--- - branch: MAIN date: Sat Jan 17 17:34:07 UTC 2015 files: - new: '1.9' old: '1.8' path: pkgsrc/mail/rspamd/Makefile pathrev: pkgsrc/mail/rspamd/Makefile@1.9 type: modified - new: '1.2' old: '1.1' path: pkgsrc/mail/rspamd/PLIST pathrev: pkgsrc/mail/rspamd/PLIST@1.2 type: modified - new: '1.3' old: '1.2' path: pkgsrc/mail/rspamd/distinfo pathrev: pkgsrc/mail/rspamd/distinfo@1.3 type: modified - new: '1.1' old: '0' path: pkgsrc/mail/rspamd/patches/patch-src_client_rspamc.c pathrev: pkgsrc/mail/rspamd/patches/patch-src_client_rspamc.c@1.1 type: added - new: '1.1' old: '0' path: pkgsrc/mail/rspamd/patches/patch-src_lua_lua__task.c pathrev: pkgsrc/mail/rspamd/patches/patch-src_lua_lua__task.c@1.1 type: added id: 20150117T173407Z.6d5b85bebc2e16ffb82173349c671379f3aae3aa log: "Update to 0.8.0\n\n0.8.0:\n\t* New fuzzy check logic:\n\t\t- use shingles algorithm for fuzzy matching\n\t\t- use blake2 instead of md5 for larger output space\n\t\t- combine fuzzy and strict matching\n\t\t- allow to organize private storages by means of keys\n\t\t- preserve compatibility with previous versions\n\t* New fuzzy storage:\n\t\t- use sqlite instead of own memory based hash tables\n\t\t- rework commands interface\n\t\t- add conversion from the old format\n\t\t- add fuzzy match by shignles\n\t\t- support old rspamd versions\n\t* Add lemmatizing for words used in fuzzy hashes that allows to improve match\n\tquality by using of the first forms of all words\n\t* Rework language detection\n\t* Fix several critical bugs, memory leaks and deadlocks:\n\t\t- memory leak in HTML nodes parsing\n\t\t- deadlock in logger code\n\t\t- deadlock in signals processing\n\t\t- crashes in fuzzy_storage\n\t\t- crashes in tokenizers if the input was empty\n\t* Import new libucl with several bugfixes and improvements\n\t* Support listening on ipv6 addresses only\n\t* Fix macro expansion in SPF module\n\t* Several bugfixes in DKIM module\n\t* Add load headers support for mime parts to the lua API\n\t* Add documentation for:\n\t\t- workers in general\n\t\t- fuzzy_storage worker\n\t\t- fuzzy_check plugin\n\t\t- mimepart and textpart lua API modules\n\n0.7.6:\n\t* Apply boundary fix for dkim simple canonization\n\t* Fix ping command\n\t* Return nil if header was not found in lua_task\n\t* Fix hang in upstreams revive logic\n\t* Decode entitles when normalizing HTML parts\n\t* Fix logic of finding URLs in HTML parts\n\t* Do not include \\0 into length of text when performing conversion to utf8\n\t* Fix raw vs parsed reperesentations\n\t\tRaw parts are now:\n\t\t\t- decoded b64/qp, but *NOT* converted to utf-8\n\t\tProcessed parts are now:\n\t\t\t- converted to UTF-8\n\t\t\t- normalized if needed (e.g. HTML tags are stripped)\n\t* Rework DKIM canonization to line based\n\t* Fix fuzzy hashes addding\n\t* Use more specific hash function for fuzzy\n\t* Fix leaking of iconv descriptors\n\t* Fix PTR resolving in lua resolver\n\t* Rework spf module.\n\t\t- Copy data to memory pool as cached record might be destroyed causing\n\t\t freed memory being passed to the protocol output (use after free)\n\t\t- Allow SPF_NEUTRAL policy to be handled separately\n\t\t- Add R_SPF_NEUTRAL to the default config\n\t* Rework `register_symbols` function\n\t* Allow to disable components of hfilter\n\n0.7.5:\n\t* Fix owner when creating folder /run/rspamd (by @sfirmery)\n\t* Fix IP validity checks\n\t* Decode URLs obtained from HTML tags\n\t* Fix crash with unweighted upstreams\n\t* Stop processing headers in parts\n\t* Set sockaddr.sa_family properly when connectig to upstreams\n\t* Fix reload issues in surbl and fuzzy_check (reported by @citrin)\n\t* Fix timeouts in redirector\n\t* Improve lua errors reporting\n\t* Fix lua closures processing in libucl\n\t* Rework calling of lua functions from regexp module\n\t* Choose raw regexp for raw headers\n\t* Rework conversion to utf since glib one is broken\n\t* Ignore SGML style tags in html\n\t* Fix old bug with non-capturing https urls\n\t* Fix memory corruption on fuzzy reload (reported by @citrin)\n\t* Fix percents display in rspamc\n\t* Fix buffer update for DKIM\n\t* Do not validate utf for raw headers\n\n0.7.4:\n\t* Fix build under *BSD\n\t* Detect HAN unicode script\n\t* Implement language detection heuristic for text parts\n\t* Fix time output in history\n\t* Improve piechart coloring\n\t* Fix \\r\\n conversion in DKIM module (reported by @citrin)\n\t* Try to detect systems with no IPv6 support\n\t* Fix multiple/single values in use settings (reported by @citrin)\n\t* Rework IP addresses in upstreams:\n\t\t- Select ipv4/unix addresses if they exist and use ipv6 for ipv6 only\n\t\t upstreams (since the support of ipv6 is poor in many OSes and\n\t\t environments)\n\t\t- Free IP list on upstream destruction\n\t\t- Add test cases for addresses selection\n\t\t- Allow adding of free form IP addresses to upstreams\n * Fix endiannes in lua_radix search (reported by @citrin)\n \ * Soft shutdown should also set wanna_die flag (reported by @citrin)\n * Stop use-after-free in event loop termination\n * Fix processing of very short messages in DKIM (reported by @citrin)\n * Detect systems without shared mutexes\n \ * Fix issues with PTR and MX elements in SPF parser (reported by @citrin)\n\n0.7.3:\n\t* New upstreams code:\n\t\t- simplify upstreams API;\n\t\t- unify strings parsing in upstreams definition;\n\t\t- add configuration options for the upstreams;\n\t\t- for failed upstreams re-resolve their addresses;\n\t\t- use all resolved addresses for an upstream (round-robin);\n\t\t- implement stable hashing and use it by default for upstreams;\n\t\t- add unit test for upstreams module.\n\t* Rework signals processing in all rspamd workers:\n\t\t- signals are now processed in the event loop;\n\t\t- implement the most common signal handlers for all workers;\n\t\t- add callbacks for workers specific signal handlers\n\t* Fix critical issue with fuzzy storage:\n\t\tFuzzy stroage could not save any hashes on termination due to bugged\n\t\tsignals handling\n * Fix roll history IP storage\n * Rework ipv4/ipv6 handling in parsing addresses:\n\t\t- turn off support of IPV6_V6ONLY socket option;\n\t\t- create ipv6 socket prior to ipv4 one to handle systems with v6/v4\n\t\tsockets enabled (Linux)\n * Remove CBL as it's wholly included in Spamhaus XBL (by @fatalbanana)\n * Remove nszones.com fake RBL (by @citrin)\n \ * Fix upstreams interaction for fuzzy_check\n * Verify spf PTR records (reported by @citrin)\n * Fix spf MX records parsing\n * Add compatibility for old libevent (by @yellowman)\n * Sync bugfixes from libucl\n\n0.7.2:\n\t* Convert all maps to the compressed radix trie\n\t* Allow IPv6 addresses in IP maps\n\t* Remove dynamic items support from symbols cache\n\t* Allow hex encoded output of strings\n\t* Fix bug with control connections count\n\t* Process fuzzy weight correctly (reported by @fatalbanana)\n\t* Remove extra reference retain of http connection on error\n\t* Remove deprecated options from the default config\n\t* Add `one_shot` attr to metric's symbols\n\t* Doc: add documentation for metrics\n\t* Add Upstart job to debian packaging (by @CameronNemo)\n\t* Config: improve SURBL symbols descriptions (by @citrin)\n\t* Config: reflect SURBL changes (by @citrin):\n \ \t- Outblaze removed, malware moved to separate list:\n \thttp://www.surbl.org/news/internal/MW-malware-sublist-added-to-multi\n \ * Fix C modules initialization on restart\n * Treat single IP as a single IP in radix lists (reported by @citrin)\n * Do not touch file and core limits if not asked explicitly (reported by @citrin)\n * Improve logging for fuzzy errors\n * Block SIGPIPE for HTTP writing\n * Doc: update manual pages\n \ * Fix HTTP connection termination\n * Reduce default number of parallel requests to 8\n * Sync with libucl include features\n\n0.7.1:\n\t* Fix typo in stat output.\n\t* Fix issues with includes crossing with the system includes\n\t* Restore testing framework\n\t* Add radix trie test suite\n\t* Implement new path-compressed radix trie.\n\t - The performance benefit over the old algorithm is about 1.5 times.\n\t\t- Memory usage is significantly lower as well.\n\t - Now radix trie can accept any IPv4/IPv6 values\n\t* Various improvements to the memory pools code\n\t* Fix writing reply to a client when no filters are defined\n\t* Write base32 encoded fuzzy\n\t* Fix 'soft reject' action\n\t* Fix rspamd reload and modules reconfiguration\n\t* Fix subject rewriting for the default subject\n\t* Fix states for processing task and pre-filters\n\t* Fix issues with connection closing\n\t* Fix crashes in rdns\n\t* Fix ratelimit pre-filter\n\t* Update exim patch.\n\t\t- Update to the recent exim version\n\t\t- Strip extra leading src/ from the patch\n\t\t- Remove sendfile since it was broken\n\t\t- Fix rspamd spam report for exim\n\t* Improve documentation\n\n0.7.0:\n\t* Use HTTP protocol for all operatiosn\n\t* Webui worker is now removed and controller works as webui\n\t* Allow to serve static files via controller by option `static_dir`\n\t* Rspamd interface is now a part of rspamd\n\t* Rspamc client has been rewritten to use HTTP and non-blocking mode\n\tallowing to start multiple operations simultaneously (see `-n` option)\n\t* Lua API was completely reworked to satisfy modern standards of LUA:\n\t\t* Module `lua-message` was removed\n\t\t* Reduced number of superglobals registered by rspamd\n\t\t* Many functions has been redesigned\n\t\t* Symbols registration is now more convenient\n\t* Users settings has been rewritten as lua plugin\n\t* Reworked headers system as gmime's based one misses many headers and is\n\tvery slow to get headers values\n\t* Reorganized code and removed embedded jannsson by using UCL for all json\n\tparsing\n\t* Migrated to `librdns` for DNS resolving that improves concurrency for\n\tDNS requests significantly\n\t* Fixed tonns of bugs in MIME processing\n\t* Improved metrcis and default symbol's weights\n\t* Added new RBL's\n\t* Fixed a number of issues in the modules\n\t* Removed several memory leaks found\n\t* Fix unicode processing\n\t* Fix fuzzy checking for unicode parts\n\t* Significantly improve documentation and especially LUA API docs\n\t* See migration notes at https://rspamd.com/doc/migration.html\n" module: pkgsrc subject: 'CVS commit: pkgsrc/mail/rspamd' unixtime: '1421516047' user: wiedi