py-asttokens: updated to 1.1.13

1.1.13:
Bug fixes.

(adam)

Fix build with gtk-3.24.

Bump revision.

(bsiegert)

Flip enchant option to use enchant2.

Bump revision.

(bsiegert)

Remove incorrect patch. I will investigate the problem later

(ryoon)

Add unzip. From Minix 3.4RC6

(sevan)

Reduce whitespace noise when compared to NetBSD config. NFC

(sevan)

Add gsoelim, readlink, sdiff, shlock, soelim. From Minix 3.4RC6

(sevan)

Add the relevant parts for cross compilation on Minix. - untested but the
relevant paths are set as expected.

(sevan)

provide paths for byacc, gegrep, gfgrep, ggrep, install-info, makeinfo, openssl,
xz, xzcat on Minix. From Minix 3.4RC6

(sevan)

Updated sysutils/py-psutil

(adam)

py-psutil: updated to 5.4.8

5.4.8:

Enhancements
* [Linux] cpu_freq() is now implemented by parsing /proc/cpuinfo in case /sys/devices/system/cpu/* filesystem is not available.
* [Linux] psutil.sensors_temperatures() now parses /sys/class/thermal in case /sys/class/hwmon fs is not available (e.g. Raspberry Pi).
* [Posix] better compilation support when using g++ instead of gcc.

Bug fixes
* do not print exception on import time in case cpu_times() fails.
* [Linux] Process.io_counters() may raise ValueError.
* [OSX] available and used memory (psutil.virtual_memory()) metrics are not accurate.
* [Windows] psutil.Process().connections() may sometimes fail with intermittent 0xC0000001.
* [Linux] disk_partitions() does not honour PROCFS_PATH.
* [AIX] system CPU times (psutil.cpu_times()) were being reported with ticks unit as opposed to seconds.
* [OSX] psutil debug messages are erroneously printed all the time.
* [SunOS] net_connections() returns an empty list.

(adam)

doc: Updated sysutils/htop to 2.2.0

(jperkin)

htop: Update to 2.2.0.

What's new in htop 2.2.0:

  * Solaris/Illumos/OpenIndiana support (thanks to Guy M. Broome)
  * -t/--tree flag for starting in tree-view mode (thanks to Daniel Flanagan)
  * macOS: detects High Sierra version to avoid OS bug (thanks to Pierre
    Malhaire)
  * OpenBSD: read battery data (thanks to @nerd972)
  * Various automake and build improvements (thanks to Kang-Che Sung)
  * Check for pkg-config when building with --enable-delayacct (thanks to
    @florian2833z for the report)
  * Avoid some bashisms in configure script (thanks to Jesin)
  * Use CFLAGS from ncurses*-config if present (thanks to Michael Klein)
  * Header generator supports non-UTF-8 environments (thanks to @volkov-am)
  * Linux: changed detection of kernel threads
  * Collapse current subtree pressing Backspace
  * BUGFIX: fix behavior of SYSCR column (thanks to Marc Kleine-Budde)
  * BUGFIX: obtain exit code of lsof correctly (thanks to @wangqr)
  * BUGFIX: fix crash with particular keycodes (thanks to Wellington Torrejais
    da Silva for the report)
  * BUGFIX: fix issue with small terminals (thanks to Daniel Elf for the report)
  * BUGFIX: fix terminal color issues (thanks to Kang-Che Sung for the report)
  * BUGFIX: preserve LDFLAGS when building (thanks to Lance Frederickson for
    the report)
  * BUGFIX: fixed overflow for systems with >= 100 signals

What's new in htop 2.1.0:

* Linux: Delay accounting metrics (thanks to Andr辿 Carvalho)
* DragonFly BSD support (thanks to Diederik de Groot)
* Support for real-time signals (thanks to Kang-Che Sung)
* 'c' key now works with threads as well
* Session column renamed from SESN to SID (thanks to Kamyar Rasta)
* Improved UI for meter style selection (thanks to Kang-Che Sung)
* Improved code for constructing process tree (thanks to wangqr)
* Compile-time option to disable setuid
* Error checking of various standard library operations
* Replacement of sprintf with snprintf (thanks to Tomasz Kramkowski)
* Linux: performance improvements in battery meter
* Linux: update process TTY device
* Linux: add support for sorting TASK_IDLE (thanks to Vladimir Panteleev)
* Linux: add upper-bound to running process counter (thanks to Lucas Correia
  Villa Real)
* BUGFIX: avoid crash when battery is removed (thanks to Jan Chren)
* BUGFIX: macOS: fix infinite loop in tree view (thanks to Wataru Ashihara)

(jperkin)

Updated archivers/py-lz4, math/py-numpy

(adam)

py-numpy: updated to 1.15.4

NumPy 1.15.4:

This is a bugfix release for bugs and regressions reported following the 1.15.3
release.  The Python versions supported by this release are 2.7, 3.4-3.7. The
wheels are linked with OpenBLAS v0.3.0, which should fix some of the linalg
problems reported for NumPy 1.14.

(adam)

py-lz4: updated to 2.1.2

2.1.2:
Improves the speed of importing the module by avoiding the use of pkg_resources
Fixes some flake8 warnings
Resolves a small issue with the test suite when detecting memory usage increases

(adam)

Updated devel/py-hypothesis, devel/py-test

(adam)

py-test: updated to 3.10.0

pytest 3.10.0:

Features
* Resume capturing output after continue with __import__("pdb").set_trace().
  This also adds a new pytest_leave_pdb hook, and passes in pdb to the existing pytest_enter_pdb hook.
* Add -sw, --stepwise as an alternative to --lf -x for stopping at the first failure, but starting the next test invocation from that test. See the documentation for more info.
* Make --color emit colorful dots when not running in verbose mode. Earlier, it would only colorize the test-by-test output if --verbose was also passed.
* Improve performance with collection reporting in non-quiet mode with terminals.
  The ���collecting ��⓽�� message is only printed/updated every 0.5s.

Bug Fixes
* Fix false RemovedInPytest4Warning: usage of Session... is deprecated, please use pytest warnings.
* Fix problems with running tests in package __init__.py files.
* Swallow warnings during anonymous compilation of source.
* Fix access denied error when deleting stale directories created by tmpdir / tmp_path.
* Naming a fixture request will now raise a warning: the request fixture is internal and should not be overwritten as it will lead to internal errors.
* Handle (ignore) exceptions raised during collection, e.g. with Django���s LazySettings proxy class.

Improved Documentation
* Added missing documentation about the fact that module names passed to filter warnings are not regex-escaped.

Trivial/Internal Changes
* Display cachedir also in non-verbose mode if non-default.
* pdb: improve message about output capturing with set_trace.
  Do not display ���IO-capturing turned off/on��� when -s is used to avoid confusion.
* Improve message and stack level of warnings issued by monkeypatch.setenv when the value of the environment variable is not a str.

(adam)

py-hypothesis: updated to 3.82.1

3.82.1:
This patch fixes :func:~hypothesis.strategies.from_type on Python 2 for classes where cls.__init__ is object.__init__.

3.82.0:
The alphabet argument for :func:~hypothesis.strategies.text now uses its default value of characters(blacklist_categories=('Cs',)) directly, instead of hiding that behind alphabet=None and replacing it within the function. Passing None is therefore deprecated.

(adam)

qemu 3.0.0nb3

(skrll)

Support the uboot kernel_noload image type as used by NetBSD/evbarm
GENERIC kernel.

Bump PKGREVISION

(skrll)

doc: Updated textproc/xapian-omega to 1.4.9

(schmonz)

Update to 1.4.9. From the changelog:

indexers:

* omindex:

  + Try harder to avoid opening a file being indexed more than once by
    reusing the file descriptor in more cases.

  + Hint to the OS not to cache output from external filters which require
    using a temporary file.

* scriptindex:

  + If the LOAD action successfully opens a file but hits a read error the
    error message now reports the file name correctly.  Previously it would
    report the partial file contents read so far instead of the file name.

portability:

* We no longer call posix_fadvise() with POSIX_FADV_NOREUSE under Linux,
  since it's still not implemented there.  We also now only call
  posix_fadvise() with POSIX_FADV_DONTNEED right before we close the file
  descriptor under Linux.

(schmonz)

doc: Updated textproc/xapian to 1.4.9

(schmonz)

Update to 1.4.9. From the changelog:

API:

* Document::add_posting(): Fix bugs with the change in 1.4.8 to more
  efficiently handle insertion of a batch of extra positions in ascending
  order.  These could lead to missing positions and corrupted encoded
  positional data.

remote backend:

* Avoid hang if remote connection shutdown fails by not waiting for the
  connection to close in this situation.  Seems to fix occasional hangs seen on
  macOS.  Patch from Germ叩n M. Bravo.

(schmonz)

gpxsee: simplify Makefile

(adam)

Updated archivers/py-zstandard, www/py-urllib3, net/py-responses

(adam)

py-responses: updated to 0.10.2

0.10.2
- Fixed build setup to use undeprecated pytest bin stub.
- Updated tox configuration.
- Added example of using responses with pytest.fixture
- Removed dependency on biscuits in py3. Instead http.cookies is being used.

0.10.1
- Packaging fix to distribute wheel

0.10.0
- Fix passing through extra settings
- Fix collections.abc warning on Python 3.7
- Use 'biscuits' library instead of 'cookies' on Python 3.4+

(adam)

py-flake8: Fix DEPENDS

(adam)

py-urllib3: updated to 1.24.1

1.24.1:
* Remove quadratic behavior within GzipDecoder.decompress()
* Restored functionality of ciphers parameter for create_urllib3_context()

(adam)

py-zstandard: updated to 0.10.2

0.10.2:

Bug Fixes
* zstd_cffi.py added to setup.py

Changes
* Change some integer casts to avoid ssize_t

(adam)

doc/TODO: add some

+ ImageMagick-7.0.8.14, brotli-1.0.7, cabextract-1.8, dconf-0.30.1,
  gmime3-3.2.1, harfbuzz-2.1.0, itstool-2.0.5, latexmk-461,
  libcares-1.15.0, libgit2-0.27.7, libmspack-0.8, librsvg-2.44.8
  [needs rust+cargo], mpc-0.31, musicpd-0.21, nickle-2.84,
  poppler-0.71.0, py-mercurial-4.8, subversion-base-1.11.0,
  tea-46.3.0, tor-0.3.4.9, xcb-util-0.4.1.

(wiz)

ticket #5874

(spz)

Pullup ticket #5874 - requested by taca
www/ruby-loofah: security update

Revisions pulled up:
- www/ruby-loofah/Makefile                                      1.5
- www/ruby-loofah/PLIST                                        1.4
- www/ruby-loofah/distinfo                                      1.5

-------------------------------------------------------------------
  Module Name: pkgsrc
  Committed By: taca
  Date: Thu Nov  1 16:11:45 UTC 2018

  Modified Files:
  pkgsrc/www/ruby-loofah: Makefile PLIST distinfo

  Log Message:
  www/ruby-loofah: update to 2.2.3

  ## 2.2.3 / 2018-10-30

  ### Security

  Address CVE-2018-16468: Unsanitized JavaScript may occur in sanitized output when a crafted SVG element is republished.

  This CVE's public notice is at https://github.com/flavorjones/loofah/issues/154

  ## Meta / 2018-10-27

  The mailing list is now on Google Groups [#146](https://github.com/flavorjones/loofah/issues/146):

  * Mail: loofah-talk@googlegroups.com
  * Archive: https://groups.google.com/forum/#!forum/loofah-talk

  This change was made because librelist no longer appears to be maintained.

  To generate a diff of this commit:
  cvs rdiff -u -r1.4 -r1.5 pkgsrc/www/ruby-loofah/Makefile \
      pkgsrc/www/ruby-loofah/distinfo
  cvs rdiff -u -r1.3 -r1.4 pkgsrc/www/ruby-loofah/PLIST

(spz)

Revbump all Go packages after go111 update.

(bsiegert)

This file was missing from the previous commit.

go111-1.11.2.

(bsiegert)

Update go111 to 1.11.2.

go1.11.2 (released 2018/11/02) includes fixes to the compiler, linker,
documentation, go command, and the database/sql and go/types packages. See the
Go 1.11.2 milestone on our issue tracker for details.

(bsiegert)

Only configure libuuid using ksh on NetBSD 6.

The build of ksh is all but broken on modern systems. PR pkg/52877
introduced ksh as CONFIGURE_SHELL to fix NetBSD 6, but this causes issues
on NetBSD-8 and later (PR pkg/53686). Arguably, the workaround could be
dropped, since we stopped supporting NetBSD 6.

Fix proposed by David H. Gutteridge, thanks!

(bsiegert)

Enable the psl option by default for wget.

Enabling the PSL is a good thing for security and privacy, as it protects
against all sorts of cookie shenanigans.

Bump revision.

(bsiegert)

mpich-3.2.1
go110-1.10.5

(bsiegert)

Update go110 to 1.10.5.

go1.10.5 (released 2018/11/02) includes fixes to the go command, linker,
runtime and the database/sql package. See the Go 1.10.5 milestone on our issue
tracker for details.

(bsiegert)

Update mpich to 3.2.1.

Patch from Eric A. Borisch via pull request.
Closes NetBSD/pkgsrc#38.

Remove patches no longer needed; migrate to configure option for rpath.

===============================================================================
                              Changes in 3.2.1
===============================================================================

# Fixes for platforms with strict memory alignment requirements.

# Fixes for MPI_Win info management.

# Fixed a progress bug with MPI generalized requests.

# Fixed multiple integer overflow bugs in CH3 and ROMIO.

# Improved detection for Fortran 2008 binding support.

# Enhanced support for libfabric (OFI) netmod.

# Several other minor bug fixes, memory leak fixes, and code cleanup.

  A full list of changes is available at the following link:

    http://git.mpich.org/mpich.git/shortlog/v3.2..v3.2.1

(bsiegert)

Updated devel/memcached, www/py-paste

(adam)

firefox: improve usize type confusion workaround.

cbindgen gets confused by netbsd's #define uintptr_t..., undef it
pkg/2018/10/25/msg020395.html">https://mail-index.netbsd.org/tech-pkg/2018/10/25/msg020395.html

(maya)

py-paste: updated to 3.0.3

3.0.3
* Ensure pytest requirements set properly.

3.0.2
* Encoding fixes in paste.fixture.

3.0.1
* Remove use of future for sake of html.escape and use own. Using
  future was causing installation loops.

3.0.0
* Fixes for use with Python 3.7, mostly to do with StopIteration.
* Moving to https://github.com/cdent/paste to keep things maintained.

(adam)

memcached: updated to 1.5.12

Memcached 1.5.12

Overview
Single bugfix release. Fixes a refcount leak that could happen when attempting to run incr/decr against a:

* 0 byte value
* CHUNKED (> 512k) item
* extstore item that has been flushed to disk

Fixes
fix INCR/DECR refcount leak for invalid items

(adam)

Restore accidentally removed comments, pointed by wiz@. Thank you.

(ryoon)

Updated www/firefox-l10n to 63.0.1

(ryoon)

Update tp 63.0.1

* Sync with www/firefox-63.0.1

(ryoon)

Fix build under NetBSD/i386 7, reported in PR pkg/53698.

(ryoon)

Updated www/firefox to 63.0.1

(ryoon)

Update to 63.0.1

* Minimize pkgsrc specific patches.
* A build system written in Rust lang does not find a C++ header files
  from pkgsrc (non-base) GCC, this version is not buildable on NetBSD 7.
  I will investigate this problem again.

Changelog:
63.0.1
Fixed

    Snippets are not loaded due to missing element (bug 1503047)

    Print preview always shows 30% scale when it is actually Shrink To Fit
    (bug 1501952)

    Dialog displayed when closing multiple windows shows unreplaced %1$S
    placeholder in Japanese and potentially other locales (bug 1500823)

63.0
New

    Performance and visual improvements for Windows users

    Performance improvements for macOS users

    Added content blocking, a collection of Firefox settings that offer
    users greater control over technology that can track them around the
    web. In 63, users can opt to block third-party tracking cookies or
    block all trackers and create exceptions for trusted sites that don't
    work correctly with content blocking enabled.

    WebExtensions now run in their own process on Linux

    Firefox now warns about having multiple windows and tabs open
    when quitting from the main menu. The Save and Quit feature has been
    removed. You can restore your session by ticking the box for Restore
    previous session in the General->Startup options or by using Restore
    Previous Session in the main menu.

    Firefox now recognizes the operating system accessibility setting for
    reducing animation

    Added search shortcuts for Top Sites: Amazon and Google appear as Top
    Sites tiles on the Firefox Home (New Tab) page. When selected these
    tiles will change focus to the address bar to initiate a search.
    Currently in US only.

Fixed

    Resolved an issue that prevented the address bar from autofilling
    bookmarked URLs in certain cases

    Various security fixes

Changed

    In the Library, the Open in Sidebar feature for individual bookmarks
    was removed

    The option to Never check for updates was removed from about:preferences.
    You can use the DisableAppUpdate enterprise policy as a substitute.

    The Ctrl+Tab shortcut now displays thumbnail previews of your tabs and
    cycles through tabs in recently used order. This new default behavior
    is activated only in new profiles and can be changed in preferences.

#CVE-2018-12391: HTTP Live Stream audio data is accessible cross-origin
#CVE-2018-12392: Crash with nested event loops
#CVE-2018-12393: Integer overflow during Unicode conversion while loading JavaScript
#CVE-2018-12395: WebExtension bypass of domain restrictions through header rewriting
#CVE-2018-12396: WebExtension content scripts can execute in disallowed contexts
#CVE-2018-12397: Missing warning prompt when WebExtension requests local file access
#CVE-2018-12398: CSP bypass through stylesheet injection in resource URIs
#CVE-2018-12399: Spoofing of protocol registration notification bar
#CVE-2018-12400: Favicons are cached in private browsing mode on Firefox for Android
#CVE-2018-12401: DOS attack through special resource URI parsing
#CVE-2018-12402: SameSite cookies leak when pages are explicitly saved
#CVE-2018-12403: Mixed content warning is not displayed when HTTPS page loads a favicon over HTTP
#CVE-2018-12388: Memory safety bugs fixed in Firefox 63
#CVE-2018-12390: Memory safety bugs fixed in Firefox 63 and Firefox ESR 60.3

(ryoon)

Updated devel/nss to 3.40

(ryoon)

Update to 3.40

Changelog:
Notable bug fixes:
* Bug 1478698 - FFDHE key exchange sometimes fails with decryption failure

New functionality:
* The draft-00 version of encrypted SNI support is implemented
* tstclnt now takes -N option to specify encrypted SNI key

Notable changes:
* The mozilla::pkix library has been ported from Mozilla PSM to NSS.
  This is a C++ library for building certification paths.
  mozilla::pkix APIs are not exposed in the libraries NSS builds.
* It is easier to build NSS on Windows in mozilla-build environments.
* The following CA certificates were Removed:
    CN = Visa eCommerce Root

(ryoon)

Added devel/cbindgen version 0.6.6

(ryoon)

Add cbindgen

(ryoon)

devel/cbindgen: import cbindgen-0.6.6

This project can be used to generate C bindings for Rust code. It
is currently being developed to support creating bindings for
WebRender, but has been designed to support any project.

cbindgen-0.6.7 is not compatible with www/firefox-63.0.1.

(ryoon)

tea: update some links

(wiz)

Revbump after devel/go-siphash update.

(alnsn)

Updated devel/go-siphash to 1.2.0.

(alnsn)

Update devel/go-siphash to v1.2.0.

Changelog:

Removed ARM assembly implementation (ARM will use pure Go implementation now) because it had a bug #15.
While there was no changes regarding compiler versions, it doesn't make sense to support Go 1.1.

(alnsn)

doc: Updated mail/qmail-run to 20181103

(schmonz)

When tagging log entries, insert "/" between "nbqmail" and the rest of
the tag; for instance, "nbqmailofmipd" becomes "nbqmail/ofmipd". Vaguely
redolent of Postfix, and easier to glance at logs now that just about
everything runs similarly from rc.d. Turn off sslserver verbosity by
default. Bump version.

(schmonz)

doc: Updated net/fehqlibs to 0.9nb1

(schmonz)

Look for /etc/dnsrewrite under PKG_SYSCONFBASE. Bump PKGREVISION.

(schmonz)

doc: Updated net/youtube-dl to 20181103

(leot)

youtube-dl: Update net/youtube-dl to 20181103

Changes:
version 2018.11.03

Core
* [extractor/common] Ensure response handle is not prematurely closed before
  it can be read if it matches expected_status (#17195, #17846, #17447)

Extractors
* [laola1tv:embed] Set correct stream access URL scheme (#16341)
+ [ehftv] Add support for ehftv.com (#15408)
* [azmedien] Adopt to major site redesign (#17745, #17746)
+ [twitcasting] Add support for twitcasting.tv (#17981)
* [orf:tvthek] Fix extraction (#17737, #17956, #18024)
+ [openload] Add support for oload.fun (#18045)
* [njpwworld] Fix authentication (#17427)
+ [linkedin:learning] Add support for linkedin.com/learning (#13545)
* [theplatform] Improve error detection (#13222)
* [cnbc] Simplify extraction (#14280, #17110)
+ [cbnc] Add support for new URL schema (#14193)
* [aparat] Improve extraction and extract more metadata (#17445, #18008)
* [aparat] Fix extraction

(leot)

jq: Clarify a bit the comment of patch-Makefile.am

(leot)

doc: Updated devel/jq to 1.6

(leot)

jq: Update devel/jq to 1.6

pkgsrc changes:
- Use GITHUB_RELEASE instead of GITHUB_TAG because the former does not need
  auto* tools (despite we need auto* tools for patches/, hopefully one day they
  will be applied!)
- Remove no longer needed SUBST_*, `git describe' is no longer used
- Remove patch-src_jv__parse.c and patch-src_jv__print.c, they are
  present in 1.6
- Rename and readjust patch-Makefile.in to patch-Makefile.am
  (pre-configure target rewrote it due `autoreconf')

Changes:
1.6
---
New in this release since 1.5:
- Destructuring Alternation
- New Builtins:
  * builtins/0
  * stderr/0
  * halt/0, halt_error/1
  * isempty/1
  * walk/1
  * utf8bytelength/1
  * localtime/0, strflocaltime/1
  * SQL-style builtins
  * and more!
- Add support for ASAN and UBSAN
- Make it easier to use jq with shebangs (8f6f28c)
- Add $ENV builtin variable to access environment
- Add JQ_COLORS env var for configuring the output colors

Bug fixes:
- Calling jq without a program argument now always assumes . for the program,
  regardless of stdin/stdout. (5fe0536)
- Make sorting stable regardless of qsort. (7835a72)
- Adds a local oniguruma submodule and the
  `./configure --with-oniguruma=builtin' option to make it easier to build
  with oniguruma support on systems where you can't install system-level
  libraries. (c6374b6 and 02bad4b)
- And much more!

(leot)

note amavisd-new update

(spz)

Update to amavisd-new-2.11.1, upstream release notes:

- removed a trailing dot element from @INC, as a workaround for a perl
  vulnerability CVE-2016-1238;

- amavis-services: bumping up syslog level from LOG_NOTICE to LOG_ERR
  for a message "PID <pid> went away", and removed redundant newlines
  from some log messages;

- safe_decode() and safe_decode_utf8(): avoid warning messages
    "Use of uninitialized value in subroutine entry"
  in Encode::MIME::Header when the $check argument is undefined;

- @sa_userconf_maps has been extended to allow loading of per-recipient
  (or per- policy bank, or global) SpamAssassin configuration set from
  LDAP. For consistency with SQL a @sa_userconf_maps entry prefixed with
  'ldap:' will load SpamAssassin configuration set using the
  load_scoreonly_ldap() method;  a patch by Atanas Karashenski;

- add some Sanesecurity.Foxhole false positives to the default
  list @virus_name_to_spam_score_maps;

- updated some comments;

+++
also add a patch to make it run with perl 5.28 without complaints
about regex syntax

(spz)

ffmpeg4: remove no-longer-installed entries from PLIST.
This affects people who use the 'doc' option.

From relaxed on freenode, thanks!

(maya)

Remove outdated comment.

(wiz)

doc: Updated x11/xf86-video-r128 to 6.12.0

(wiz)

xf86-video-r128: update to 6.12.0.

This release is mainly meant deal with 2 urgent build failure issues
reported by users.
If your distribution is using Version 6.11.0, please replace it
with this version as soon as possible.
There is very little change in the functionality compared to the
previous release, but I did rewrite hard to maintain and very
awkwardly written XAA / EXA initialization code.
It is always possible that I can mess up the code, but it appears
that the code is working correctly.

(wiz)

Updated graphics/tesseract, textproc/py-jsbeautifier

(adam)

py-jsbeautifier: updated to 1.8.8

v1.8.8:
async function in object wrong indentation

(adam)

tesseract: updated to 4.0.0

V4.0.0:
New OCR engine
- Added a new OCR engine that uses neural network system based on LSTMs, with major accuracy gains.
- This includes new training tools for the LSTM OCR engine. A new model can be trained from scratch or by fine tuning an existing model.
- Added trained data that includes LSTM models to 123 languages.
- Added optional accelerated code paths for the LSTM recognizer:
  * Using OpenMP
  * Using SIMD: AVX2 / AVX / SSE4.1
- Added a new parameter lstm_choice_mode that allows to include alternative symbol choices in the hOCR output.
- The new LSTM engine still does not support all features from the old legacy engine (see missing features).

Other OCR engines
- The pattern matching OCR engine that was the primary OCR engine in previous versions is still available in this version.
- Removed the 'Cube' OCR engine from the codebase. It was used for Hindi and for Arabic. The New LSTM engine performs much better, thus the Cube engine was no longer needed.

Updated build system
- Tesseract now uses semantic versioning.
- Tesseract now requires Leptonica 1.74.0 or a higher version.
- For building Tesseract from source code, a compiler with good C++ 11 support is required. See here for a list of officially supported compilers.
- Added unit tests to the main repo. The unit tests require Git submodules and the code for training.
- Added an option to compile Tesseract without the code of the legacy OCR engine.
- Update minimum required autoconf version to 2.63.
- Training tools dependencies - Update minimum required versions: ICU 52.1, Pango 1.22.0.
- Reorganized Tesseract's source tree. Most sources are now below the src directory.

Bug fixes and enhancements
- Fixed many issues that triggered compiler warnings.
- Fixed many issues reported by Coverity Scan or LGTM.
- Fixes to trainingdata rendering.
- Fixed damage to binary images when processing PDFs.
- Don't trigger a deliberate segmentation fault for fatal errors in release code.
- Fixed some issues in OpenCL code. OpenCL now works for the legacy Tesseract OCR engine, but does not improve the performance. It is not implemented for the LSTM OCR engine.
- Improved multi-page TIFF handling.
- Improvements to PDF rendering.
- Added version information and improved help texts to the training tools.
- Added faster version of log2().
- Documented in tesseract man page the option to use an input text file which contains lists of images.
- Made 'osd' the default traineddata when psm 0 is requested (currently this feature is only implemented in the command line interface, but not in the API).
- Removed tessedit_pageseg_mode 1 from hocr, pdf, and tsv config files. The user should explicitly use --psm 1 if that is desired.
- The list of available languages and scripts is now sorted alphabetically.
- Parameter unlv_tilde_crunching changed to false, because of default values cause issues in cases of unlv output in Tesseract 4.
- Removed obsolete code.

(adam)

Updated multimedia/ffmpeg4, multimedia/ffmpeg3

(adam)

ffmpeg3: updated to 3.4.5

version 3.4.5:
- avutil/integer: Fix integer overflow in av_mul_i()
- avcodec/msrle: Check that the input is large enough to contain a end of picture code
- avcodec/jpeg2000dec: Fix off by 1 error in JPEG2000_PGOD_CPRL handling
- avcodec/mpeg4videodec: Fix typo in sprite delta check
- avcodec/h264_cavlc: Check mb_skip_run
- avcodec/ra144: Fix integer overflow in add_wav()
- avformat/utils: Never store negative values in last_IP_duration
- avformat/utils: Fix integer overflow in discontinuity check
- avcodec/unary: Improve get_unary() docs
- avcodec/gdv: Replace divisions by shifts in rescale()
- avcodec/dvdsubdec: Sanity check len in decode_rle()
- avcodec/mpeg4videodec: Fix undefined shift in get_amv()
- avcodec/zmbv: Check that the decompressed data size is correct
- avcodec/zmbv: Update decomp_len in raw frames
- avcodec/shorten: Fix bitstream end check in read_header()
- avcodec/dvdsubdec: Avoid branch in decode_run_8bit()
- avcodec/h264_refs: Document last if() in ff_h264_execute_ref_pic_marking()
- avcodec/ra144: Fix undefined integer overflow in add_wav()
- avcodec/indeo4: Check dimensions in decode_pic_hdr()
- avformat/mov: Error on too large stsd entry counts.
- examples: Fix use of AV_CODEC_FLAG_GLOBAL_HEADER
- avcodec/hq_hqa: Check remaining input bits in hqa_decode_mb()
- avcodec/vb: Check for end of bytestream before reading blocktype
- avcodec/snowdec: Fix integer overflow with motion vector residual
- avformat/nsvdec: Do not parse multiple NSVf
- avformat/mlvdec: read_string() received unsigned size, make the argument unsigned
- avformat/rmdec: Fix EOF check in the stream loop in ivr_read_header()
- avcodec/scpr: Check for min > max in decompress_p()
- avcodec/shorten: Fix signed 32bit overflow in shift in shorten_decode_frame()
- avcodec/shorten: Fix integer overflow in residual/LPC combination
- avcodec/shorten: Check verbatim length
- avcodec/mpegaudio_parser: Initialize poutbuf*
- avcodec/aacpsdsp_template: Fix integer overflow in ps_stereo_interpolate_c()
- avformat/flvenc: Check audio packet size
- lavc/svq3: Fix regression decoding some files.
- avcodec/qtrle: Check remaining bytestream in qtrle_decode_XYbpp()
- avcodec/diracdec: Check bytes count in else branch in decode_lowdelay() too
- avcodec/diracdec: Check slice numbers for overflows in relation to picture dimensions
- avcodec/diracdec: Change frame_number to 64bit as its a 32bit from the bitstream and we also have a -1 special case
- avcodec/dirac_dwt_template: Fix several integer overflows in horizontal_compose_daub97i()
- avcodec/diracdec: Prevent integer overflow in intermediate in global_mv()
- swresample/swresample: Fix input channel count in resample_first computation
- avutil/pixfmt: Document chroma plane size for odd resolutions
- avcodec/cuviddec: properly take deinterlacing and display delay into account for buffer_full check
- configure: add LIBDRM to extralibs_avutil
- avcodec/bitstream_filters: check the input argument of av_bsf_get_by_name() for NUL

(adam)

ffmpeg4: updated to 4.0.3

version 4.0.3:
- avutil/integer: Fix integer overflow in av_mul_i()
- avcodec/msrle: Check that the input is large enough to contain a end of picture code
- avformat/ftp: return AVERROR_EOF for EOF
- avcodec/libx264: remove FF_CODEC_CAP_INIT_THREADSAFE flag
- avcodec/jpeg2000dec: Fix off by 1 error in JPEG2000_PGOD_CPRL handling
- avcodec/mpeg4videodec: Fix typo in sprite delta check
- avcodec/h264_cavlc: Check mb_skip_run
- avcodec/ra144: Fix integer overflow in add_wav()
- avformat/utils: Never store negative values in last_IP_duration
- avformat/utils: Fix integer overflow in discontinuity check
- Revert "avcodec/cbs_h264: silence errors about end_of_seq nalus"
- avcodec/cbs: ensure user_data is padded for GBC parsing
- avcodec/cbs: fix crash in sei_pic_timestamp
- avcodec/cbs_h264: silence errors about end_of_seq nalus
- avcodec/cuviddec: properly take deinterlacing and display delay into account for buffer_full check
- avcodec/h2645_parse: skip NALUs with no content after stripping all the trailing zeros
- configure: <fflib>_deps: validate, reduce sensitivity
- configure: speed up check_deps()
- configure: speed up print_enabled_components()
- configure: speed up flatten_extralibs_wrapper()
- avformat/utils: Fix potential integer overflow in extract_extradata()
- avcodec/unary: Improve get_unary() docs
- avcodec/gdv: Replace divisions by shifts in rescale()
- avcodec/ac3dec: Fix shift signedness in mask creation
- avcodec/eac3dec: Check that channel_map does not contain more than EAC3_MAX_CHANNELS
- doc/examples/vaapi_transcode: Fix the typo
- avcodec/dvdsubdec: Sanity check len in decode_rle()
- avcodec/mpeg4videodec: Fix undefined shift in get_amv()
- avcodec/zmbv: Check that the decompressed data size is correct
- avcodec/zmbv: Update decomp_len in raw frames
- avcodec/shorten: Fix bitstream end check in read_header()
- avcodec/dvdsubdec: Avoid branch in decode_run_8bit()
- avcodec/h264_refs: Document last if() in ff_h264_execute_ref_pic_marking()
- avcodec/ra144: Fix undefined integer overflow in add_wav()
- avcodec/indeo4: Check dimensions in decode_pic_hdr()
- avformat/mov: Error on too large stsd entry counts.
- examples: Fix use of AV_CODEC_FLAG_GLOBAL_HEADER
- avcodec/hq_hqa: Check remaining input bits in hqa_decode_mb()
- avcodec/vb: Check for end of bytestream before reading blocktype
- avcodec/snowdec: Fix integer overflow with motion vector residual
- avcodec/mpeg4videodec: Fix slice end detection in mpeg4_decode_studio_mb()
- avformat/nsvdec: Do not parse multiple NSVf
- avformat/dashdec: Fix strlen(rep_id_val) with it being NULL
- avformat/mlvdec: read_string() received unsigned size, make the argument unsigned
- avformat/rmdec: Fix EOF check in the stream loop in ivr_read_header()
- avcodec/scpr: Check for min > max in decompress_p()
- avcodec/shorten: Fix signed 32bit overflow in shift in shorten_decode_frame()
- avcodec/shorten: Fix integer overflow in residual/LPC combination
- avcodec/shorten: Check verbatim length
- avcodec/mpegaudio_parser: Initialize poutbuf*
- avcodec/aacpsdsp_template: Fix integer overflow in ps_stereo_interpolate_c()
- avformat/flvenc: Check audio packet size
- lavc/svq3: Fix regression decoding some files.
- avcodec/mlp_parser: Check if synccode is within buffer
- avcodec/qtrle: Check remaining bytestream in qtrle_decode_XYbpp()
- avcodec/diracdec: Check bytes count in else branch in decode_lowdelay() too
- avcodec/diracdec: Check slice numbers for overflows in relation to picture dimensions
- avcodec/diracdec: Change frame_number to 64bit as its a 32bit from the bitstream and we also have a -1 special case
- avcodec/dirac_dwt_template: Fix several integer overflows in horizontal_compose_daub97i()
- avcodec/diracdec: Prevent integer overflow in intermediate in global_mv()
- swresample/swresample: Fix input channel count in resample_first computation
- avutil/pixfmt: Document chroma plane size for odd resolutions
- lavf/libsmbclient: return AVERROR_EOF for EOF.
- lavc/videotoolboxenc: Fix compilation on osx 10.10.5 Yosemite
- avcodec/mediacodecdec: fix SEGV on modern nvidia decoders
- avcodec/bitstream_filters: check the input argument of av_bsf_get_by_name() for NULL
- avformat/librtmp: fix returning EOF from Read/Write
- avcodec/videotoolboxenc: fix undefined behavior with rc_max_rate=0

(adam)

Updated graphics/libimagequant, security/libgcrypt

(adam)

libgcrypt: updated to 1.8.4

Noteworthy changes in version 1.8.4:
* Bug fixes:
  - Fix infinite loop due to applications using fork the wrong
    way.
  - Fix possible leak of a few bits of secret primes to pageable
    memory.
  - Fix possible hang in the RNG (1.8.3 only).
  - Several minor fixes.

* Performance:
  - On Linux always make use of getrandom if possible and then use
    its /dev/urandom behaviour.

(adam)

libimagequant: updated to 2.12.2

2.12.2:
Unknown changes

(adam)

doc: Updated chat/jabberd2 to 2.7.0

(gdt)

jabberd2: update to 2.7.0

Upstream changes:

  - openssl-1.1 support
  - Python script to export data in XEP-0227 format
  - Fix build errors with MariaDB 10.2
  - systemd units restart on failure
  - Use systemd BindsTo= instead of BindTo.

(gdt)

Updated databases/py-asyncpg, devel/py-cached-property

(adam)

py-cached-property: updated to 1.5.1

1.5.1:
Added formal support for Python 3.7
Removed formal support for Python 3.3

(adam)

py-asyncpg: updated to 0.18.1

asyncpg v0.18.1:
Fix DSN parsing regression

asyncpg v0.18.0:
Improvements
Implement Record.get()
Internal asyncpg errors are now consistently raised as InternalClientError
Allow mappings as composite type input
Add BitString.to_int() and BitString.from_int()
Allow 'sslmode' in DSNs
Add support for specifying multiple host addresses when connecting
Low-level protocol implementation has been tweaked and
optimized for slightly better performance in certain scenarios
Queries with cached statements now generate fewer TCP packets
Allow aliasing builtin types by name in set_builtin_type_codec()
Factor out generic PostgreSQL protocol helpers into a separate package
Fix tests and enable CI for PostgreSQL 11

Bug Fixes
Handle and ignore permission errors when attempting to read .pgpass
Fix decoding of fractional timestamps before Postgres epoch

(adam)

Updated www/py-django2, fonts/py-fonttools

(adam)

py-fonttools: updated to 3.32.0

3.32.0:
- [ufoLib] Make UFOWriter a subclass of UFOReader, and use mixins
  for shared methods
- [featureVars] Fixed normalization error when a condition's minimum/maximum
  attributes are missing in designspace <rule>
- [setup.py] Added [plot] to extras, to optionally install matplotlib,
  needed to use the fonTools.varLib.plot module.
- [varLib] Take total bounding box into account when resolving model.
  If multiple axes have the same range ratio, cut across both.
- [subset] Don't error if STAT has no AxisValue tables.
- [fontBuilder] Added a new submodule which contains a FontBuilder wrapper
  class around TTFont that makes it easier to create a working TTF or OTF
  font from scratch with code. NOTE: the API is still experimental and may
  change in future versions.

3.31.0:
- [ufoLib] Merged the ufoLib <https://github.com/unified-font-objects/ufoLib>__
  master branch into a new fontTools.ufoLib package
  Moved ufoLib.pointPen module to fontTools.pens.pointPen.
  Moved ufoLib.etree module to fontTools.misc.etree.
  Moved ufoLib.plistlib module to fontTools.misc.plistlib.
  To use the new fontTools.ufoLib module you need to install fonttools
  with the [ufo] extra, or you can manually install the required additional
  dependencies (cf. README.rst).
- [morx] Support AAT action type to insert glyphs and clean up compilation
  of AAT action tables.
- [subset] The --no-hinting on a CFF font now also drops the optional
  hinting keys in Private dict: ForceBold, LanguageGroup, and
  ExpansionFactor
- [subset] Include nameIDs referenced by STAT table
- [loggingTools] Added msg=None argument to
  CapturingLogHandler.assertRegex.
- [varLib.mutator] Implemented FeatureVariations instantiation
- [g_l_y_f] Added PointPen support to _TTGlyph objects

(adam)

py-django2: updated to 2.1.3

Django 2.1.3

Bugfixes:
Fixed a regression in Django 2.0 where combining Q objects with __in lookups and lists crashed
Fixed a regression in Django 1.11 where django-admin shell may hang on startup
Fixed a regression in Django 2.0 where test databases aren窶冲 reused with manage.py test --keepdb on MySQL
Fixed a regression where cached foreign keys that use to_field were incorrectly cleared in Model.save()
Fixed a regression in Django 2.0 where FileSystemStorage crashes with FileExistsError if concurrent saves try to create the same directory

(adam)

libetpan: Fix build against newer curl API.

(jperkin)

ticket #5872

(spz)

Pullup ticket #5872 - requested by leot
www/curl: security update

Revisions pulled up:
- www/curl/Makefile                                            1.202
- www/curl/PLIST                                                1.71
- www/curl/distinfo                                            1.147

-------------------------------------------------------------------
  Module Name: pkgsrc
  Committed By: leot
  Date: Wed Oct 31 08:06:24 UTC 2018

  Modified Files:
  pkgsrc/www/curl: Makefile PLIST distinfo

  Log Message:
  curl: Update www/curl to 7.62.0

  Changes:
  7.62.0
  ------
  This release includes the following changes:

    o multiplex: enable by default
    o url: default to CURL_HTTP_VERSION_2TLS if built h2-enabled
    o setopt: add CURLOPT_DOH_URL
    o curl: --doh-url added
    o setopt: add CURLOPT_UPLOAD_BUFFERSIZE: set upload buffer size
    o imap: change from "FETCH" to "UID FETCH"
    o configure: add option to disable automatic OpenSSL config loading
    o upkeep: add a connection upkeep API: curl_easy_upkeep()
    o URL-API: added five new functions
    o vtls: MesaLink is a new TLS backend

  This release includes the following bugfixes:

    o CVE-2018-16839: SASL password overflow via integer overflow
    o CVE-2018-16840: use-after-free in handle close
    o CVE-2018-16842: warning message out-of-buffer read
    o CURLOPT_DNS_USE_GLOBAL_CACHE: deprecated
    o Curl_dedotdotify(): always nul terminate returned string
    o Curl_follow: Always free the passed new URL
    o Curl_http2_done: fix memleak in error path
    o Curl_retry_request: fix memory leak
    o Curl_saferealloc: Fixed typo in docblock
    o FILE: fix CURLOPT_NOBODY and CURLOPT_HEADER output
    o GnutTLS: TLS 1.3 support
    o SECURITY-PROCESS: mention the bountygraph program
    o VS projects: add USE_IPV6:
    o Windows: fixes for MinGW targeting Windows Vista
    o anyauthput: fix compiler warning on 64-bit Windows
    o appveyor: add WinSSL builds
    o appveyor: run test suite (on Windows!)
    o certs: generate tests certs with sha256 digest algorithm
    o checksrc: enable strict mode and warnings
    o checksrc: handle zero scoped ignore commands
    o cmake: Backport to work with CMake 3.0 again
    o cmake: Improve config installation
    o cmake: add support for transitive ZLIB target
    o cmake: disable -Wpedantic-ms-format
    o cmake: don't require OpenSSL if USE_OPENSSL=OFF
    o cmake: fixed path used in generation of docs/tests
    o cmake: remove unused *SOCKLEN_T variables
    o cmake: suppress MSVC warning C4127 for libtest
    o cmake: test and set missed defines during configuration
    o comment: Fix multiple typos in function parameters
    o config: Remove unused SIZEOF_VOIDP
    o config_win32: enable LDAPS
    o configure: force-use -lpthreads on HPUX
    o configure: remove CURL_CONFIGURE_CURL_SOCKLEN_T
    o configure: s/AC_RUN_IFELSE/CURL_RUN_IFELSE
    o cookies: Remove redundant expired check
    o cookies: fix leak when writing cookies to file
    o curl-config.in: remove dependency on bc
    o curl.1: --ipv6 mutexes ipv4 (fixed typo)
    o curl: enabled Windows VT Support and UTF-8 output
    o curl: update the documentation of --tlsv1.0
    o curl_multi_wait: call getsock before figuring out timeout
    o curl_ntlm_wb: check aprintf() return codes
    o curl_threads: fix classic MinGW compile break
    o darwinssl: Fix realloc memleak
    o darwinssl: more specific and unified error codes
    o data-binary.d: clarify default content-type is x-www-form-urlencoded
    o docs/BUG-BOUNTY: explain the bounty program
    o docs/CIPHERS: Mention the options used to set TLS 1.3 ciphers
    o docs/CIPHERS: fix the TLS 1.3 cipher names
    o docs/CIPHERS: mention the colon separation for OpenSSL
    o docs/examples: URL updates
    o docs: add "see also" links for SSL options
    o example/asiohiper: insert warning comment about its status
    o example/htmltidy: fix include paths of tidy libraries
    o examples/Makefile.m32: sync with core
    o examples/http2-pushinmemory: receive HTTP/2 pushed files in memory
    o examples/parseurl.c: show off the URL API
    o examples: Fix memory leaks from realloc errors
    o examples: do not wait when no transfers are running
    o ftp: include command in Curl_ftpsend sendbuffer
    o gskit: make sure to terminate version string
    o gtls: Values stored to but never read
    o hostip: fix check on Curl_shuffle_addr return value
    o http2: fix memory leaks on error-path
    o http: fix memleak in rewind error path
    o krb5: fix memory leak in krb_auth
    o ldap: show precise LDAP call in error message on Windows
    o lib: fix gcc8 warning on Windows
    o memory: add missing curl_printf header
    o memory: ensure to check allocation results
    o multi: Fix error handling in the SENDPROTOCONNECT state
    o multi: fix memory leak in content encoding related error path
    o multi: make the closure handle "inherit" CURLOPT_NOSIGNAL
    o netrc: free temporary strings if memory allocation fails
    o nss: fix nssckbi module loading on Windows
    o nss: try to connect even if libnssckbi.so fails to load
    o ntlm_wb: Fix memory leaks in ntlm_wb_response
    o ntlm_wb: bail out if the response gets overly large
    o openssl: assume engine support in 0.9.8 or later
    o openssl: enable TLS 1.3 post-handshake auth
    o openssl: fix gcc8 warning
    o openssl: load built-in engines too
    o openssl: make 'done' a proper boolean
    o openssl: output the correct cipher list on TLS 1.3 error
    o openssl: return CURLE_PEER_FAILED_VERIFICATION on failure to parse issuer
    o openssl: show "proper" version number for libressl builds
    o pipelining: deprecated
    o rand: add comment to skip a clang-tidy false positive
    o rtmp: fix for compiling with lwIP
    o runtests: ignore disabled even when ranges are given
    o runtests: skip ld_preload tests on macOS
    o runtests: use Windows paths for Windows curl
    o schannel: unified error code handling
    o sendf: Fix whitespace in infof/failf concatenation
    o ssh: free the session on init failures
    o ssl: deprecate CURLE_SSL_CACERT in favour of a unified error code
    o system.h: use proper setting with Sun C++ as well
    o test1299: use single quotes around asterisk
    o test1452: mark as flaky
    o test1651: unit test Curl_extract_certinfo()
    o test320: strip out more HTML when comparing
    o tests/negtelnetserver.py: fix Python2-ism in neg TELNET server
    o tests: add unit tests for url.c
    o timeval: fix use of weak symbol clock_gettime() on Apple platforms
    o tool_cb_hdr: handle failure of rename()
    o travis: add a "make tidy" build that runs clang-tidy
    o travis: add build for "configure --disable-verbose"
    o travis: bump the Secure Transport build to use xcode
    o travis: make distcheck scan for BOM markers
    o unit1300: fix stack-use-after-scope AddressSanitizer warning
    o urldata: Fix "connecting" comment
    o urlglob: improve error message on bad globs
    o vtls: fix ssl version "or later" behavior change for many backends
    o x509asn1: Fix SAN IP address verification
    o x509asn1: always check return code from getASN1Element()
    o x509asn1: return CURLE_PEER_FAILED_VERIFICATION on failure to parse cert
    o x509asn1: suppress left shift on signed value

  To generate a diff of this commit:
  cvs rdiff -u -r1.201 -r1.202 pkgsrc/www/curl/Makefile
  cvs rdiff -u -r1.70 -r1.71 pkgsrc/www/curl/PLIST
  cvs rdiff -u -r1.146 -r1.147 pkgsrc/www/curl/distinfo

(spz)