doc: Updated lang/gnucobol to 3.1.1

(fcambus)

gnucobol: update to 3.1.1.

Pkgsrc changes:

- Follow redirects (open-cobol -> gnucobol) for MASTER_SITES and HOMEPAGE
- Add a test target

ChangeLog:

GnuCOBOL 3.1.1 released (20201208)
GnuCOBOL 3.1 released (20201111) had issues that were fixed

* New GnuCOBOL features

** XML GENERATE statement
  (note: runtime support needs additional library libxml2)

** JSON GENERATE statement
  (note: runtime support needs additional library cJSON or JSON-C)

** CONTINUE AFTER statement (COBOL 202x) implemented, also handle fractions
  of seconds in C$SLEEP now

** TYPEDEF and SAME AS (COBOL 2002) implemented, including the MicroFocus
  and RM/COBOL variants

** >>TURN (COBOL 2002) directive implemented, allowing some exception checks
  to be turned on/off per source as desired

** Improved support for different compiler extensions (ACUCOBOL, IBM,
  Fujitsu, MicroFocus COBOL, Microsoft COBOL, RM/COBOL, CA Realia and more)

** file handling: include support for a callable EXTFH interface also provided
  by several compilers including Micro Focus
  This allows users to insert an external file handler while retaining
  all of the normal COBOL I/O functions with a possible callback to libcob.
  To have the compiled program call `yourfh()` for file I/O use:
  `cobc -fcallfh=yourfh`
  In turn `yourfh()` may call `EXTFH()` to use I/O functions from GnuCOBOL.
  The external file handler can also be directly invoked from COBOL, too,
  using `CALL "EXTFH"`.
  ** Note: Not each flag contained in the FCD3 is handled already **

** file handling: added support for [RE]WRITE FILE file FROM source

** file handling: name mapping adjusted (improved MF and ACU-compatibility):
  entries starting with a period or number are not resolved any more,
  periods in the external identifier are always replaced by underscore
    -> MY.FILE is resolved by DD_MY_FILE, dd_MY_FILE, MIFILE now;
  prefixes "-F " and "-D " are removed from external names;
  if filename is not absolute after translation, COB_FILE_PATH is now
  still applied;
  File name mapping now applies both to COBOL statements and CALLable
  CBL_ and C$ file routines.

** Screen I/O: initial mouse support (for details see runtime.cfg),
  use of CURSOR clause in SPECIAL-NAMES for positioning on ACCEPT

** on abort a stack trace will be genereated, this can be suppressed by
  runtime configuration option COB_STRACK_TRACE

** the dump that is generated on abort (depending on -fdump at compile-time)
  was heavily improved and combines consecutive identical OCCURS items,
  leading to smaller dump files

** changes in handling COPY statement:
  * copybook names that contain an extension aren't searched with additional
    extensions [as post-rc1-change this may be set to old behaviour by
    defining COB_MULTI_EXTENSION when building GnuCOBOL/cobc]
  * library names are now tested for environment "COB_COPY_LIB_libname",
    allowing the directory to specified externally (also as no-directory
    by exporting with empty value) and has a fallback (with a warning) to
    be effectively ignored (as previous versions did this)

* Removed functions

** SCREEN SECTION, REPORT-WRITER module: removed non-standard extension
  "LINE / COL signed-integer" (inadvertently available since 2.2/3.0rc1);
  which will now raise an error "unsigned integer expected";
  if used replace by standard "LINE / COL +/- integer"

* Obsolete features (will be removed in the next version if no explicit user
  requests are raised)

** support for Borland C compiler and linker
** -fif-cutoff flag for cobc (currently disabled, see entry below in 3.0rc1)
** old OpenCOBOL-only-EXTFH

* Changes to the COBOL compiler (cobc) options:

** new options:
  -f[no]-ec=exception-name to tune the exception checks similar to the >>TURN
      directive, you may also leave out the "EC-" prefix here, example to
      enable all checks but disable all bound checks but OCCURS DEPENDING ON:
      cobc -debug -fno-ec=bound -fec=bound-odo

** adjustments to warning options:
  -Wextra "new" option to enable every possible warning that is not dialect
      specific (this option used to be called -W)
  -Wadditional  new warning group for all warnings that don't have a group
      on their own
  -Wno-error and -Wno-error=<warning> to treat (specific <warning>s) not as error
  -Wdangling-text for raising the warning "source text after program area",
      not included in -Wall any more
  -Wno-ignored-error allows to suppress messages that normally would be an
      error and are only allowed because they are never executed
  -Wimplicit-define and -Wcorresponding are now enabled by default

  -f[no]-diagnostics-show-option, enabled by default, shows the
    command line option responsible for the diagnostic message

  extra information to a warning (or error) is now marked as "note:"

** the interal Xref got a huge speedup, has all references in ascending order
  now and includes the total amount of direct references

** the interal listing got a speedup and has all error references in
  ascending order now

** cobc -g (and configure --enable-debug) use the most expressive
  debugging options available on the system

** cobc -g now auto-includes references to the COBOL source file and to
  all ENTRY and SECTION elements to ease source level debugging

* Changes in the COBOL runtime (libcob)

** Messages from the COBOL runtime are also translated now (if installed).
  To prevent this disable translations in general with using the configure
  option --disable-nls (or by deactivating ENABLE_NLS in config.h).

** libcob.h does no longer auto-include gmp.h (behavior since 2.x), if you link
  against libcob and need cob_decimal include gmp.h/mpir.h yourself before;
  otherwise you do not need it in your include path any more

** execution times of INSPECT and INITIALIZE with OCCURS were heavily cut down

** convenience functions for direct C access to COBOL fields and for debugging
  were added, see new C-API documentation

** first-time file-locking under Win32

** Breaking change: previously the return-code of registered error handlers
  (by CBL_ERROR_PROC) were ignored. This was changed according to the
  documentation for CBL_ERROR_PROC -> a RETURN-VALUE of ZERO skips further
  error handlers to be called, including the internal one.

* New build features

** Running the internal tests by make check now fails if the testsuite has any
  unexpected result.

** The modules and test programs in the NIST COBOL-85 test suite (tests/cobol85)
  may now be build and/or tested and/or the test results checked separately.
  You now may also run the tests with a previous installed version of GnuCOBOL
  (or a version specified by a manual temporary setup).
  For details see tests/cobol85/README.

** new configure option --with-math=ARG to specify which math multiple precision
  library is to be used, where ARG may be: check (default), gmp, mpir

** new configure options --with-xml2 / -without-xml2 to explicit force/disable
  XML runtime support, otherwise it will be included if found as working

** new configure option --with-json / -without-json to explicit force/disable
  JSON runtime support, otherwise it will be included if found as working
  Note: As a special case you may built-in cJSON by placing its source in
  the folder "libcob". If it is included there, this version will be compiled
  into libcob. It may be enforced with --with-json=local,
  like --with-json=cjson and --with-json=json-c enforce the given library.

** To adjust the build system for GMP/MPIR you may use the new variables
  GMP_CFLAGS / MPIR_CFLAGS and GMP_LIBS / MPIR_LIBS.
  If unset configure will try pkg-config.

** To adjust configure to use libxml2 you may use the new variables XML2_CFLAGS
  and XML2_LIBS. If unset configure will use pkg-config / xml2-config.

** To adjust configure to use libcjson you may use the new variables CJSON_CFLAGS
  and CJSON_LIBS, similar JSON_C_CFLAGS and JSON_C_LIBS for libjson-c.
  If unset configure will use pkg-config.

** new configure option --enable-hardening to either enable GNU C's
  hardening options or leave as-is, or disable (which previous versions
  effectively did)

** build system: defaults.h is not created or included any more, all configure
  provided defines are now found in the single header config.h

** Any time after `make` you can call `pre-inst-env` script to use the still-
  uninstalled binaries. Samples:
  pre-inst-env cobc -xj prog.cob
  pre-inst-env cobcrun -M prog start
  pre-inst-env may also be called without parameters to start a new shell
  session with the environment adjusted to use the uninstalled version.

* Too much bug fixes to list here (please check ChangeLogs for full details),
  includes the following CVEs:

** compiler (may be triggered with special crafted source files)
  CVE-2019-14468, CVE-2019-14486, CVE-2019-14528, CVE-2019-14541,
  CVE-2019-16396, CVE-2019-16395

* GnuCOBOL's getopt implementation honors POSIXLY_CORRECT now:
  if set to any value the option parsing in cobc, cobcrun and CBL_GC_GETOPT
  stops at the first nonoption, otherwise it stays with the old behaviour and
  re-orders nonoptions to the end)

* Known issues in 3.1

** testsuite:
  * if built with vbisam, cisam or disam, depending on the version used, some
    tests will lead to UNEXPECTED PASS, while others may fail
  * possibly failing tests (false positives):
    * temporary path invalid
    * compiler outputs (assembler)
    * compile from stdin
  * NIST: OBNC1M.CBL false positive (the test runner uses a nonportable way of
    emulating a program kill)

** the recent additions of ">> TURN" and "variable LIKE variable" may not work
  as expected in all cases

** features that are known to not be portable to every environment yet
  (especially when using a different compiler than GCC)
    * function with variable-length RETURNING item
    * USAGE POINTER, which may need to be manually aligned

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

GnuCOBOL 3.0-rc1 released (20180422)

* New GnuCOBOL features

** REPORTWRITER module added

** INDEXED file handling: added support for sparse and split keys

** file handling: added support for [RE]WRITE FILE file FROM source

** DISPLAY ... UPON PRINTER may be redirected to an external command
  (new runtime configuration COB_DISPLAY_PRINT_PIPE) or appended to a file
  (new runtime configuration COB_DISPLAY_PRINT_FILE, which takes precedence)

** XML GENERATE statement
  (note: runtime support needs additional library libxml2)

** JSON GENERATE statement
  (note: runtime support needs additional library cJSON)

** Improved support for different compiler extensions (ACUCOBOL, IBM,
  Fujitsu, MicroFocus COBOL, Microsoft COBOL, RM/COBOL and more)

** Parser support for many features of different compilers, for example
  PIC 1 / USAGE BIT, ACUCOBOL extensions for graphical controls
  VALIDATE statement and much more.
  Most of them will be fully implemented in a later version...

** Option to dump (partial) data of modules on abort.
  Use new cobc option -fdump=<scope> to prepare the module and optional
  use new runtime configuration options COB_DUMP_FILE and COB_DUMP_WIDTH
  to adjust the dump.

** C interface: new functions cob_set_runtime_option / cob_get_runtime_option
  to set/get special runtime options (currently FILE * for trace and printer
  output) or to reload the runtime configuration after changing environment

** file handling: include support for a callable EXTFH interface also provided
  by several compilers including Micro Focus
  This allows users to insert an external file handler while retaining
  all of the normal COBOL I/O functions with a possible callback to libcob.
  To have the compiled program call `yourfh()` for file I/O use:
  `cobc -fcallfh=yourfh`
  In turn `yourfh()` may call `EXTFH()` to use I/O functions from GnuCOBOL.
  The external file handler can also be directly invoked from COBOL, too,
  using `CALL "EXTFH"`.
  ** Note: Not all flags contained in the FCD3 are handled already **

* Changed cobc options:

** The option -debug (runtime checks) no longer implies -ftrace (option to
  trace program flow of the generated module with COB_SET_TRACE).
  You may specify -ftrace[all] along -debug if you want to use this feature.

** The option -E (preprocess file) does not imply an output file any more.
  If no output file is explicit specified with -o filename.i the output will
  be written to stdout (behavior of versions 1.1 is restored).
  Requesting output to stdout explicit by using a dash as output name is
  also possible.

** Changed options for listing:
  The option -tsymbols was replaced by -ftsymbols and therefore can now also
  be explicit deactivated by specifying -fno-tsymbols.
  New options for suppressing (or explicit requesting) parts of the listing:
  -fno-theader    suppress all headers from listing while keeping page breaks
  -fno-tmessages  suppress warning and error summary from listing
  -fno-tsource    suppress actual source from listing (for example to only
                  produce the cross-reference)

** The option -fif-cutoff (option to change generated C sources to use
  a label + goto for nested if/else) was deactivated to allow the C compiler
  to fully control the program flow.
  ** Please report if you have a need for this option as it will be **
  ** removed permanently in the next release of GnuCOBOL otherwise. **

* Changes in the COBOL runtime (libcob)

** updated exception handling, GnuCOBOL now only cleans raised exceptions when
  requested by SET LAST EXCEPTION TO OFF

** The standard-format for program tracing was changed and is now adjustable
  by the runtime configuration option COB_TRACE_FORMAT.

* New build features

** New test suite for manual tests (especially SCREEN I/O),
  run with `make checkmanual`.
  Note: You may want to adjust the test runner tests/run_prog_manual.sh which
  defaults to xterm in GUI environments and screen in terminal environments.

** new configure option --enable-debug-log to allow *internal* tracing
  of GnuCOBOL (intended for developers of GnuCOBOL only)

* Too much bug fixes to list here (please check ChangeLogs for full details).

(fcambus)

doc: Updated emulators/hatari to 2.3.0

(fcambus)

hatari: update to 2.3.0.

Version 2.3.0 (2020-11-28)
--------------------------

Following features are deprecated and will be removed in a future release:
- Support for the SDL 1.2 library (i.e. SDL 2.x should be used instead)
- SDL 2.x "bUseSdlRenderer" config and "GPU scaling" GUI options
  (after HW support for SDL2 is available widely enough)
- The old UAE CPU core (i.e. the new WinUAE CPU core should be used instead)
- Python v2 support in Python scripts (Python 2 was end of life in 2020)
- The "external" disassembler (i.e. use "--disasm uae" instead)
- Hatari XBios(255) API enabled with the "--bios-intercept" option
  (i.e. use "--natfeats" & "--cmd-fifo" options and "hconsole" instead)
- The old ~/.hatari configuration file location (use ~/.config/hatari instead)

Emulation:
- FDC / Disk :
  - Support for MegaSTE DIP switch register $FF9200
    (set floppy drive to HD by default on MegaSTE/TT/Falcon)
  - support for DD/HD mode on MegaSTE at $FF860E
    (when FDC is set to HD mode, reading DD floppies will fail)
  - Support for the 'Disk Change' (DC) signal on TT machines on TT's MFP GPIP4
  - Fix: IDE disks with sector size > 512 bytes
  - Fix: IDE controller is now always available in Falcon mode, even if
    no hard disks have been configured.
- CPU:
  - Update CPU core to latest WinUAE 4.4.0 beta : full support for undocument
    fields in 68000 bus/address error stack frames, as well as CCR flags for
    most of the 680x0 instructions (using a cpu tester program on the real
    hardware that checks all possible opcodes' combinations)
  - 68030 MMU hardware bus error support + various fixes
  - FPU fixes
- Video:
  - Improved timing when setting Vsync signal
    (same place where video counter is reloaded)
  - Handle screen where vertical DE signal is completely disabled
  - Better start/end position for the VBlank signal at 50Hz and 60Hz
- Sound:
  - Add a better filter for downsampling the internal 250 kHz signal, should
    give better results when the YM2149 outputs high frequency sounds
  - Fix microwire mask shifting when CPU runs > 8 MHz
- MFP :
  - Rewrite MFP code to handle several MFP objects and add support
    for the TT's 2nd MFP (not all TT's MFP signals are emulated yet)
  - Improved Falcon's DMA sound interrupt on GPIP7 and AER
- Blitter:
  - Large rewrite of the blitter's core, improving cycle accuracy and
    handling the complex cases where xcount=1 and nfsr=1. Code is slighlty
    smaller and closer to the logic of the real hardware
  - Handle restart in non HOG mode when the CPU uses a RMW instruction
    (eg TAS)
  - Improve access to memory regions that would generate a bus error
    for the CPU
- Emulate additional RTC/NVRAM registers
- megaSTE should start at 8 MHz, not 16 MHz

Emulator:
- Miscellaneous:
  - Fix: freeze at Hatari exit and RS-232 device file changes,
    when device file(s) are FIFO(s)
  - Fix: when autostarting programs without pre-existing INF file,
    enable blitter also with EmuTOS
  - Use floppy track's size in bytes to detect DD/HD/ED
    (instead of counting sectors)
  - Add --lilo debug option for more convenient m68k Linux loading
- Config file handling:
  - Support config file values with '=' in them
  - Skip reading global config file if HATARI_TEST environment
    variable is set
- Memory handling:
  - Memory snapshot version increase due to FDC changes
    (i.e. old snapshots won't work with new version)
  - Accept 10MB as valid ST-RAM amount (max on real MegaSTE/TT machines)
    and correct invalid Falcon ST-RAM amounts
  - Fix: 24-bit address mode change while emulation is running
    (triggered e.g. when TT-RAM is enabled for TT)
- HD images:
  - Fix: run-time IDE byte swap change requires IDE re-init
  - Fix: TOS booting from A: although SCSI drive was enabled
  - Support read-only HD image files, and show error dialogs
    for image file open/lock issues
- GEMDOS HD emulation:
  - Support FASTLOAD program flag with GEMDOS HD
  - GEMDOS HD emulation cartridge assembly functionality is moved almost
    completely to emulator side. Fixes Atari side error handling when program
    file is not readable, and TOS stack overflows in some rare cases
  - Detect DTA re-use to reduce DTA cache usage, grow cache on
    demand and give warning if its entries need to be re-cycled
    (= cache max size is reached)
  - Invalid DTA in Fsnext() return -ENMFIL, like TOS does
  - Fix: skip non-existing host files on FSnext() instead
    of returning an error (latter broke directory listings)
  - Fix: Dsetpath/Dgetpath empty path handling
- Hatari graphics support:
  - Low/med-rez line doubling uses less CPU and doubled lines in
    "TV" display mode are now drawn at half intensity, not as black
    (fixes TV mode being too dark)
  - SDL2: "--zoom" option accepts any values between 1.0 - 8.0
  - SDL2: "--zoom" option is changed to always enable low resolution
    doubling before SDL framebuffer is scaled up (or down) by the zoom
    factor. This way Hatari output window is approximately same sized
    regardless of emulated Atari resolution, like on a real CRT monitor
  - SDL2: scale quality is selected automatically; nearest pixel for sharp
    output with integer scaling factors, and linear scaling to smooth out
    issues with non-integer scaling and window resizes
  - SDL2: Now redundant "nRenderScaleQuality" config option is
    removed and "Linear scaling" option in GUI is replaced with
    the "GPU scaling" option (=bUseSdlRenderer config option)
  - Added new "--screenshot-dir" option to select the folder for screenshots
  - Fix: [ffmpeg/video] Invalid PNG signature 0x89504E470D0A1A
  - Fix: garbage graphics (by clearing the whole render area)
  - Fix: Spec512_StoreCyclePalette when using 16 or 32 MHz
- Input handling:
  - Support SDL "Hat" events in addition to "Axes" events
    (= support 80's game controllers, also in SDL GUI)
  - Map a turbofire button independent of the fire button if the game
    controller is capable
  - Show mouse grab toggle shortcut key in startup statusbar message
  - Center host mouse to Hatari window on Atari resets and resolution
    changes only when window is focused and mouse pointer is within it
  - Fix: keypad emulation with SDL2
  - Fix: simulated (socket API) key input with SDL2
- Profiler:
  - Profiler backtrace shows now real caller addresses
    and their offsets from the function entry points
    (slows profiling of addresses with symbols)
  - All profiler outputs have now reasonable limits
    (so that they don't flood console)
  - Fix: exception in profile post-processor script
    (with symbol address aliases)
- Tracing:
  - Fix: CPU disassembly trace output doesn't go to specified trace file
  - Trace flags can be added and removed instead of needing to
    always specify all the relevant ones, both with "--trace"
    command line option and debugger "trace" command:
    --trace os_base,aes, trace +xbios,bios, trace -bios,-aes
  - VDI trace shows names also for NVDI/Speedo/GDOS functions
  - VDI & AES trace function numbers are shown in hexadecimals
    with 0x prefix like rest of the OS calls
- Debugger:
  - New "screenshot" command for saving screen dump to a PNG/BMP file
  - "symbols resident" option replaced with "symbols autoload"
    option which can be used to completely disable automatic symbol
    loading and unloading for programs run through the GEMDOS HD
    (helps debugging resident programs started from GEMDOS HD)
  - Improvements to UAE and external disassembler disassembly
  - UAE disassembler is now default instead of external one
    (latter doesn't decode all instructions correctly)
  - New "info" subcommands:
    "acia", "dmasnd", "ikbd", "mfp", "nvram", "rtc" and "scc"
  - Also UAE disassembler can now show the profile info
  - "info" command can show AES & VDI information on on their
    respective traps without VDI mode/tracing being enabled
  - Breakpoint ":info" option to call specified info function
    on tracing breakpoint hits (one can now use e.g. ":info vdi"
    on VdiOpcode breakpoints)
  - Improved symbols info output
- Native features:
  - Support for missing NF_SHUTDOWN (reset) sub commands
  - Test code for rest of features (except for NF_SCSIDRV)
  - When Hatari resets or exits due to emulated program
    NF_SHUTDOWN / NF_EXIT call, output user a note about that

Tools and Hatari Python/Gtk UI:
- Python scripts use now "python3" because most current distros don't
  anymore install Python v2 by default.  To use a script with v2,
  change "python3" in its first line to "python2"

Building and unit tests:
- Source repository moved from Mercurial to Git
- Fix: issue with multilib capable cross-compilers
- Only Caps library v5.1 is supported (support for old v4.2 is dropped)
- Obsolete Mudflap option replaced with AddressSanitizer support
- Add tests for GEMDOS HD, fullscreen/overscan display, blitter and Hatari
  command FIFO + improve CPU/MMU variant coverage in earlier tests

Documentation:
- Up to date documentation provided at: https://hatari.tuxfamily.org/doc/
- New m68k-linux.txt and m68k-netbsd.txt documents on how to
  test m68k Linux and NetBSD under Hatari
- Debugging and profiling information is split from manual.html to
  a separate debugger.html file
- Minor improvements

Fixed demos:
- Pacemaker STE demo (end part), when it's run from GEMDOS HD
- Multi scrolls part in Closure by Sync
  (regression since Hatari 2.2, vsync in bottom border)
- Fullscreen part in Hard As Ice STE demo by I.C.E.
  (screen with no vertical DE signal)
- Fullast Vinner by Troed/Sync
  (improved vblank position, partial fix for now)
- Electric Night Falcon demo by Dune
  (MFP DMA sound interrupt on timer A using AER)
- Oompa by No Extra (after greetings part)
  (blitter access to bus error regions)
- E.K.O System (music should now play in the racing scene)

Fixed programs:
- MS Write (crash), when it's run from GEMDOS HD
- Akaisex program reading AKAI S1000 HD floppies converted to STX
- EmuTos drawing vertical lines with blitter and leaving some trails
  (blitter in non HOG mode using TAS intruction to restart)
- Cecile v2.22, now also works if no IDE drive has been configured
- Trans D-Bug Express by PHF (lock when running in megaSTE mode at 16 MHz)

(fcambus)

net/quagga: document confilct with frr package

(kardel)

net/quagga: comment patches, use preferred link status interface on NetBSD

(kardel)

binutils: add a test target.

(fcambus)

net/frr: add frr

(kardel)

fix merge botch

(kardel)

doc: Added net/frr version 7.5

(kardel)

net/frr: import frr-7.5

FRRouting
=========

FRR is free software that implements and manages various IPv4 and IPv6 routing
protocols. It runs on nearly all distributions of Linux and BSD as well as
Solaris and supports all modern CPU architectures.

FRR currently supports the following protocols:

* BGP
* OSPFv2
* OSPFv3
* RIPv1
* RIPv2
* RIPng
* IS-IS
...

(kardel)

Updated games/rocksndiamonds, databases/prometheus

(adam)

prometheus: updated to 2.23.0

2.23.0:
[CHANGE] UI: Make the React UI default.
[CHANGE] Remote write: The following metrics were removed/renamed in remote write.
prometheus_remote_storage_succeeded_samples_total was removed and prometheus_remote_storage_samples_total was introduced for all the samples attempted to send.
prometheus_remote_storage_sent_bytes_total was removed and replaced with prometheus_remote_storage_samples_bytes_total and prometheus_remote_storage_metadata_bytes_total.
prometheus_remote_storage_failed_samples_total -> prometheus_remote_storage_samples_failed_total .
prometheus_remote_storage_retried_samples_total -> prometheus_remote_storage_samples_retried_total.
prometheus_remote_storage_dropped_samples_total -> prometheus_remote_storage_samples_dropped_total.
prometheus_remote_storage_pending_samples -> prometheus_remote_storage_samples_pending.
[CHANGE] Remote: Do not collect non-initialized timestamp metrics.
[FEATURE] [EXPERIMENTAL] Remote write: Allow metric metadata to be propagated via remote write. The following new metrics were introduced: prometheus_remote_storage_metadata_total, prometheus_remote_storage_metadata_failed_total, prometheus_remote_storage_metadata_retried_total, prometheus_remote_storage_metadata_bytes_total.
[ENHANCEMENT] Remote write: Added a metric prometheus_remote_storage_max_samples_per_send for remote write.
[ENHANCEMENT] TSDB: Make the snapshot directory name always the same length.
[ENHANCEMENT] TSDB: Create a checkpoint only once at the end of all head compactions.
[ENHANCEMENT] TSDB: Avoid Series API from hitting the chunks.
[ENHANCEMENT] TSDB: Cache label name and last value when adding series during compactions making compactions faster.
[ENHANCEMENT] PromQL: Improved performance of Hash method making queries a bit faster.
[ENHANCEMENT] promtool: tsdb list now prints block sizes.
[ENHANCEMENT] promtool: Calculate mint and maxt per test avoiding unnecessary calculations.
[ENHANCEMENT] SD: Add filtering of services to Docker Swarm SD.
[BUGFIX] React UI: Fix button display when there are no panels.
[BUGFIX] PromQL: Fix timestamp() method for vector selector inside parenthesis.
[BUGFIX] PromQL: Don't include rendered expression on PromQL parse errors.
[BUGFIX] web: Fix panic with double close() of channel on calling /-/quit/.
[BUGFIX] TSDB: Fixed WAL corruption on partial writes within a page causing invalid checksum error on WAL replay.
[BUGFIX] Update config metrics prometheus_config_last_reload_successful and prometheus_config_last_reload_success_timestamp_seconds right after initial validation before starting TSDB.
[BUGFIX] promtool: Correctly detect duplicate label names in exposition.

(adam)

devel/libyang: add Makefile and license entry

(kardel)

rocksndiamonds: updated to 4.2.0.5

Rocks'n'Diamonds 4.2.0.5:

Here窶冱 another bugfix release that fixes and adds the following:

fixed handling of player at fake acid for EM engine
fixed wrap-around with entering EM style doors for EM engine
fixed activating robot wheel at wrap-around position for EM engine
fixed some elements and properties when reading native DC2 levels
added Emscripten support for running R窶冢窶僖 in a web browser
fixed compiling on OS/2 (ArcaOS, in fact)
fixed some compiler warnings for newer versions of GCC

Rocks'n'Diamonds 4.2.0.4:

This is yet another bugfix release that fixes and adds the following:

re-added accidentally removed program icon
fixed bug with text input / text area gadgets when pressing 窶廢scape窶� key
fixed bug with clicked text area gadgets marking level as changed
improved inserting level sketch from clipboard to level editor
fixed some game elements when inserting level sketch from clipboard
added setting game engine when inserting level sketch from clipboard
fixed workaround for color key bug in SDL 2.0.12 that breaks transparency
improved handling 窶廚ONF窶� and 窶弃ROPERTIES窶� buttons in level editor
fixed bug with virtual buttons that may be broken after rotating device
increased maximum tape length for playing extreme levels like 窶彁elda II窶�
fixed graphical bugs if digging or collecting causes player relocation

Rocks'n'Diamonds 4.2.0.3:

This is another bugfix release which fixes and adds the following:

fixed some problems with wrap-around levels in Emerald Mine engine
added full compatibility for wrap-around levels in Emerald Mine engine
fixed single-step mode for wrap-around levels in Emerald Mine engine
fixed playing tapes recorded with old Emerald Mine game engine
added command 窶彗utofix窶� to fix tapes recorded with old EM game engine
fixed key shortcut to start/end game (which was broken since 4.2.0.0)
fixed some other key shortcuts that require entering upper case letters
added menu command 窶�:undo-tape窶� to undo/restore last recorded tape
fixed potential crash bug that may occur when loading custom artwork
fixed single-step mode when using custom elements with mouse click events
added creating undo/redo snapshots when using mouse click events
fixed problems with virtual buttons and showing envelopes on Android
improved startup speed by optimizing parsing of parameter values
improved handling output of warnings, errors and debug messages
fixed showing source date on version page of info screen menu
added showing commit hash on version page of info screen menu

Rocks'n'Diamonds 4.2.0.2:

This is mainly a bugfix release which fixes and adds the following:

fixed broken tapes (for various reasons) recorded with old EM engine
fixed support for initially moving spring in EM game engine
added support for initially moving spring to R窶冢窶僖 game engine
fixed potential crash bug when reading from artwork info cache
fixed wrong eater content when loading native EM levels
added support for variable number of eater arrays for EM engine
fixed vsync mode when not using OpenGL renderer (like 窶廴etal窶� on Mac)
added option for setting hint for render driver to setup config file
added displaying render driver on info screen page

Rocks'n'Diamonds 4.2.0.1:

This is a bugfix release which fixes the following bugs:

fixed loading dynamic libraries shipped with the Linux package
fixed level editor key shortcuts (broken by regression)
fixed support for wrap-around levels in EM engine for old tapes

Rocks'n'Diamonds 4.2.0.0:

The most important change is the long-awaited update of the Emerald Mine game engine, which was based on an old version of David Tritscher窶冱 窶廢merald Mine for X11窶� from 2000/2001. The new game engine uses a more recent code base from 2009, which contains new features and bug fixes and improves the compatibility of the game engine with many levels from the Emerald Mine Club level collection (while preserving compatibility of already recorded tapes).

The most important Emerald Mine game engine related changes are:

support for wrap-around levels (like level 80 from level set 窶彝uppelmine 2窶�)
improved handling of chain-explosions of the 窶彙ug窶� game element
improved handling of the 窶彷ake acid窶� game element
improved handling of various other game elements (like burning dynamite)
As another important improvement, the whole build system was updated for all platforms to support today窶冱 development tools and to support the most recent versions of the SDL libraries, which removes several problems when building the game on current systems. This also includes native 64-bit support for the Windows version.

Here窶冱 an overview of the most important build system changes:

added support for cross-compiling to Windows 64-bit platform
added CPU architecture (32/64 bit) to version info screen
added build support for older versions of Mac OS X
changed build system for Android from Ant to Gradle
updated SDL libraries to the latest versions for all platforms

The following features and bug fixes were added to custom elements:

added being able to use CE condition 窶廚E value/score gets 0窶�
added mouse click events to CE change events (experimental)
added new change action 窶徇ove player new窶� to CE change actions
added support for tapes with both keyboard/joystick and mouse actions
fixed bug with reanimating killed player by CE condition

The following additions and fixes are related to global animations:

added option to generally set global animations to block clicks
added missing handling of animation mode 窶徨andom窶� for global animations
fixed drawing global animations when switching screens without fading

Additionally, there are the following new features and bug fixes:

added workaround for a bug in SDL 2.0.12 which prevents transparency
fixed potential crash bug if personal user level set cannot be found
changed move speed for some elements for older game engine versions
fixed element property that caused levels/tapes to be unsolvable
moved game engine settings to separate setup menu screen
fixed bug with scrollbar still active on virtual buttons config screen
replaced ILBM graphics source files in repository with converted PNG files
fixed text event handling for newer SDL versions on Android
fixed screen rotation for newer SDL versions on Android
fixed screen size for newer SDL versions on Android
updated custom game controller mappings for newer SDL versions on Android
added disabling overlay touch buttons when using joystick

(adam)

doc: Added devel/libyang version 1.0.184

(kardel)

devel/libyang: import libyang-1.0.184

libyang is a YANG data modelling language parser and toolkit written (and
providing API) in C. The library is used e.g. in

* Parsing (and validating) schemas in YANG format.
* Parsing (and validating) schemas in YIN format.
* Parsing, validating and printing instance data in XML format.
* Parsing, validating and printing instance data in JSON format

(kardel)

ocaml: remove references to non-existent files

(wiz)

doc: Updated comms/asterisk16 to 16.15.0

(gdt)

asterisk16: Update to 16.15.0

Upstream changes:

  bugfixes
  minor improvements
  STIR/SHAKEN support

(gdt)

doc: Updated audio/milkytracker to 1.03.00

(nia)

milkytracker: Update to 1.03.00

12/12/2020 (v1.03):

  What���s new:

    * Improved FT2 accuracy
    * Alt-Backspace alternative for insert keybindings
    * Improved mousewheel / touchpad scrolling for Windows/OSX/SDL2
    * Option to invert mousewheel for pattern editor
    * New flanger effect
    * Allow quarter periods in sample generator
    * Click and drag to move selection in pattern editor
    * More intuitive cutting/pasting of partial FX commands
    * Allow selections by clicking outside the pattern bounds
    * Easier and more intuitive sample selection resizing

  Bugs fixed:

    * Various compatibility fixes
    * Jam channels stop working after applying settings
    * Improper WAV chunk parsing for odd sizes
    * Multiple heap & buffer overflow vulnerabilities
    * MacOS compatibility
    * Inverted samoples during signed to unsigned conversion
    * ���and more, see git commit history for details

(nia)

Updated net/wireshark, devel/py-faker, devel/py-factory_boy, devel/py-distorm3

(adam)

py-distorm3: updated to 3.5.1

3.5.1:
Bug fixes

(adam)

py-factory_boy: updated to 3.1.0

3.1.0 (2020-10-02)
------------------

*New:*

    - Allow all types of declarations in :class:`factory.Faker` calls - enables references to other faker-defined attributes.

3.0.1 (2020-08-13)
------------------

*Bugfix:*

    - :issue:`769`: Fix ``import factory; factory.django.DjangoModelFactory`` and similar calls.

3.0.0 (2020-08-12)
------------------

Breaking changes
""""""""""""""""

The following aliases were removed:

+------------------------------------------------+---------------------------------------------------+
| Broken alias                                  | New import                                        |
+================================================+===================================================+
| ``from factory import DjangoModelFactory``    | ``from factory.django import DjangoModelFactory`` |
+------------------------------------------------+---------------------------------------------------+
| ``from factory import MogoFactory``            | ``from factory.mogo import MogoFactory``          |
+------------------------------------------------+---------------------------------------------------+
| ``from factory.fuzzy import get_random_state`` | ``from factory.random import get_random_state``  |
+------------------------------------------------+---------------------------------------------------+
| ``from factory.fuzzy import set_random_state`` | ``from factory.random import set_random_state``  |
+------------------------------------------------+---------------------------------------------------+
| ``from factory.fuzzy import reseed_random``    | ``from factory.random import reseed_random``      |
+------------------------------------------------+---------------------------------------------------+

*Removed:*

    - Drop support for Python 2 and 3.4. These versions `are not maintained anymore <https://devguide.python.org/devcycle/#end-of-life-branches>`__.
    - Drop support for Django 2.0 and 2.1. These versions `are not maintained anymore <https://www.djangoproject.com/download/#supported-versions>`__.
    - Remove deprecated ``force_flush`` from ``SQLAlchemyModelFactory`` options. Use
      ``sqlalchemy_session_persistence = "flush"`` instead.
    - Drop deprecated ``attributes()`` from :class:`~factory.Factory` subclasses; use
      ``factory.make_factory(dict, FactoryClass._meta.pre_declarations)`` instead.
    - Drop deprecated ``declarations()`` from :class:`~factory.Factory` subclasses; use ``FactoryClass._meta.pre_declarations`` instead.
    - Drop ``factory.compat`` module.

*New:*

    - Add support for Python 3.8
    - Add support for Django 2.2 and 3.0
    - Report misconfiguration when a :py:class:`~factory.Factory` is used as the :py:attr:`~factory.Factory.model` for another :py:class:`~factory.Factory`.
    - Allow configuring the color palette of :py:class:`~factory.django.ImageField`.
    - :py:meth:`get_random_state()` now represents the state of Faker and ``factory_boy`` fuzzy attributes.
    - Add SQLAlchemy ``get_or_create`` support

*Improvements:*

    - :issue:`561`: Display a developer-friendly error message when providing a model instead of a factory in a :class:`~factory.declarations.SubFactory` class.

*Bugfix:*

    - Fix issue with SubFactory not preserving signal muting behaviour of the used factory, thanks `Patrick Stein <https://github.com/PFStein>`_.
    - Fix issue with overriding params in a Trait, thanks `Gr辿goire Rocher <https://github.com/cecedille1>`_.
    - :issue:`598`: Limit ``get_or_create`` behavior to fields specified in ``django_get_or_create``.
    - :issue:`606`: Re-raise :class:`~django.db.IntegrityError` when ``django_get_or_create`` with multiple fields fails to lookup model using user provided keyword arguments.
    - :issue:`630`: TypeError masked by __repr__ AttributeError when initializing ``Maybe`` with inconsistent phases.

(adam)

py-faker: updated to 5.0.1

5.0.1
* ``th_TH`` ``strftime``: normalize output for unsupported directive on ``musl``-based Linux.

5.0.0
* Drop support for Python 3.5.
* Add support fro Python 3.9.

4.18.0
* Add ``date_time`` and ``bank`` providers for ``th_TH``.

4.17.1
* Correct spelling errors in city names for ``de_DE``.

4.17.0
* Add name pairs to get matched representation in ``ja_JP`` person provider.

4.16.0
* Add SSN, company name, address, and license plate providers for ``th_TH``.

4.15.0
* Add postcode format, country names, person prefix weights, and update phone number format for ``th_TH``.

4.14.2
* Fix generation of names ending with spaces.

4.14.1
* Add relative frequencies for japanese last names.

4.14.0
* Add Swiss bank provider locales.

4.13.0
* Split first names into male and female on ``pt_PT`` provider.

4.12.0
* Geo provider added for ``tr_TR`` locale.

4.11.0
* Add ``sk_SK`` Job provider.

4.10.0
* Add ``date_time`` provider for ``pt_PT``.

4.9.0
* Add ``.unique()`` for unique values.

4.8.0
* Add automotive provider for ``tr_TR``.

4.7.0
* Add province list and add 2 new district to ``ne_NP``.

4.6.0
* Add Currency provider for ``sv_SE``.

4.5.0
* Add ``pt_PT`` credit card provider.

4.4.0
* Added Company Provider for ``tr_TR`` locale.

4.3.0
* Add job providers for ``tr_TR``.

4.2.0
* Implement color provider for ``sk_SK`` locale.

4.1.8
* Fix ``hu_HU`` color provider inheritance.

4.1.7
* Bigger zipcode ranges for VA, TX and MD in ``en_US``.

4.1.6
* Add new style ``pt_PT`` automotive plates.

4.1.5
* Remove duplicate jobs from the ``pt_PT`` provider.

4.1.4
* Use "Belarus" instead of "Vitryssland" for ``sv_SE``.
* Added bank provider for ``tr_TR`` locale.
* Improve VAT generation for IT provider.
* Use non-zero number for first digit of Swedish postal codes.

(adam)

wireshark: updated to 3.4.1

Wireshark 3.4.1 Release Notes

What is Wireshark?

  Wireshark is the world’s most popular network protocol analyzer. It is
  used for troubleshooting, analysis, development and education.

What’s New

  Bug Fixes

    • wnpa-sec-2020-16[1] Kafka dissector memory leak. Bug 16739[2].
      CVE-2020-26418[3].

    • wnpa-sec-2020-17[4] USB HID dissector crash. Bug 16958[5].
      CVE-2020-26421[6].

    • wnpa-sec-2020-18[7] RTPS dissector memory leak. Bug 16994[8].
      CVE-2020-26420[9].

    • wnpa-sec-2020-19[10] Multiple dissector memory leak. Bug
      17032[11]. CVE-2020-26419[12].

  The following bugs have been fixed:

  New and Updated Features

    • IETF QUIC TLS decryption errors when a NAT rebinding happens for
      a connection Bug 16915[13].

    • IETF QUIC TLS decryption error with key update Bug 16916[14].

    • IETF QUIC TLS decryption error after the second key update Bug
      16920[15].

    • SOME/IP: Wrong dissection of parameters after Array Bug
      16951[16].

    • Can editcap properly corrupt pcapng file with systemd journal
      export block? Bug 16965[17].

    • Crash when a GIOP ior.txt file is present Bug 16984[18].

    • Protobuf: failed to parse .proto file contains negative enum
      values or option values of number type Bug 16988[19].

    • MMRP dissector bug Bug 17005[20].

    • QUIC: "Loss bits" capability Bug 17010[21].

    • Stdin capture fails on Windows Bug 17018[22].

    • SSTP no longer recognized Bug 17024[23].

    • RFC2190 encapsulated H.263 bitfields masked wrong in Mode A Bug
      17025[24].

    • editcap fails when splitting into multiple pcapng files Bug
      17060[25].

  New Protocol Support

  There are no new protocols in this release.

  Updated Protocol Support

  ACDR, DOCSIS, Ericsson HDLC, F5 Ethernet Trailer, GIOP, GSM A, GSM
  RLC MAC, HTTP, IEEE 802.11, Kafka, LLC, MBIM, MMRP, NAS 5GS, NAS EPS,
  Nordic BLE, ProtoBuf, QUIC, Radiotap, RFC 2190, RTCP, RTPS, S1AP,
  SOME/IP, STUN, and USB Video

  New and Updated Capture File Support

  pcapng

(adam)

devel: Sort by name

(ryoon)

devel: Enable py-jupyter-console

(ryoon)

doc: Added devel/py-jupyter-console version 6.2.0

(ryoon)

devel/py-jupyter-console: import py38-jupyter-console-6.2.0

Jupyter Console is a terminal-based console frontend for Jupyter kernels.

(ryoon)

doc: Updated www/ruby-rouge to 3.26.0

(fcambus)

ruby-rouge: update to 3.26.0.

ChangeLog:

- We have two new lexers: one for OCL and one for ReScript.
- There are also fixes for the CMake, Crystal, JSL, Python, ReasonML
  and Rust lexers.

(fcambus)

doc: Updated databases/pgocaml to 4.2.2

(jaapb)

Updated databases/pgocaml to 4.2.2.

Changes are minor, mostly compatibility-related.

(jaapb)

haproxy: Don't set _XOPEN_SOURCE_EXTENDED=1

This breaks the _XOPEN_SOURCE logic, forcing XPG4v2 to be selected regardless
of what _XOPEN_SOURCE is set to.  Fixes SunOS build.

(jperkin)

doc: Updated textproc/lowdown to 0.7.5

(fcambus)

lowdown: update to 0.7.5.

Version 0.7.5, 2020-12-09

- Add support for the Gemini protocol I've been hearing so much about.
  This may now be used from lowdown(1) or as a library in lowdown(3).
  This is a very simple output: it basically does no formatting at
  all, but does have some logic to shuffle around links.  Version

Version 0.7.4, 2020-08-29

- Bug-fix: don't emit stray .PP macros when in -Tman or -Tms mode.
This bug was introduced in version 0.7.3.

- The library is now usable from C++ applications as-is, without
  needing extra compilation flags.

- Add missing lowdown_diff(3) and lowdown_metaq_free(3) manpages.

Version 0.7.3, 2020-08-20

- Fix some smart typography bugs, specifically with ending single or
  double quotes. While doing so, create a regression suite for smart
  typography and update the manpage. Bug submitted by Larry Kollar,
  thanks!

- Make base header level metadata key work properly. Another bug
  submitted by Larry Kollar, thanks!

- Fix --nroff-hard-wrap to emit trailing newlines. Yet another bug
  submitted by Larry Kollar, thanks!

Larry further suggested using typographic conventions in both the
-Tlatex and -Tms output to have initial paragraphs not indent, but
subsequent ones should. This is the default mode in LaTeX, which
I was disabling. I've now removed my override to be more like
default LaTeX, and Larry proposed an initial patch for having -Tms
do the same. Thanks yet again!

(fcambus)

doc: Updated devel/ocaml-ppx_deriving to 4.5

(jaapb)

Updated devel/ocaml-ppx_deriving to 4.5.

This adds support for OCaml 4.11.

(jaapb)

doc: Updated devel/ocaml-ppxlib to 0.15.0

(jaapb)

Updated devel/ocaml-ppxlib to 0.15.0.

Relatively minor changes, amongst which support for OCaml 4.10 and 4.11.

(jaapb)

doc: Updated devel/ocaml-stdlib-shims to 0.2.0nb1

(jaapb)

Updated devel/ocaml-stdlib-shims, revision bump.

Some files do not get compiled/installed any more, removed from PLIST.

(jaapb)

doc: Updated devel/ocaml-ppxfind to 1.4

(jaapb)

Updated devel/ocaml-ppxfind to 1.4

Added support for ocaml-migrate-parsetree >= 1.6.0.

(jaapb)

doc: Added sysutils/intel-backlight version 20200418

(nia)

sysutils: Add intel-backlight

This package contains the intel_backlight program from intel-gpu-tools,
which allows controlling the backlight level on certain Intel(R) GPUs,
including i915.

Since it performs direct PCI access, it must be run as root.

(nia)

sort

(jnemeth)

add and enable p5-Tie-CPHash

(jnemeth)

doc: Updated mail/neomutt to 20201127

(wiz)

neomutt: update to 20201127.

2020-11-27  Richard Russon  <rich@flatcap.org>
* Bug Fixes
  - Fix crash when saving an alias
* Translations
  - 70% Russian
* Code
  - Remove redundant function call

(wiz)

doc: Updated www/apache-tomcat85 to 8.5.61

(otis)

www/apache-tomcat85: Update to 8.5.61

Changelog for 8.5.61:
  - Align the behaviour of ServletContext.getRealPath(String path) with the
    recent clarification from the Servlet specification project. If the path
    parameter does not start with / then Tomcat processes the call as if / is
    appended to the beginning of the provided path.
  - Fix a potential file descriptor leak when WebSocket connections are
    attempted and fail.
  - Ensure that the LoadBalancerDrainingValve uses the correct setting for the
    secure attribute for any session cookies it creates.

Changelog for 8.5.60:
  - Statistics are now available (via JMX) for HTTP/2, WebSocket and HTTP/1.1
    upgraded connections
  - Stability improvements for HTTP/2
  - Improvements to error handling in the connection pool used by the JNDI
    Realm

(otis)

doc: Updated www/apache-tomcat9 to 9.0.41

(otis)

www/apache-tomcat9: Update to 9.0.41

Changelog for 9.0.41:
  - Align the behaviour of ServletContext.getRealPath(String path) with the
    recent clarification from the Servlet specification project. If the path
    parameter does not start with / then Tomcat processes the call as if / is
    appended to the beginning of the provided path.
  - Fix a potential file descriptor leak when WebSocket connections are
    attempted and fail.
  - Ensure that the LoadBalancerDrainingValve uses the correct setting for the
    secure attribute for any session cookies it creates.

Changelog for 9.0.40:
  - Statistics are now available (via JMX) for HTTP/2, WebSocket and HTTP/1.1
    upgraded connections
  - Stability improvements for HTTP/2
  - Stability improvements for the NIO connector

(otis)

py-jsonrpc-server: Fix python bulk build breakage.

(jperkin)

Update chat/matrix-synapse to 1.24.0

Synapse 1.24.0 (2020-12-09)
===========================

Due to the two security issues highlighted below, server administrators are
encouraged to update Synapse. We are not aware of these vulnerabilities being
exploited in the wild.

Security advisory
-----------------

The following issues are fixed in v1.23.1 and v1.24.0.

- There is a denial of service attack
  ([CVE-2020-26257](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-26257))
  against the federation APIs in which future events will not be correctly sent
  to other servers over federation. This affects all servers that participate in
  open federation. (Fixed in [#8776](https://github.com/matrix-org/synapse/pull/8776)).

- Synapse may be affected by OpenSSL
  [CVE-2020-1971](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-1971).
  Synapse administrators should ensure that they have the latest versions of
  the cryptography Python package installed.

To upgrade Synapse along with the cryptography package:

* Administrators using the [`matrix.org` Docker
  image](https://hub.docker.com/r/matrixdotorg/synapse/) or the [Debian/Ubuntu
  packages from
  `matrix.org`](https://github.com/matrix-org/synapse/blob/master/INSTALL.md#matrixorg-packages)
  should ensure that they have version 1.24.0 or 1.23.1 installed: these images include
  the updated packages.
* Administrators who have [installed Synapse from
  source](https://github.com/matrix-org/synapse/blob/master/INSTALL.md#installing-from-source)
  should upgrade the cryptography package within their virtualenv by running:
  ```sh
  <path_to_virtualenv>/bin/pip install 'cryptography>=3.3'
  ```
* Administrators who have installed Synapse from distribution packages should
  consult the information from their distributions.

Internal Changes
----------------

- Add a maximum version for pysaml2 on Python 3.5. ([\#8898](https://github.com/matrix-org/synapse/issues/8898))

Synapse 1.24.0rc2 (2020-12-04)
==============================

Bugfixes
--------

- Fix a regression in v1.24.0rc1 which failed to allow SAML mapping providers which were unable to redirect users to an additional page. ([\#8878](https://github.com/matrix-org/synapse/issues/8878))

Internal Changes
----------------

- Add support for the `prometheus_client` newer than 0.9.0. Contributed by Jordan Bancino. ([\#8875](https://github.com/matrix-org/synapse/issues/8875))

Synapse 1.24.0rc1 (2020-12-02)
==============================

Features
--------

- Add admin API for logging in as a user. ([\#8617](https://github.com/matrix-org/synapse/issues/8617))
- Allow specification of the SAML IdP if the metadata returns multiple IdPs. ([\#8630](https://github.com/matrix-org/synapse/issues/8630))
- Add support for re-trying generation of a localpart for OpenID Connect mapping providers. ([\#8801](https://github.com/matrix-org/synapse/issues/8801), [\#8855](https://github.com/matrix-org/synapse/issues/8855))
- Allow the `Date` header through CORS. Contributed by Nicolas Chamo. ([\#8804](https://github.com/matrix-org/synapse/issues/8804))
- Add a config option, `push.group_by_unread_count`, which controls whether unread message counts in push notifications are defined as "the number of rooms with unread messages" or "total unread messages". ([\#8820](https://github.com/matrix-org/synapse/issues/8820))
- Add `force_purge` option to delete-room admin api. ([\#8843](https://github.com/matrix-org/synapse/issues/8843))

Bugfixes
--------

- Fix a bug where appservices may be sent an excessive amount of read receipts and presence. Broke in v1.22.0. ([\#8744](https://github.com/matrix-org/synapse/issues/8744))
- Fix a bug in some federation APIs which could lead to unexpected behaviour if different parameters were set in the URI and the request body. ([\#8776](https://github.com/matrix-org/synapse/issues/8776))
- Fix a bug where synctl could spawn duplicate copies of a worker. Contributed by Waylon Cude. ([\#8798](https://github.com/matrix-org/synapse/issues/8798))
- Allow per-room profiles to be used for the server notice user. ([\#8799](https://github.com/matrix-org/synapse/issues/8799))
- Fix a bug where logging could break after a call to SIGHUP. ([\#8817](https://github.com/matrix-org/synapse/issues/8817))
- Fix `register_new_matrix_user` failing with "Bad Request" when trailing slash is included in server URL. Contributed by @angdraug. ([\#8823](https://github.com/matrix-org/synapse/issues/8823))
- Fix a minor long-standing bug in login, where we would offer the `password` login type if a custom auth provider supported it, even if password login was disabled. ([\#8835](https://github.com/matrix-org/synapse/issues/8835))
- Fix a long-standing bug which caused Synapse to require unspecified parameters during user-interactive authentication. ([\#8848](https://github.com/matrix-org/synapse/issues/8848))
- Fix a bug introduced in v1.20.0 where the user-agent and IP address reported during user registration for CAS, OpenID Connect, and SAML were of the wrong form. ([\#8784](https://github.com/matrix-org/synapse/issues/8784))

Improved Documentation
----------------------

- Clarify the usecase for a msisdn delegate. Contributed by Adrian Wannenmacher. ([\#8734](https://github.com/matrix-org/synapse/issues/8734))
- Remove extraneous comma from JSON example in User Admin API docs. ([\#8771](https://github.com/matrix-org/synapse/issues/8771))
- Update `turn-howto.md` with troubleshooting notes. ([\#8779](https://github.com/matrix-org/synapse/issues/8779))
- Fix the example on how to set the `Content-Type` header in nginx for the Client Well-Known URI. ([\#8793](https://github.com/matrix-org/synapse/issues/8793))
- Improve the documentation for the admin API to list all media in a room with respect to encrypted events. ([\#8795](https://github.com/matrix-org/synapse/issues/8795))
- Update the formatting of the `push` section of the homeserver config file to better align with the [code style guidelines](https://github.com/matrix-org/synapse/blob/develop/docs/code_style.md#configuration-file-format). ([\#8818](https://github.com/matrix-org/synapse/issues/8818))
- Improve documentation how to configure prometheus for workers. ([\#8822](https://github.com/matrix-org/synapse/issues/8822))
- Update example prometheus console. ([\#8824](https://github.com/matrix-org/synapse/issues/8824))

Deprecations and Removals
-------------------------

- Remove old `/_matrix/client/*/admin` endpoints which were deprecated since Synapse 1.20.0. ([\#8785](https://github.com/matrix-org/synapse/issues/8785))
- Disable pretty printing JSON responses for curl. Users who want pretty-printed output should use [jq](https://stedolan.github.io/jq/) in combination with curl. Contributed by @tulir. ([\#8833](https://github.com/matrix-org/synapse/issues/8833))

Internal Changes
----------------

- Simplify the way the `HomeServer` object caches its internal attributes. ([\#8565](https://github.com/matrix-org/synapse/issues/8565), [\#8851](https://github.com/matrix-org/synapse/issues/8851))
- Add an example and documentation for clock skew to the SAML2 sample configuration to allow for clock/time difference between the homserver and IdP. Contributed by @localguru. ([\#8731](https://github.com/matrix-org/synapse/issues/8731))
- Generalise `RoomMemberHandler._locally_reject_invite` to apply to more flows than just invite. ([\#8751](https://github.com/matrix-org/synapse/issues/8751))
- Generalise `RoomStore.maybe_store_room_on_invite` to handle other, non-invite membership events. ([\#8754](https://github.com/matrix-org/synapse/issues/8754))
- Refactor test utilities for injecting HTTP requests. ([\#8757](https://github.com/matrix-org/synapse/issues/8757), [\#8758](https://github.com/matrix-org/synapse/issues/8758), [\#8759](https://github.com/matrix-org/synapse/issues/8759), [\#8760](https://github.com/matrix-org/synapse/issues/8760), [\#8761](https://github.com/matrix-org/synapse/issues/8761), [\#8777](https://github.com/matrix-org/synapse/issues/8777))
- Consolidate logic between the OpenID Connect and SAML code. ([\#8765](https://github.com/matrix-org/synapse/issues/8765))
- Use `TYPE_CHECKING` instead of magic `MYPY` variable. ([\#8770](https://github.com/matrix-org/synapse/issues/8770))
- Add a commandline script to sign arbitrary json objects. ([\#8772](https://github.com/matrix-org/synapse/issues/8772))
- Minor log line improvements for the SSO mapping code used to generate Matrix IDs from SSO IDs. ([\#8773](https://github.com/matrix-org/synapse/issues/8773))
- Add additional error checking for OpenID Connect and SAML mapping providers. ([\#8774](https://github.com/matrix-org/synapse/issues/8774), [\#8800](https://github.com/matrix-org/synapse/issues/8800))
- Add type hints to HTTP abstractions. ([\#8806](https://github.com/matrix-org/synapse/issues/8806), [\#8812](https://github.com/matrix-org/synapse/issues/8812))
- Remove unnecessary function arguments and add typing to several membership replication classes. ([\#8809](https://github.com/matrix-org/synapse/issues/8809))
- Optimise the lookup for an invite from another homeserver when trying to reject it. ([\#8815](https://github.com/matrix-org/synapse/issues/8815))
- Add tests for `password_auth_provider`s. ([\#8819](https://github.com/matrix-org/synapse/issues/8819))
- Drop redundant database index on `event_json`. ([\#8845](https://github.com/matrix-org/synapse/issues/8845))
- Simplify `uk.half-shot.msc2778.login.application_service` login handler. ([\#8847](https://github.com/matrix-org/synapse/issues/8847))
- Refactor `password_auth_provider` support code. ([\#8849](https://github.com/matrix-org/synapse/issues/8849))
- Add missing `ordering` to background database updates. ([\#8850](https://github.com/matrix-org/synapse/issues/8850))
- Allow for specifying a room version when creating a room in unit tests via `RestHelper.create_room_as`. ([\#8854](https://github.com/matrix-org/synapse/issues/8854))

(js)

Updated net/py-scp, math/py-networkx

(adam)

py-networkx: updated to 2.5

NetworkX 2.5

Highlights
----------
This release is the result of 10 months of work with over 200 commits by
92 contributors. Highlights include:

- Dropped support for Python 3.5.
- add Pathlib support to work with files.
- improve performance.
- Updated docs and tests.
- Removed code designed to work with Python 2.

New Functions:
- lukes_partitioning
- triadic analysis functions
- functions for trophic levels analysis
- d_separated
- is_regular and other regular graph measures
- graph_hash using Weisfeiler Lehman methods
- common_neighbor_centrality (CCPA link prediction)
- max_weight_clique
- path_weight and is_path
- rescale_layout_dict
- junction_tree

New generators:
- paley_graph
- interval_graph

New layouts:
- multipartite_layout

Improvements
------------
- Add governance documents, developer guide and community structures
- Implement explicit deprecation policy.
- Initiate an NX Enhancement Proposal (NXEP) system
- optimize single_source_shortest_path
- improved consistent "weight" specification in shortest_path routines
- Reduce numpy.matrix usage which is discouraged by numpy.
- improved line color
- better search engine treatment of docs
- lattice and grid_graph and grid_2d_graph can use dim=tuple
- fix initializer of kamada_kawai_layout algorithm
- moral and threshold functions now included in namespace and docs
- scale arrows better when drawing
- more uniform creation of random lobster graphs
- allow editing graph during iteration over connected_components
- better column handling in coversion of pandas DataFrame
- allow simrank_similarity with directed graph input
- ensure VoteRank ability is nonnegative
- speedup kernighan_lin_bisection
- speedup negative weight cycle detection
- tree_isomorphism
- rooted_tree_isomorphism
- Gexf edge attribute "label" is available

API Changes
-----------
- enabled "copy" flag parameter in `contracted_nodes`
- allow partially periodic lattices
- return value for minimum_st_node_cut now always a set
- removed unused "has_numpy" argument from create_py_random_state
- fixed return values when drawing empty nodes and edges
- allow sets and frozensets of edges as input to nx.Graph()
- "weight" can be function for astar, directional_dijksta, all_shortest_path
- allow named key ids for GraphML edge writing
- all keywords are now checked for validity in nx.draw and friends
- EdgeDataView "in" operator checks if nodes are "in nbunch"
- remove completeness condition from minimum weight full matching
- option to sort neighbors in bfs traversal
- draw_networkx accepts numpy array for edgelist
- relabel_nodes with 2 nodes mapped to same node can now create multiedge
- steiner_tree works with MultiGraph
- Add `show` kwarg to view_pygraphviz
- Prepare for turning chordal_graph_cliques into a generator
- GraphML reader keyword force_multigraph creates MultiGraph even w/o multiedges

(adam)

py-scp: updated to 0.13.3

0.13.3 (2020-10-26)
- Fix hanging when underlying paramiko channel is closed

(adam)

doc: Updated graphics/djview4 to 4.12

(ryoon)

djview4: Update to 4.12

Changelog:
NEW IN VERSION 4.12
-------------------
- Fixes for recent compilers
- Fixes for Qt-5.15
- Fixes in tiff2pdf.c
- Updated documentation (most browsers no longer support plugins)
- Spanish localization (from Mike Molina)

NEW IN VERSION 4.11
-------------------
- Support for pinch gestures
- New shortcuts on mac
- Support for high dpi displays
- Spanish translations
- Bug fixes
- Workaround for qt5.5 embed bug
- Fixed annotation display bugs revealed by qt5
- Urls in outline are now opened by djview if mime type is djvu.

(ryoon)

doc: Updated print/pdf2djvu to 0.9.17.1

(ryoon)

pdf2djvu: Update to 0.9.17.1

Changelog:
pdf2djvu (0.9.17.1) unstable; urgency=low

  * Fix build failure with Poppler >= 20.08.

-- Jakub Wilk <jwilk@jwilk.net>  Fri, 07 Aug 2020 19:13:22 +0200

pdf2djvu (0.9.17) unstable; urgency=low

  * Fix build failure with Poppler >= 0.86.
    Thanks to David B. Evans for the bug report.
    https://github.com/jwilk/pdf2djvu/issues/142
  * Drop support for Poppler < 0.35.
  * Upgrade libraries bundled with the Windows package:
    - Poppler to 0.86.1;
    - Expat to 2.2.9;
    - FreeType to 2.10.1.

-- Jakub Wilk <jwilk@jwilk.net>  Mon, 02 Mar 2020 17:46:38 +0100

pdf2djvu (0.9.16) unstable; urgency=low

  * Fix build failure with Poppler >= 0.85.

-- Jakub Wilk <jwilk@jwilk.net>  Thu, 20 Feb 2020 11:38:58 +0100

pdf2djvu (0.9.15) unstable; urgency=low

  * Fix build failure with Poppler >= 0.83.

-- Jakub Wilk <jwilk@jwilk.net>  Fri, 20 Dec 2019 15:30:18 +0100

pdf2djvu (0.9.14) unstable; urgency=low

  * Fix build failure with Poppler >= 0.82.

-- Jakub Wilk <jwilk@jwilk.net>  Mon, 28 Oct 2019 17:07:29 +0100

(ryoon)

doc: Updated math/py-sympy to 1.7

(ryoon)

py-sympy: Update to 1.7

Changelog:
SymPy 1.7 was released on 29th November 2020.

This version of SymPy has been tested on Python 3.6, 3.7, 3.8, 3.9 and PyPy.
See our Python version support policy for more information on when we plan to
drop support for older Python versions.

Note in particular that SymPy 1.5.1 was the last release to support Python 2.7.
SymPy 1.7 will not work on Python 2.7. Python 2.7 users should install SymPy
1.5.1 and will not be able to install any further SymPy updates without
updating to Python 3.

Install SymPy with

pip install -U sympy

or if you use Anaconda

conda install sympy

Highlights

There are many changes in 1.7 (see below).

Backwards compatibility breaks and deprecations

  * core

      + Modules and names that were accidentally importable from sympy are no
        longer importable. In sympy 1.6 importing and using these names would
        give a deprecation warning. In sympy 1.7 these names are removed. As an
        example from sympy import add would need to be from sympy.core import
        add or import sympy.core.add as add. (#19554 by @oscarbenjamin)

      + DEPRECATION: Using non-Expr args in Add, Mul or Pow is now deprecated (
        #19445 by @oscarbenjamin)

  * diffgeom

      + Manifold.patches attribute is deprecated. (#19368 by @JSS95 and
        @mcpl-sympy)

      + Patch.coord_systems attribute is deprecated. (#19368 by @JSS95 and
        @mcpl-sympy)

      + Class signature names of CoordSystem is deprecated. CoordinateSymbol
        class and CoordSystem.symbols attribute are introduced instead. (#19368
        by @JSS95 and @mcpl-sympy)

      + CoordSystem.transforms, CoordSystem.connect_to, and
        CoordSystem.coord_tuple_transform_to are deprecated. Class signature
        relations, CoordSystem.transformation and CoordSystem.transform are
        introduced instead. (#19368 by @JSS95 and @mcpl-sympy)

  * printing

      + sympy.printing.pretty.pretty_symbology.xstr has been deprecated (#20081
        by @eric-wieser)

      + The unicode argument to sympy.printing.stringpict.prettyForm has been
        deprecated (#20081 by @eric-wieser)

      + The deprecation of calling preview with viewer="StringIO" is now
        expired instead of forgotten (a regression in 1.6.0) (#19905 by
        @eric-wieser)

      + The modules sympy.printing.ccode, sympy.printing.fcode, and
        sympy.printing.cxxcode have been renamed to sympy.printing.c,
        sympy.printing.fortran, and sympy.printing.cxx, respectively. This was
        done to avoid conflicts that occur when a module name is the same as a
        function name. The modules are still importable under their old names
        but doing so is deprecated and a warning will be given (#19908 by
        @asmeurer)

      + from sympy.printing.codeprinter import Assignment no longer works. You
        should use from sympy.codegen import Assignment, which is where
        Assignment has lived since SymPy 1.1. (#19908 by @asmeurer)

      + Calling preview with viewer="file" no longer looks for a file
        executable (a regression in 1.6.0) (#19905 by @eric-wieser)

  * solvers

      + solve_linear_system is now a thin wrapper for linsolve. It is
        recommended to use linsolve in new code. solve_linear_system maybe
        deprecated or removed in future. (#18814 by @oscarbenjamin)
  * utilities

      + find_executable is deprecated in favor of the builtin shutil.which. (#
        19634 by @eric-wieser)

Changes

  * algebras

      + Added DocString for integrate function of quaternion class. (#19410 by
        @mohitshah3111999)
  * codegen

      + Added support for generating calls to scipy.special.cosm1. (#20011 by
        @bjodah)
      + sympy.codegen and sympy.combinatorics are no longer imported as part of
        from sympy import *. The codegen and combinatorics modules do not have
        any names that are included in the top-level namespace, so their being
        imported with the top-level SymPy was a mistake. This improves the
        import time of from sympy import *. (#19908 by @asmeurer)
      + Added support for generating calls to numpy.logaddexp &
        numpy.logaddexp2. (#19880 by @bjodah)

      + Fix bugs to the parser of matrix expressions in order to build
        CodegenArray objects correctly. (#19197 by @Upabjojr)

  * combinatorics

      + Fixed a bug in PermutationGroup.minimal_blocks caused by modifying a
        list while iterating over its indices. (#19954 by @ilya-pchelintsev)
  * concrete

      + Implemented Raabe's Test (#18656 by @sachin-4099)
  * core

      + Fixed a few broken cases of expr.is_integer (#20450 by @coproc and
        @tbennun)

      + Modules and names that were accidentally importable from sympy are no
        longer importable. In sympy 1.6 importing and using these names would
        give a deprecation warning. In sympy 1.7 these names are removed. As an
        example from sympy import add would need to be from sympy.core import
        add or import sympy.core.add as add. (#19554 by @oscarbenjamin)

      + Zero raised to power Negative Infinity gives ComplexInfinity(zoo)
        instead of zero (#20212 by @sidhu1012)

      + Extensible add, mul and power functions are introduced to allow sympy
        objects to define what classes should be used for them in place of Add,
        Mul and Pow (e.g. matrices use MatAdd). This is an experimental
        approach aimed at enabling the behaviour of core routines (expand,
        collect, etc) to be customised by user-defined types (e.g. MatAdd
        rather than Add). This mechanism is still experimental, is not fully
        implemented across the core and might be changed or removed in a future
        release of sympy. (#19463 by @JSS95 and @mcpl-sympy)

      + divmod on sympy.Float with 0 numerator now results in (0, 0). (#20109
        by @eriknw)
      + Dict operations no longer automatically converts strings into SymPy
        types. (#19911 by @asmeurer)

      + Dict operations no longer raise SympifyError. (#19911 by @asmeurer)

      + Fixes _eval_nseries() function of power.py (#19508 by @sachin-4099)

      + Remove optional dependency on fastcache (#19492 by @pbrady)

      + DEPRECATION: Using non-Expr args in Add, Mul or Pow is now deprecated (
        #19445 by @oscarbenjamin)

      + When creating an Add or Mul with evaluate=False identities (0 or 1) are
        no longer removed. (#19450 by @oscarbenjamin)

      + Fixes _eval_nseries() function of mul.py (#19369 by @sachin-4099)

      + Sum is now included in count_ops results (#19261 by @smichr)

      + match has been optimized to improve term-matching in Add (#19261 by
        @smichr)

      + match will automatically ignore bound symbols when matching (#19261 by
        @smichr)

      + match results will no longer contain extraneous symbols (only those
        requested) (#19261 by @smichr)

      + as_dummy should give a canonical result for expressions having bound
        symbols (#19261 by @smichr)

      + Lambdas written in terms of different symbols will no longer compare
        equal; this was an abuse of the Python == operator (#19261 by @smichr)

      + expr: A new method is_meromorphic is added. (#19306 by @jksuom)

  * diffgeom

      + Manifold.patches attribute is deprecated. (#19368 by @JSS95 and
        @mcpl-sympy)

      + Patch.coord_systems attribute is deprecated. (#19368 by @JSS95 and
        @mcpl-sympy)

      + Class signature names of CoordSystem is deprecated. CoordinateSymbol
        class and CoordSystem.symbols attribute are introduced instead. (#19368
        by @JSS95 and @mcpl-sympy)

      + CoordSystem.transforms, CoordSystem.connect_to, and
        CoordSystem.coord_tuple_transform_to are deprecated. Class signature
        relations, CoordSystem.transformation and CoordSystem.transform are
        introduced instead. (#19368 by @JSS95 and @mcpl-sympy)

      + CoordSystem.jacobian_determinant method is introduced. (#19368 by
        @JSS95 and @mcpl-sympy)

  * functions

      + lambdify added a warning when args is a set. (#19792 by @foice,
        @RobertoFranceschini, and @sylee957)

      + Fixes _eval_nseries method of log (#20002 by @sachin-4099)

      + Adds _eval_is_meromorphic method and _eval_aseries to class lowergamma
        (#19990 by @sachin-4099)

      + Adds _eval_is_meromorphic method and _eval_rewrite_as_tractable method
        to class uppergamma (#19990 by @sachin-4099)

      + Rectifies eval method of class besselk (#19990 by @sachin-4099)

      + Adds _eval_is_meromorphic to bessel function. (#19963 by @sachin-4099)

      + Adds _eval_nseries function to sin and cos. (#19916 by @sachin-4099)

      + reduced symbolic multiples of pi in trigonometric functions (#19741 by
        @sachin-4099)

      + fixed errors in assumptions when rewriting RisingFactorial /
        FallingFactorial as gamma or factorial (#18696 by @sachin-4099)

      + Adds _singularities to LambertW function (#19716 by @sachin-4099)

      + Rectifies _eval_rewrite_as_tractable method of class erf (#19697 by
        @sachin-4099)

      + Improved condition checking in piecewise_simplify() (#19596 by
        @dhruvmendiratta6 and @smichr)

      + Implemented _eval_rewrite_as_Abs() for sign (#19487 by
        @dhruvmendiratta6)

      + Adds cdir parameter to handle series expansions on branch cuts (#19555
        by @sachin-4099)

      + Adds _eval_rewrite_as_factorial() and _eval_rewrite_as_gamma()
        functionalities for subfactorial (#19515 by @sachin-4099)

      + Fixed cot.as_real_imag (sign error in imaginary part) (#19468 by
        @DaveWitteMorris and @gschintgen)

      + Corrects the _eval_as_leading_term() method of tan and sec functions (#
        19461 by @sachin-4099)

      + bsplines are more robust in terms of handling symbolic knots (#19272 by
        @smichr)

  * geometry

      + Ellipses with eccentricity >=1 and for eccentricity < 0 will be handled
        as trivial cases (#20045 by @agrawalshubham01)
  * integrals

      + upgrades to manualintegrate to support inverse trig functions! (#19993
        by @iammosespaulr)
  * interactive

      + The _repr_latex_, _repr_svg_, and _repr_png_ methods of subclasses of
        sympy objects are no longer discarded when init_printing() is called. (
        #19944 by @eric-wieser)
  * logic

      + Binary boolean operators on Boolean objects no longer coerce strings (#
        20093 by @eric-wieser)
  * matrices

      + Adding an array and a matrix now consistently gives TypeError. (#20159
        by @sidhu1012)

      + changed subs function to check if input is zip (#19159 by @czgdp1807
        and @gfolbe318)

      + added tests in test_commonmatrix.py (#19159 by @czgdp1807 and
        @gfolbe318)

      + The ordering of parameters in a parametrised solution from
        gauss_jordan_solve was fixed. Previously incorrect results were
        returned for some underdetermined systems. (#19885 by @1124816)

      + Prevents infinite recursion with rmul (#19860 by @mloubout)

      + Added class MatrixSet to represent the set of matrices (#19826 by
        @Smit-create)

      + Disabled default matrix intermediate product simplification and changed
        it to enable via context manager. (#19588 by @oscarbenjamin and
        @Pristine-Cat)

      + Use more efficient Cholesky factorization method to check if matrices
        are positive semidefinite. (#19573 by @galbwe)

      + row_del and col_del will raise IndexError rather than ValueError when
        the index is out of bounds. (#19571 by @sylee957)
      + Fixed a bug in the implementation of Sylvester's criterion for
        determining if a matrix is positive semidefinite. (#19556 by @galbwe)

      + Explicit non-matrix are treated as scalar (#19533 by @mloubout)

      + QRdecomposition will return matrices with zero rows and columns for
        zero rank matrices. e.g. Matrix([[0, 0, 0], [0, 0, 0], [0, 0, 0]]) will
        be decomposed with Matrix(3, 0, []) and Matrix(0, 3, []) (#19319 by
        @sylee957)

      + Added Matrix.companion for creating dense companion matrix. (#19339 by
        @sylee957)

      + Added CompanionMatrix for creating a symbolic companion matrix. (#19339
        by @sylee957)

      + Matrix([]).eigenvals(multiple=True) will give an empty list instead of
        an empty dict. (#19355 by @sylee957)

      + Determinant is now considered commutative. (#19354 by @eric-wieser)
  * ntheory

      + Integrated Lenstra's Elliptic Curve factorization into factorint (#
        19937 by @abh2k)

      + Added quadratic sieve (#19657 by @abh2k)

      + Implemented Lenstra's Elliptic curve factorization and Elliptic curve
        primality test (#19436 by @abhinav28071999)

  * parsing

      + Added support for while loop in C Parser (#20188 by @smitgajjar)
      + Upgraded Relational Operator support (#19982 by @iammosespaulr)

      + Bra-Ket Notation support (#19982 by @iammosespaulr)

      + Improved Grammar (#19982 by @iammosespaulr)

      + added Latex support for "not equal" and expanded support for less than,
        greater than symbols (#19970 by @bhpayne)

      + parse_latex supports \left and \right parenthesis notation. (#19466 by
        @sylee957)

      + parse_latex can parse expressions with amsmath spacing (#19475 by
        @sylee957)

      + Added parsing of \exp in parse_latex. (#19395 by @sylee957)

      + Add more parsing rules and test examples. (#19177 by @wuyudi)

      + Added support for more data types in C parser: signed char, unsigned
        char, short, short int, signed short, signed short int, unsigned short,
        unsigned short int, unsigned int, long, long int, signed long, signed
        long int, unsigned long, unsigned long int, double, long double. Also,
        modified the data type for int and float to intc and float32
        respectively, replacing integer and real (#19230 by @smitgajjar)

      + Added support for shorthand operators in C parser: +=, -=, *=, /= and %
        = (#19230 by @smitgajjar)

      + Removed the assumption of value of a variable, if it is not initialized
        while variable declaration(e.g.; in case of int a;, the value of a was
        assumed to be Integer(0), in case of float b;, the value of b was
        assumed to be Float(0.0) and in case of bool c;, the value of c was
        assumed to be S.false). Also, removed the assumption of default value
        of formal parameters while parameter declaration in function definition
        or function prototype (e.g.; in case of function definition void func
        (int a, float b) { //some code }, default value of formal parametersa
        and b were assumed to be Integer(0) and Float(0.0) respectively) (#
        19230 by @smitgajjar)

  * physics.control

      + Added dc_gain, poles, zeros, and is_stable in TransferFunction class. (
        #19896 by @namannimmo10)

      + Adding a new control systems toolbox as physics.control. (#18436 by
        @benepla and @namannimmo10)

      + Add TransferFunction, Series, Parallel, and Feedback class for
        physics.control submodule (#19390 by @benepla and @namannimmo10)

  * physics.quantum

      + Simplification of Dagger() * IdentityOperator() (#19783 by
        @dhruvmendiratta6)

      + When printing, Commutator, Anticommutator, InnerProduct, TensorProduct,
        and OuterProduct now respect keyword-arguments to sstr. (#19424 by
        @eric-wieser)

  * physics.units

      + Fixed some dimensional analysis bugs with the addition and
        multiplication operators. (#19705 by @mgreminger)
  * physics.vector

      + Added user warnings for all possible paths are found in particle.py. (#
        20131 by @sidhu1012)

      + Added user warning for cyclic paths in particle.py. (#20131 by
        @sidhu1012)

      + Point.vel() now attempts to calculate the velocity using the relative
        position from other points if it has not been already set by the user.
        This behavior mimics the existing behavior in ReferenceFrame.ang_vel_in
        (). (#20049 by @moorepants and @sidhu1012)

      + VectorLatexPrinter now respects the symbol_names setting when printing
        dynamicsymbols (#19684 by @eric-wieser)

      + VectorLatexPrinter now know about the same trig functions as the
        regular printer (#19684 by @eric-wieser)

      + When printing, Vector and Dyadic now respect keyword-arguments to sstr
        and latex. As a result, these no longer use vector printing
        customizations unless init_vprinting has been called. (#19640 by
        @eric-wieser)

  * plotting

      + capability to subclass Basebackend and specify it to the plotting
        functions, thus creating plots with other plotting libraries (#20463 by
        @oscarbenjamin)
      + Fixed plot3d_parametric_line plotting curves out of the box. (#19252 by
        @sylee957)
  * polys

      + Polys with complex floating point coefficients will now use the CC
        domain rather than EX. (#20194 by @oscarbenjamin)

      + Fixed a bug in minimal_polynomial when using Groebner bases (compose=
        False) (#19799 by @coproc)

      + Fixed GeneratorsError for creating some elements of FractionField when
        its ground domain is FractionField or PolynomialRing. (#19713 by
        @sylee957)

      + Fixed Poly initialized with PolyElement mutating the generator of the
        coefficient in the form of polynomial. (e.g. Poly(ZZ[x](x+1), y, domain
        =ZZ[x]) becomes Poly(y+1, y, domain=ZZ[x])) (#19659 by @sylee957)

      + Fixed Poly initialized with FracElement raising SympifyError. (e.g. dom
        = ZZ.frac_field(x); Poly(dom(x+2), y, domain=dom)) (#19659 by @sylee957
        )

      + Add division to finite extensions. (#19593 by @gschintgen and @jksuom)

      + Fixed GCD to always return a non-negative constant. (#19569 by
        @KaustubhDamania)

      + added new domains for Gaussian integers and rationals (#15396 by
        @jksuom and @smichr)

      + Add the Gaussian domains ZZ_I and QQ_I to Poly. Make Poly use the
        Gaussian domains automatically when I is present in the input. Add
        factorisation over the Gaussian integers (ZZ_I). The polys keyword
        argument gaussian=True now results in the domain QQ_I rather than the
        extension field QQ<I>. (#15396 by @oscarbenjamin)

      + improvement of dup_zz_mignotte_bound(f, K) by Knuth-Cohen bound (#19254
        by @lagamura)

  * printing

      + Support frac with pycode printers (for lambdify) (#20115 by @ehren)

      + Round-trip printing of floats (double-precision) to content MathML. (#
        19958 by @lcontento)

      + latex now once again requires settings to be passed as keyword and not
        positional arguments, and respects printer settings changed with
        set_global_settings; restoring the behavior from sympy 1.2 and earlier.
        (#20067 by @eric-wieser)

      + sympy.printing.pretty.pretty_symbology.xstr has been deprecated (#20081
        by @eric-wieser)

      + The unicode argument to sympy.printing.stringpict.prettyForm has been
        deprecated (#20081 by @eric-wieser)

      + The unicode attribute of sympy.printing.stringpict.prettyForm has been
        deprecated (#20081 by @eric-wieser)

      + The mpmath code printer now correctly prints the loggamma function. (#
        19913 by @abhaydhiman)

      + Use literal suffix for 1.0 in C89CodePrinter's printing of pow when the
        exponent is -1 (#19956 by @bjodah and @mmohrhard)

      + The modules sympy.printing.ccode, sympy.printing.fcode, and
        sympy.printing.cxxcode have been renamed to sympy.printing.c,
        sympy.printing.fortran, and sympy.printing.cxx, respectively. This was
        done to avoid conflicts that occur when a module name is the same as a
        function name. The modules are still importable under their old names
        but doing so is deprecated and a warning will be given (#19908 by
        @asmeurer)

      + from sympy.printing.codeprinter import Assignment no longer works. You
        should use from sympy.codegen import Assignment, which is where
        Assignment has lived since SymPy 1.1. (#19908 by @asmeurer)

      + Calling preview with viewer="file" no longer looks for a file
        executable (a regression in 1.6.0) (#19905 by @eric-wieser)

      + The deprecation of calling preview with viewer="StringIO" is now
        expired instead of forgotten (a regression in 1.6.0) (#19905 by
        @eric-wieser)

      + When printing, NDimArray now respects keyword-arguments to sstr (#19903
        by @eric-wieser)

      + preview no longer fails with ValueError if the preamble contains a %
        character. (#19858 by @eric-wieser)

      + Types which are not recognized by the LaTeX printer no longer have
        their __str__ interpreted as LaTeX, and have their str(...) printed as
        pre-formatted text as if they were printed normally. This includes the
        builtin str type: latex("hello") now results in the latex \mathtt{\text
        {hello}}.

        If a custom type intends to be interpreted as latex, it should define
        the _latex hook as described in the docs:

        def _latex(self, printer):
            return str(self)  # indicate that the result of __str__ is LaTeX-compatible

        To print a string containing LaTeX math using MathJax, use

        import IPython
        IPython.display.Math(string)

        (#19611 by @eric-wieser)

      + The latex printer now shows builtin floats using ...x10^... notation
        instead of ...e... notation. (#19611 by @eric-wieser)

      + preview now throws OSError instead of SystemError if viewers cannot be
        found. (#19818 by @eric-wieser)

      + Fixed the SciPy printer for sparse matrices (#19633 by @benjaminwolba
        and @sylee957)

      + preview(..., output='pdf') now uses dvipdfmx instead of dvipdf if
        available. As a result, it now works with a MiKTeX installation on
        windows. (#19635 by @eric-wieser)

      + LatexPrinter._print is no longer called on strings which have already
        been converted to Latex. (#19614 by @eric-wieser)

      + A new sympy.printing.defaults.Printable base class was added, which is
        a mixin providing _repr_latex_ in terms of LatexPrinter().doprint().
        Any user type which subclasses this will opt into init_printing. (#
        19425 by @eric-wieser)

      + Printing unevaluated Muls with multiple Number factors will show all
        factors strictly in order. Identities will also be shown explicitly. (#
        19450 by @oscarbenjamin)

      + user types that implement _latex are now printed as LaTeX when embedded
        within builtin collections like list or dict. (#19389 by @eric-wieser)

      + fixed a bug where srepr function would not print dictionary and set
        properly (#19346 by @rational-kunal)

      + tuples of one element now include the usual trailing comma (#19348 by
        @eric-wieser)

      + mat_symbol_style='bold' no longer applies to subscripts of matrix
        symbols (#19301 by @eric-wieser)

  * series

      + Adds e.is_Pow heuristic to limits.py to improve the limit evaluations
        of Pow objects (#19680 by @sachin-4099)

      + Changes in mrv() function of gruntz.py and cancel() function of
        polytools.py resolves RecursionError and Timeout in limit evaluations (
        #19646 by @sachin-4099)

      + modified order.py to better work with Add objects. (#19546 by
        @maurogaravello)
      + Adds a functionality to the doit() method of limits.py which uses
        is_meromorphic() for limit evaluations (#19432 by @sachin-4099)
      + Fixed wrong computations of fourier_series for even or odd functions
        with limits that are specified non-central. (#19382 by @sylee957)
      + Replaces xreplace() with subs() in rewrite() function of gruntz.py
        resolving incorrect limit evaluations (#19297 by @sachin-4099)

      + Adds a condition to limitinf() function of gruntz.py resolving
        incorrect limit evaluations (#19292 by @sachin-4099)

  * sets

      + Earlier expr and sets were treated equal which gave incorrect output
        for some set functions(mainly : - in, is_subset), made sets and expr
        not to be equal (#20208 by @sidhu1012)
      + nested multi-symbol first arg for ConditionSet now handled with subs/
        as_dummy (#19512 by @smichr)

      + the bound symbols cannot be replaced with subs (#19512 by @smichr)

      + the error checking for mismatched signatures for sym and the base set
        has been improved (#19512 by @smichr)

      + ConditionSet still tries to unify symbols and denest a base set that is
        given as a ConditionSet but will no longer introduce new symbols (and
        will leave the base set a a ConditionSet) when this cannot be done (#
        19512 by @smichr)

      + Fixed ConditionSet.dummy_eq() and ConditionSet.as_dummy(). (#19502 by
        @gschintgen)

      + Fixed ConditionSet.subs() in the case where the substitution targets a
        free symbol. (#19495 by @gschintgen)

      + Fixed _infimum_key sorting key. (#19437 by @gschintgen)

      + ImageSets with Lambdas having different symbols will no longer compare
        equal and should be compared like a.dummy_eq(b) (#19261 by @smichr)

  * simplify

      + Fixed sqrtdenest giving wrong results for some forms of sqrt(a + b*sqrt
        (r)) (#19932 by @sylee957)
      + Fixes a bug in collect when collection keys are not independent. (#
        19720 by @mloubout)

      + Improved simplification for sign() (#19596 by @dhruvmendiratta6 and
        @smichr)

      + Improved trigsimp for hyperbolic functions nested in non-trig
        functions. (#19548 by @gschintgen)

      + Fixes a bug in collect when collected symbols appear in the facorized
        expression. (#19431 by @mloubout)

  * solvers

      + Added simplification strategies for simplifying the solutions of
        systems of ODEs (#19998 by @mijo2 and @oscarbenjamin)

      + Fix bug in nonlinsolve leading to key-error (#19189 by @nsfinkelstein
        and @oscarbenjamin)

      + improved functionality for solveset in case of inequalities (#19978 by
        @maurogaravello)

      + Handling of inequalities involving Piecewise is improved in solveset. (
        #19986 by @maurogaravello)

      + Solving higher-order system of ODEs by reducing/transforming it into
        the first-order system of ODEs by numerous methods. (#19838 by @mijo2)

      + Added component division technique to divide the system of ODEs into
        logical sub-systems and solving each of these separately. (#19762 by
        @mijo2)

      + Extending checkodesol and constants_renumber to handle system of ODEs (
        #19733 by @mijo2)

      + Added dsolve_system that can solve a system of ODEs (#19695 by @mijo2)

      + API for the _linear_neq_order1_type1-4 was changed to make it easier
        for anyone to access the solver (#19653 by @mijo2)

      + Solving linear systems particularly involving polynomial coefficients
        is much faster (#18844 by @oscarbenjamin)

      + Added the new n equations linear first-order non-constant coefficient
        non-homogeneous solver where the coefficient matrix of the system of
        ODEs is commutative with its antiderivative. (#19594 by @mijo2)

      + solveset will always use a symbol that has only either the real or
        complex attribute and no other attribute; when a ConditionSet is
        returned, the original symbol for which the solution is being sought
        will be used if it does not cause evaluation of the result. (#19512 by
        @smichr)

      + In dsolve there is no a general solver that can solve systems of
        constant coefficient non-homogeneous first order ODEs of any size in
        terms of integrals. (#19341 by @mijo2)

      + Fixed exception handling in solveset's secondary trigonometric solver.
        (#19566 by @gschintgen)

      + equations with an additive generator are now solved more quickly (#
        19524 by @smichr)

      + Improved solveset capabilities for solving trigonometric equations,
        notably rational and symbolic coefficients are now supported. (#19507
        by @gschintgen)

      + solve_linear_system is now a thin wrapper for linsolve. It is
        recommended to use linsolve in new code. solve_linear_system maybe
        deprecated or removed in future. (#18814 by @oscarbenjamin)

      + Addition of a solver that handles a subclass of linear first order
        non-constant coefficient homogeneous systems of ODEs with any number of
        equations. (#19185 by @mijo2)

  * stats

      + The state space of ContinuousMarkovChain is now by default a Range
        object instead of S.Reals. (#20150 by @czgdp1807 and @naveensaigit)

      + The generator matrix of ContinuousMarkovChain is now by default a
        MatrixSymbol object instead of None. (#20150 by @czgdp1807 and
        @naveensaigit)

      + RandomMatrixSymbol.doit will be invariant upon call. (#20136 by
        @sylee957)
      + The state space of DiscreteMarkovChain is now by default a Range object
        instead of S.Reals. (#20042 by @Maelstrom6)

      + The transition probability matrix of DiscreteMarkovChain is now by
        default a MatrixSymbol object instead of None. (#20042 by @Maelstrom6)

      + Fixed xreplace infinitely expanding random matrix ensemble classes. (#
        20018 by @sylee957)

      + All the ensemble classes (RandomMatrixEnsemble, GaussianEnsemble,
        GaussianOrthogonalEnsemble, ...) now becomes stub function
        constructors. If you want to use them as classes, you should import
        them as RandomMatrixEnsembleModel, GaussianEnsembleModel, ... (#20018
        by @sylee957)

      + Added sampling of Joint RVs from external libraries (#19848 by
        @Smit-create)

      + Added sampling for Matrix Distributions (#19857 by @Smit-create)

      + Allowing CompoundDistribution to handle more than one random variables
        (#19808 by @Smit-create)

      + Added Wishart and MatrixNormal Distributions (#19795 by @Smit-create)

      + Change in return type of P and E with evaluate=False. With evaluate=
        False, P and E are made to return Probability and Expectation object
        respectively. (#19819 by @Smit-create)

      + Added MatrixGamma Distribution (#19734 by @Smit-create)

      + Added symbolic classes of Moment and CentralMoment (#19724 by
        @Smit-create)

      + Added support for Compound Distributions (#19648 by @Smit-create)

      + Added doit in class Probability (#19696 by @Smit-create)

      + Added MutlivariateNormal and MutlivariateLaplace function (#19631 by
        @Smit-create)

      + Added Poisson, Wiener and Gamma Processes (#19387 by @Smit-create)

      + Added Expectation Matrix, Variance Matrix and CrossCovariance Matrix (#
        19529 by @Smit-create)

      + Added sample_stochastic for sampling from stochastic processes. (#19500
        by @Smit-create)

      + FIxes free_symbols method of RandomIndexedSymbol (#19459 by
        @Smit-create)

      + Added Sampling from external libraries for all the random variables of
        sympy (#19342 by @Smit-create)

      + Added doit method in Expectation and made E to call Expectation (#19290
        by @Smit-create)

      + Added is_random in sympy.stats.rv to check if expression contains
        random variables (#19304 by @Smit-create)

      + expand added in sympy.stats.symbolic_rv API. (#19295 by @Smit-create)

      + Added Lomax and Bounded pareto distribution (#19273 by @Smit-create)

      + Added sampling methods for continuous variables (#18754 by @Smit-create
        )

      + Added library option in sample (#18754 by @Smit-create)

      + sample returns an iterator object since version 1.7 (#18754 by
        @Smit-create)

  * tensor

      + Adding ArrayDerivative class as subclass of Derivative. This new
        handles derivatives involving non-scalar expressions. (#20072 by
        @Upabjojr)
  * utilities

      + sympy.utilities.iterables.partitions() no longer reuses the same
        dictionary for each yielded output. (#20154 by @asmeurer)
      + Add support for Integral with lambdify (using scipy or mpmath) (#20134
        by @ehren)

      + Lambdifying an expression with loggamma using mpmath no longer raises
        ImportError. (#19913 by @abhaydhiman)

      + find_executable is deprecated in favor of the builtin shutil.which. (#
        19634 by @eric-wieser)

  * vector

      + integral of parametric region depends on the order of limits at the
        time of initialization. (#20044 by @friyaz)

      + vector_integrate can integrate over ImplicitRegion objects. (#19883 by
        @friyaz)

      + Added a function to find a rational point on conic (#19807 by @friyaz
        and @Upabjojr)

      + Added support to create implictly defined regions. (#19681 by @friyaz)

      + Added support to integrate scalar/vector fields over objects of
        geometry module. (#19650 by @friyaz)

      + added class to represent integral of scalar/vector field over a
        parametric surface. (#19539 by @friyaz)

      + Modified API of ParametricIntegral class (#19580 by @friyaz)

      + Added class to represent a parametric region in space. (#19472 by
        @friyaz)

  * other

      + The LaTeX docs now need to built with xelatex rather than pdflatex. (#
        20309 by @oscarbenjamin)
      + Support for Python 3.5 has been dropped. SymPy now requires Python 3.6
        or newer. (#20145 by @oscarbenjamin)

      + more function raise TypeError when passed invalid keyword-arguments,
        rather than ignoring them silently (#20086 by @eric-wieser)

      + assert sympy.testing.pytest.raises(Exception, func) no longer always
        asserts when pytest is not present (#20012 by @eric-wieser)
      + Make SymPy do less at import time so that import sympy is faster. (#
        19910 by @asmeurer)
      + Improve code quality by cleaning the doctests up (#19406 by
        @InCogNiTo124 and @oscarbenjamin)

      + intersphinx links to :mod:`sympy` no longer point to the documentation
        for Immutable Matrices (#19430 by @eric-wieser)

(ryoon)