Thu May 20 12:23:24 2021 UTC ()
zstd: update to 1.5.0.

v1.5.0  (May 11, 2021)
api: Various functions promoted from experimental to stable API: (#2579-2581, @senhuang42)
  `ZSTD_defaultCLevel()`
  `ZSTD_getDictID_fromCDict()`
api: Several experimental functions have been deprecated and will emit a compiler warning (#2582, @senhuang42)
  `ZSTD_compress_advanced()`
  `ZSTD_compress_usingCDict_advanced()`
  `ZSTD_compressBegin_advanced()`
  `ZSTD_compressBegin_usingCDict_advanced()`
  `ZSTD_initCStream_srcSize()`
  `ZSTD_initCStream_usingDict()`
  `ZSTD_initCStream_usingCDict()`
  `ZSTD_initCStream_advanced()`
  `ZSTD_initCStream_usingCDict_advanced()`
  `ZSTD_resetCStream()`
api: ZSTDMT_NBWORKERS_MAX reduced to 64 for 32-bit environments (@Cyan4973)
perf: Significant speed improvements for middle compression levels (#2494, @senhuang42 @terrelln)
perf: Block splitter to improve compression ratio, enabled by default for high compression levels (#2447, @senhuang42)
perf: Decompression loop refactor, speed improvements on `clang` and for `--long` modes (#2614 #2630, @Cyan4973)
perf: Reduced stack usage during compression and decompression entropy stage (#2522 #2524, @terrelln)
bug: Improve setting permissions of created files (#2525, @felixhandte)
bug: Fix large dictionary non-determinism (#2607, @terrelln)
bug: Fix non-determinism test failures on Linux i686 (#2606, @terrelln)
bug: Fix various dedicated dictionary search bugs (#2540 #2586, @senhuang42 @felixhandte)
bug: Ensure `ZSTD_estimateCCtxSize*() `monotonically increases with compression level (#2538, @senhuang42)
bug: Fix --patch-from mode parameter bound bug with small files (#2637, @occivink)
bug: Fix UBSAN error in decompression (#2625, @terrelln)
bug: Fix superblock compression divide by zero bug (#2592, @senhuang42)
bug: Make the number of physical CPU cores detection more robust (#2517, @PaulBone)
doc: Improve `zdict.h` dictionary training API documentation (#2622, @terrelln)
doc: Note that public `ZSTD_free*()` functions accept NULL pointers (#2521, @animalize)
doc: Add style guide docs for open source contributors (#2626, @Cyan4973)
tests: Better regression test coverage for different dictionary modes (#2559, @senhuang42)
tests: Better test coverage of index reduction (#2603, @terrelln)
tests: OSS-Fuzz coverage for seekable format (#2617, @senhuang42)
tests: Test coverage for ZSTD threadpool API (#2604, @senhuang42)
build: Dynamic library built multithreaded by default (#2584, @senhuang42)
build: Move  `zstd_errors.h`  and  `zdict.h`  to  `lib/`  root (#2597, @terrelln)
build: Allow `ZSTDMT_JOBSIZE_MIN` to be configured at compile-time, reduce default to 512KB (#2611, @Cyan4973)
build: Single file library build script moved to `build/` directory (#2618, @felixhandte)
build: `ZBUFF_*()` is no longer built by default (#2583, @senhuang42)
build: Fixed Meson build (#2548, @SupervisedThinking @kloczek)
build: Fix excessive compiler warnings with clang-cl and CMake (#2600, @nickhutchinson)
build: Detect presence of `md5` on Darwin (#2609, @felixhandte)
build: Avoid SIGBUS on armv6 (#2633, @bmwiedmann)
cli: `--progress` flag added to always display progress bar (#2595, @senhuang42)
cli: Allow reading from block devices with `--force` (#2613, @felixhandte)
cli: Fix CLI filesize display bug (#2550, @Cyan4973)
cli: Fix windows CLI `--filelist` end-of-line bug (#2620, @Cyan4973)
contrib: Various fixes for linux kernel patch (#2539, @terrelln)
contrib: Seekable format - Decompression hanging edge case fix (#2516, @senhuang42)
contrib: Seekable format - New seek table-only API  (#2113 #2518, @mdittmer @Cyan4973)
contrib: Seekable format - Fix seek table descriptor check when loading (#2534, @foxeng)
contrib: Seekable format - Decompression fix for large offsets, (#2594, @azat)
misc: Automatically published release tarballs available on Github (#2535, @felixhandte)


(wiz)
diff -r1.40 -r1.41 pkgsrc/archivers/zstd/Makefile
diff -r1.28 -r1.29 pkgsrc/archivers/zstd/distinfo
diff -r1.9 -r1.10 pkgsrc/archivers/zstd/patches/patch-Makefile
diff -r1.12 -r1.13 pkgsrc/archivers/zstd/patches/patch-lib_Makefile

cvs diff -r1.40 -r1.41 pkgsrc/archivers/zstd/Makefile (expand / switch to unified diff)

--- pkgsrc/archivers/zstd/Makefile 2021/04/05 10:12:38 1.40
+++ pkgsrc/archivers/zstd/Makefile 2021/05/20 12:23:24 1.41
@@ -1,16 +1,16 @@ @@ -1,16 +1,16 @@
1# $NetBSD: Makefile,v 1.40 2021/04/05 10:12:38 ryoon Exp $ 1# $NetBSD: Makefile,v 1.41 2021/05/20 12:23:24 wiz Exp $
2 2
3DISTNAME= zstd-1.4.9 3DISTNAME= zstd-1.5.0
4CATEGORIES= archivers 4CATEGORIES= archivers
5MASTER_SITES= ${MASTER_SITE_GITHUB:=facebook/} 5MASTER_SITES= ${MASTER_SITE_GITHUB:=facebook/}
6GITHUB_TAG= v${PKGVERSION_NOREV} 6GITHUB_TAG= v${PKGVERSION_NOREV}
7 7
8MAINTAINER= pkgsrc-users@NetBSD.org 8MAINTAINER= pkgsrc-users@NetBSD.org
9HOMEPAGE= https://facebook.github.io/zstd/ 9HOMEPAGE= https://facebook.github.io/zstd/
10COMMENT= Fast real-time compression algorithm 10COMMENT= Fast real-time compression algorithm
11LICENSE= modified-bsd OR gnu-gpl-v2 11LICENSE= modified-bsd OR gnu-gpl-v2
12 12
13CHECK_PORTABILITY_SKIP+= tests/playTests.sh 13CHECK_PORTABILITY_SKIP+= tests/playTests.sh
14 14
15# 1.4.8 15# 1.4.8
16# ld: ../lib/libzstd.a: error adding symbols: no more archived files 16# ld: ../lib/libzstd.a: error adding symbols: no more archived files

cvs diff -r1.28 -r1.29 pkgsrc/archivers/zstd/distinfo (expand / switch to unified diff)

--- pkgsrc/archivers/zstd/distinfo 2021/04/05 10:12:38 1.28
+++ pkgsrc/archivers/zstd/distinfo 2021/05/20 12:23:24 1.29
@@ -1,11 +1,11 @@ @@ -1,11 +1,11 @@
1$NetBSD: distinfo,v 1.28 2021/04/05 10:12:38 ryoon Exp $ 1$NetBSD: distinfo,v 1.29 2021/05/20 12:23:24 wiz Exp $
2 2
3SHA1 (zstd-1.4.9.tar.gz) = 28f82bf3e258c7eeacfa105d0af354140d0df059 3SHA1 (zstd-1.5.0.tar.gz) = 3299248fcd44d7f21ba2f1f198c1173eeb3c4f32
4RMD160 (zstd-1.4.9.tar.gz) = c6fc59c14f83439d1ef0ab8255d370172ae5dae5 4RMD160 (zstd-1.5.0.tar.gz) = c636d4cb4113bd56e3deade6778e08c73a06937e
5SHA512 (zstd-1.4.9.tar.gz) = f529db9c094f9ae26428bf1fdfcc91c6d783d400980e0f0d802d2cf13c2be2931465ef568907e03841ff76a369a1447e7371f8799d8526edb9a513ba5c6db133 5SHA512 (zstd-1.5.0.tar.gz) = 25b657529a698eec891f92ff4a085d1fd95d2ff938ce52c8a4ff6163eb0b668ec642dd09e0db190652638cd92371006afa01d8e437437762c4097ad301675c33
6Size (zstd-1.4.9.tar.gz) = 1834843 bytes 6Size (zstd-1.5.0.tar.gz) = 1867111 bytes
7SHA1 (patch-Makefile) = e1e702cd3b461d432e25909fdcf01cc51c769a8a 7SHA1 (patch-Makefile) = b7e72910488e946971cde5ad2fac6a6134dbd70b
8SHA1 (patch-lib_Makefile) = 1f1497becc67d59069875460b8d0dd049f23037f 8SHA1 (patch-lib_Makefile) = 2475241f1f75d353bf6deeccb4f391cd6626aed2
9SHA1 (patch-tests_Makefile) = b83de10222859d656468463071dbce70adcc22b1 9SHA1 (patch-tests_Makefile) = b83de10222859d656468463071dbce70adcc22b1
10SHA1 (patch-tests_playTests.sh) = 349f8e400f46b5914add4aee955a040045f62779 10SHA1 (patch-tests_playTests.sh) = 349f8e400f46b5914add4aee955a040045f62779
11SHA1 (patch-zlibWrapper_examples_minigzip.c) = 4ed0cb648bdd6efa61b3f66ba6eb1ea74b7767ec 11SHA1 (patch-zlibWrapper_examples_minigzip.c) = 4ed0cb648bdd6efa61b3f66ba6eb1ea74b7767ec

cvs diff -r1.9 -r1.10 pkgsrc/archivers/zstd/patches/patch-Makefile (expand / switch to unified diff)

--- pkgsrc/archivers/zstd/patches/patch-Makefile 2021/01/03 14:55:50 1.9
+++ pkgsrc/archivers/zstd/patches/patch-Makefile 2021/05/20 12:23:24 1.10
@@ -1,22 +1,22 @@ @@ -1,22 +1,22 @@
1$NetBSD: patch-Makefile,v 1.9 2021/01/03 14:55:50 adam Exp $ 1$NetBSD: patch-Makefile,v 1.10 2021/05/20 12:23:24 wiz Exp $
2 2
3Enable the "install" target on all OS. 3Enable the "install" target on all OS.
4 4
5--- Makefile.orig 2020-12-19 00:39:42.000000000 +0000 5--- Makefile.orig 2021-05-14 14:59:34.000000000 +0000
6+++ Makefile 6+++ Makefile
7@@ -149,7 +149,6 @@ clean: 7@@ -148,7 +148,6 @@ clean:
8 #------------------------------------------------------------------------------ 8 #------------------------------------------------------------------------------
9 # make install is validated only for Linux, macOS, Hurd and some BSD targets 9 # make install is validated only for Linux, macOS, Hurd and some BSD targets
10 #------------------------------------------------------------------------------ 10 #------------------------------------------------------------------------------
11-ifneq (,$(filter $(shell uname),Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD DragonFly NetBSD MSYS_NT Haiku)) 11-ifneq (,$(filter $(shell uname),Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD DragonFly NetBSD MSYS_NT Haiku))
12  12
13 HOST_OS = POSIX 13 HOST_OS = POSIX
14 CMAKE_PARAMS = -DZSTD_BUILD_CONTRIB:BOOL=ON -DZSTD_BUILD_STATIC:BOOL=ON -DZSTD_BUILD_TESTS:BOOL=ON -DZSTD_ZLIB_SUPPORT:BOOL=ON -DZSTD_LZMA_SUPPORT:BOOL=ON -DCMAKE_BUILD_TYPE=Release 14
15@@ -356,7 +355,6 @@ clang38install: 15@@ -354,7 +353,6 @@ clang38install:
16 lz4install: 16 lz4install:
17 [ -e lz4 ] || git clone https://github.com/lz4/lz4 && sudo $(MAKE) -C lz4 install 17 [ -e lz4 ] || git clone https://github.com/lz4/lz4 && sudo $(MAKE) -C lz4 install
18  18
19-endif 19-endif
20  20
21  21
22 ifneq (,$(filter MSYS%,$(shell uname))) 22 CMAKE_PARAMS = -DZSTD_BUILD_CONTRIB:BOOL=ON -DZSTD_BUILD_STATIC:BOOL=ON -DZSTD_BUILD_TESTS:BOOL=ON -DZSTD_ZLIB_SUPPORT:BOOL=ON -DZSTD_LZMA_SUPPORT:BOOL=ON -DCMAKE_BUILD_TYPE=Release

cvs diff -r1.12 -r1.13 pkgsrc/archivers/zstd/patches/patch-lib_Makefile (expand / switch to unified diff)

--- pkgsrc/archivers/zstd/patches/patch-lib_Makefile 2021/04/05 10:12:38 1.12
+++ pkgsrc/archivers/zstd/patches/patch-lib_Makefile 2021/05/20 12:23:24 1.13
@@ -1,23 +1,23 @@ @@ -1,23 +1,23 @@
1$NetBSD: patch-lib_Makefile,v 1.12 2021/04/05 10:12:38 ryoon Exp $ 1$NetBSD: patch-lib_Makefile,v 1.13 2021/05/20 12:23:24 wiz Exp $
2 2
3Detect and use third-party libraries (taken from programs/Makefile). 3Detect and use third-party libraries (taken from programs/Makefile).
4-fvisibility=hidden makes error when linking. 4-fvisibility=hidden makes error when linking.
5Enable the "install" target on all OS. 5Enable the "install" target on all OS.
6Fix pkgconfig installation path. 6Fix pkgconfig installation path.
7 7
8--- lib/Makefile.orig 2021-03-02 22:20:57.000000000 +0000 8--- lib/Makefile.orig 2021-05-14 14:59:34.000000000 +0000
9+++ lib/Makefile 9+++ lib/Makefile
10@@ -195,6 +195,43 @@ endif 10@@ -204,6 +204,43 @@ endif
11 endif # BUILD_DIR 11 endif # BUILD_DIR
12  12
13  13
14+VOID = /dev/null 14+VOID = /dev/null
15+ 15+
16+# Make 4.3 doesn't support '\#' anymore (https://lwn.net/Articles/810071/) 16+# Make 4.3 doesn't support '\#' anymore (https://lwn.net/Articles/810071/)
17+NUM_SYMBOL := \# 17+NUM_SYMBOL := \#
18+ 18+
19+# thread detection 19+# thread detection
20+HAVE_PTHREAD := $(shell printf '$(NUM_SYMBOL)include <pthread.h>\nint main(void) { return 0; }' | $(CC) $(FLAGS) -o have_pthread$(EXT) -x c - -pthread 2> $(VOID) && rm have_pthread$(EXT) && echo 1 || echo 0) 20+HAVE_PTHREAD := $(shell printf '$(NUM_SYMBOL)include <pthread.h>\nint main(void) { return 0; }' | $(CC) $(FLAGS) -o have_pthread$(EXT) -x c - -pthread 2> $(VOID) && rm have_pthread$(EXT) && echo 1 || echo 0)
21+HAVE_THREAD := $(shell [ "$(HAVE_PTHREAD)" -eq "1" -o -n "$(filter Windows%,$(OS))" ] && echo 1 || echo 0) 21+HAVE_THREAD := $(shell [ "$(HAVE_PTHREAD)" -eq "1" -o -n "$(filter Windows%,$(OS))" ] && echo 1 || echo 0)
22+ifeq ($(HAVE_THREAD), 1) 22+ifeq ($(HAVE_THREAD), 1)
23+THREAD_MSG := ==> building with threading support 23+THREAD_MSG := ==> building with threading support
@@ -41,48 +41,38 @@ Fix pkgconfig installation path. @@ -41,48 +41,38 @@ Fix pkgconfig installation path.
41+endif 41+endif
42+ 42+
43+# lz4 detection 43+# lz4 detection
44+HAVE_LZ4 := $(shell printf '$(NUM_SYMBOL)include <lz4frame.h>\n$(NUM_SYMBOL)include <lz4.h>\nint main(void) { return 0; }' | $(CC) $(FLAGS) -o have_lz4$(EXT) -x c - -llz4 2> $(VOID) && rm have_lz4$(EXT) && echo 1 || echo 0) 44+HAVE_LZ4 := $(shell printf '$(NUM_SYMBOL)include <lz4frame.h>\n$(NUM_SYMBOL)include <lz4.h>\nint main(void) { return 0; }' | $(CC) $(FLAGS) -o have_lz4$(EXT) -x c - -llz4 2> $(VOID) && rm have_lz4$(EXT) && echo 1 || echo 0)
45+ifeq ($(HAVE_LZ4), 1) 45+ifeq ($(HAVE_LZ4), 1)
46+LZ4CPP = -DZSTD_LZ4COMPRESS -DZSTD_LZ4DECOMPRESS 46+LZ4CPP = -DZSTD_LZ4COMPRESS -DZSTD_LZ4DECOMPRESS
47+LZ4LD = -llz4 47+LZ4LD = -llz4
48+endif 48+endif
49+ 49+
50+ 50+
51 # macOS linker doesn't support -soname, and use different extension 51 # macOS linker doesn't support -soname, and use different extension
52 # see : https://developer.apple.com/library/mac/documentation/DeveloperTools/Conceptual/DynamicLibraries/100-Articles/DynamicLibraryDesignGuidelines.html 52 # see : https://developer.apple.com/library/mac/documentation/DeveloperTools/Conceptual/DynamicLibraries/100-Articles/DynamicLibraryDesignGuidelines.html
53 ifeq ($(UNAME), Darwin) 53 ifeq ($(UNAME), Darwin)
54@@ -258,7 +295,8 @@ else # not Windows 54@@ -374,7 +411,6 @@ clean:
55 LIBZSTD = libzstd.$(SHARED_EXT_VER) 
56 .PHONY: $(LIBZSTD) # must be run every time 
57 $(LIBZSTD): CFLAGS += -fPIC -fvisibility=hidden 
58-$(LIBZSTD): LDFLAGS += -shared 
59+$(LIBZSTD): CPPFLAGS += $(THREAD_CPP) $(ZLIBCPP) $(LZMACPP) $(LZ4CPP) 
60+$(LIBZSTD): LDFLAGS += -shared $(THREAD_LD) $(ZLIBLD) $(LZMALD) $(LZ4LD) 
61  
62 ifndef BUILD_DIR 
63 # determine BUILD_DIR from compilation flags 
64@@ -349,7 +387,6 @@ clean: 
65 #----------------------------------------------------------------------------- 55 #-----------------------------------------------------------------------------
66 # make install is validated only for below listed environments 56 # make install is validated only for below listed environments
67 #----------------------------------------------------------------------------- 57 #-----------------------------------------------------------------------------
68-ifneq (,$(filter $(UNAME),Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD NetBSD DragonFly SunOS Haiku)) 58-ifneq (,$(filter $(UNAME),Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD NetBSD DragonFly SunOS Haiku))
69  59
70 all: libzstd.pc 60 all: libzstd.pc
71  61
72@@ -380,11 +417,7 @@ PCLIBPREFIX := $(if $(findstring $(LIBDI 62@@ -405,11 +441,7 @@ PCLIBPREFIX := $(if $(findstring $(LIBDI
73 # to PREFIX, rather than as a resolved value. 63 # to PREFIX, rather than as a resolved value.
74 PCEXEC_PREFIX := $(if $(HAS_EXPLICIT_EXEC_PREFIX),$(EXEC_PREFIX),$${prefix}) 64 PCEXEC_PREFIX := $(if $(HAS_EXPLICIT_EXEC_PREFIX),$(EXEC_PREFIX),$${prefix})
75  65
76-ifneq (,$(filter $(UNAME),FreeBSD NetBSD DragonFly)) 66-ifneq (,$(filter $(UNAME),FreeBSD NetBSD DragonFly))
77- PKGCONFIGDIR ?= $(PREFIX)/libdata/pkgconfig 67- PKGCONFIGDIR ?= $(PREFIX)/libdata/pkgconfig
78-else 68-else
79 PKGCONFIGDIR ?= $(LIBDIR)/pkgconfig 69 PKGCONFIGDIR ?= $(LIBDIR)/pkgconfig
80-endif 70-endif
81  71
82 ifneq (,$(filter $(UNAME),SunOS)) 72 ifneq (,$(filter $(UNAME),SunOS))
83 INSTALL ?= ginstall 73 INSTALL ?= ginstall
84@@ -450,4 +483,3 @@ uninstall: 74@@ -479,4 +511,3 @@ uninstall:
85 $(RM) $(DESTDIR)$(INCLUDEDIR)/zdict.h 75 $(RM) $(DESTDIR)$(INCLUDEDIR)/zdict.h
86 @echo zstd libraries successfully uninstalled 76 @echo zstd libraries successfully uninstalled
87  77
88-endif 78-endif