zstd: update to 1.5.0. v1.5.0 (May 11, 2021) api: Various functions promoted from experimental to stable API: (#2579-2581, @senhuang42) `ZSTD_defaultCLevel()` `ZSTD_getDictID_fromCDict()` api: Several experimental functions have been deprecated and will emit a compiler warning (#2582, @senhuang42) `ZSTD_compress_advanced()` `ZSTD_compress_usingCDict_advanced()` `ZSTD_compressBegin_advanced()` `ZSTD_compressBegin_usingCDict_advanced()` `ZSTD_initCStream_srcSize()` `ZSTD_initCStream_usingDict()` `ZSTD_initCStream_usingCDict()` `ZSTD_initCStream_advanced()` `ZSTD_initCStream_usingCDict_advanced()` `ZSTD_resetCStream()` api: ZSTDMT_NBWORKERS_MAX reduced to 64 for 32-bit environments (@Cyan4973) perf: Significant speed improvements for middle compression levels (#2494, @senhuang42 @terrelln) perf: Block splitter to improve compression ratio, enabled by default for high compression levels (#2447, @senhuang42) perf: Decompression loop refactor, speed improvements on `clang` and for `--long` modes (#2614 #2630, @Cyan4973) perf: Reduced stack usage during compression and decompression entropy stage (#2522 #2524, @terrelln) bug: Improve setting permissions of created files (#2525, @felixhandte) bug: Fix large dictionary non-determinism (#2607, @terrelln) bug: Fix non-determinism test failures on Linux i686 (#2606, @terrelln) bug: Fix various dedicated dictionary search bugs (#2540 #2586, @senhuang42 @felixhandte) bug: Ensure `ZSTD_estimateCCtxSize*() `monotonically increases with compression level (#2538, @senhuang42) bug: Fix --patch-from mode parameter bound bug with small files (#2637, @occivink) bug: Fix UBSAN error in decompression (#2625, @terrelln) bug: Fix superblock compression divide by zero bug (#2592, @senhuang42) bug: Make the number of physical CPU cores detection more robust (#2517, @PaulBone) doc: Improve `zdict.h` dictionary training API documentation (#2622, @terrelln) doc: Note that public `ZSTD_free*()` functions accept NULL pointers (#2521, @animalize) doc: Add style guide docs for open source contributors (#2626, @Cyan4973) tests: Better regression test coverage for different dictionary modes (#2559, @senhuang42) tests: Better test coverage of index reduction (#2603, @terrelln) tests: OSS-Fuzz coverage for seekable format (#2617, @senhuang42) tests: Test coverage for ZSTD threadpool API (#2604, @senhuang42) build: Dynamic library built multithreaded by default (#2584, @senhuang42) build: Move `zstd_errors.h` and `zdict.h` to `lib/` root (#2597, @terrelln) build: Allow `ZSTDMT_JOBSIZE_MIN` to be configured at compile-time, reduce default to 512KB (#2611, @Cyan4973) build: Single file library build script moved to `build/` directory (#2618, @felixhandte) build: `ZBUFF_*()` is no longer built by default (#2583, @senhuang42) build: Fixed Meson build (#2548, @SupervisedThinking @kloczek) build: Fix excessive compiler warnings with clang-cl and CMake (#2600, @nickhutchinson) build: Detect presence of `md5` on Darwin (#2609, @felixhandte) build: Avoid SIGBUS on armv6 (#2633, @bmwiedmann) cli: `--progress` flag added to always display progress bar (#2595, @senhuang42) cli: Allow reading from block devices with `--force` (#2613, @felixhandte) cli: Fix CLI filesize display bug (#2550, @Cyan4973) cli: Fix windows CLI `--filelist` end-of-line bug (#2620, @Cyan4973) contrib: Various fixes for linux kernel patch (#2539, @terrelln) contrib: Seekable format - Decompression hanging edge case fix (#2516, @senhuang42) contrib: Seekable format - New seek table-only API (#2113 #2518, @mdittmer @Cyan4973) contrib: Seekable format - Fix seek table descriptor check when loading (#2534, @foxeng) contrib: Seekable format - Decompression fix for large offsets, (#2594, @azat) misc: Automatically published release tarballs available on Github (#2535, @felixhandte)diff -r1.40 -r1.41 pkgsrc/archivers/zstd/Makefile
(wiz)
@@ -1,16 +1,16 @@ | @@ -1,16 +1,16 @@ | |||
1 | # $NetBSD: Makefile,v 1.40 2021/04/05 10:12:38 ryoon Exp $ | 1 | # $NetBSD: Makefile,v 1.41 2021/05/20 12:23:24 wiz Exp $ | |
2 | 2 | |||
3 | DISTNAME= zstd-1.4.9 | 3 | DISTNAME= zstd-1.5.0 | |
4 | CATEGORIES= archivers | 4 | CATEGORIES= archivers | |
5 | MASTER_SITES= ${MASTER_SITE_GITHUB:=facebook/} | 5 | MASTER_SITES= ${MASTER_SITE_GITHUB:=facebook/} | |
6 | GITHUB_TAG= v${PKGVERSION_NOREV} | 6 | GITHUB_TAG= v${PKGVERSION_NOREV} | |
7 | 7 | |||
8 | MAINTAINER= pkgsrc-users@NetBSD.org | 8 | MAINTAINER= pkgsrc-users@NetBSD.org | |
9 | HOMEPAGE= https://facebook.github.io/zstd/ | 9 | HOMEPAGE= https://facebook.github.io/zstd/ | |
10 | COMMENT= Fast real-time compression algorithm | 10 | COMMENT= Fast real-time compression algorithm | |
11 | LICENSE= modified-bsd OR gnu-gpl-v2 | 11 | LICENSE= modified-bsd OR gnu-gpl-v2 | |
12 | 12 | |||
13 | CHECK_PORTABILITY_SKIP+= tests/playTests.sh | 13 | CHECK_PORTABILITY_SKIP+= tests/playTests.sh | |
14 | 14 | |||
15 | # 1.4.8 | 15 | # 1.4.8 | |
16 | # ld: ../lib/libzstd.a: error adding symbols: no more archived files | 16 | # ld: ../lib/libzstd.a: error adding symbols: no more archived files |
@@ -1,11 +1,11 @@ | @@ -1,11 +1,11 @@ | |||
1 | $NetBSD: distinfo,v 1.28 2021/04/05 10:12:38 ryoon Exp $ | 1 | $NetBSD: distinfo,v 1.29 2021/05/20 12:23:24 wiz Exp $ | |
2 | 2 | |||
3 | SHA1 (zstd-1.4.9.tar.gz) = 28f82bf3e258c7eeacfa105d0af354140d0df059 | 3 | SHA1 (zstd-1.5.0.tar.gz) = 3299248fcd44d7f21ba2f1f198c1173eeb3c4f32 | |
4 | RMD160 (zstd-1.4.9.tar.gz) = c6fc59c14f83439d1ef0ab8255d370172ae5dae5 | 4 | RMD160 (zstd-1.5.0.tar.gz) = c636d4cb4113bd56e3deade6778e08c73a06937e | |
5 | SHA512 (zstd-1.4.9.tar.gz) = f529db9c094f9ae26428bf1fdfcc91c6d783d400980e0f0d802d2cf13c2be2931465ef568907e03841ff76a369a1447e7371f8799d8526edb9a513ba5c6db133 | 5 | SHA512 (zstd-1.5.0.tar.gz) = 25b657529a698eec891f92ff4a085d1fd95d2ff938ce52c8a4ff6163eb0b668ec642dd09e0db190652638cd92371006afa01d8e437437762c4097ad301675c33 | |
6 | Size (zstd-1.4.9.tar.gz) = 1834843 bytes | 6 | Size (zstd-1.5.0.tar.gz) = 1867111 bytes | |
7 | SHA1 (patch-Makefile) = e1e702cd3b461d432e25909fdcf01cc51c769a8a | 7 | SHA1 (patch-Makefile) = b7e72910488e946971cde5ad2fac6a6134dbd70b | |
8 | SHA1 (patch-lib_Makefile) = 1f1497becc67d59069875460b8d0dd049f23037f | 8 | SHA1 (patch-lib_Makefile) = 2475241f1f75d353bf6deeccb4f391cd6626aed2 | |
9 | SHA1 (patch-tests_Makefile) = b83de10222859d656468463071dbce70adcc22b1 | 9 | SHA1 (patch-tests_Makefile) = b83de10222859d656468463071dbce70adcc22b1 | |
10 | SHA1 (patch-tests_playTests.sh) = 349f8e400f46b5914add4aee955a040045f62779 | 10 | SHA1 (patch-tests_playTests.sh) = 349f8e400f46b5914add4aee955a040045f62779 | |
11 | SHA1 (patch-zlibWrapper_examples_minigzip.c) = 4ed0cb648bdd6efa61b3f66ba6eb1ea74b7767ec | 11 | SHA1 (patch-zlibWrapper_examples_minigzip.c) = 4ed0cb648bdd6efa61b3f66ba6eb1ea74b7767ec |
@@ -1,22 +1,22 @@ | @@ -1,22 +1,22 @@ | |||
1 | $NetBSD: patch-Makefile,v 1.9 2021/01/03 14:55:50 adam Exp $ | 1 | $NetBSD: patch-Makefile,v 1.10 2021/05/20 12:23:24 wiz Exp $ | |
2 | 2 | |||
3 | Enable the "install" target on all OS. | 3 | Enable the "install" target on all OS. | |
4 | 4 | |||
5 | --- Makefile.orig 2020-12-19 00:39:42.000000000 +0000 | 5 | --- Makefile.orig 2021-05-14 14:59:34.000000000 +0000 | |
6 | +++ Makefile | 6 | +++ Makefile | |
7 | @@ -149,7 +149,6 @@ clean: | 7 | @@ -148,7 +148,6 @@ clean: | |
8 | #------------------------------------------------------------------------------ | 8 | #------------------------------------------------------------------------------ | |
9 | # make install is validated only for Linux, macOS, Hurd and some BSD targets | 9 | # make install is validated only for Linux, macOS, Hurd and some BSD targets | |
10 | #------------------------------------------------------------------------------ | 10 | #------------------------------------------------------------------------------ | |
11 | -ifneq (,$(filter $(shell uname),Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD DragonFly NetBSD MSYS_NT Haiku)) | 11 | -ifneq (,$(filter $(shell uname),Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD DragonFly NetBSD MSYS_NT Haiku)) | |
12 | 12 | |||
13 | HOST_OS = POSIX | 13 | HOST_OS = POSIX | |
14 | CMAKE_PARAMS = -DZSTD_BUILD_CONTRIB:BOOL=ON -DZSTD_BUILD_STATIC:BOOL=ON -DZSTD_BUILD_TESTS:BOOL=ON -DZSTD_ZLIB_SUPPORT:BOOL=ON -DZSTD_LZMA_SUPPORT:BOOL=ON -DCMAKE_BUILD_TYPE=Release | 14 | ||
15 | @@ -356,7 +355,6 @@ clang38install: | 15 | @@ -354,7 +353,6 @@ clang38install: | |
16 | lz4install: | 16 | lz4install: | |
17 | [ -e lz4 ] || git clone https://github.com/lz4/lz4 && sudo $(MAKE) -C lz4 install | 17 | [ -e lz4 ] || git clone https://github.com/lz4/lz4 && sudo $(MAKE) -C lz4 install | |
18 | 18 | |||
19 | -endif | 19 | -endif | |
20 | 20 | |||
21 | 21 | |||
22 | ifneq (,$(filter MSYS%,$(shell uname))) | 22 | CMAKE_PARAMS = -DZSTD_BUILD_CONTRIB:BOOL=ON -DZSTD_BUILD_STATIC:BOOL=ON -DZSTD_BUILD_TESTS:BOOL=ON -DZSTD_ZLIB_SUPPORT:BOOL=ON -DZSTD_LZMA_SUPPORT:BOOL=ON -DCMAKE_BUILD_TYPE=Release |
@@ -1,23 +1,23 @@ | @@ -1,23 +1,23 @@ | |||
1 | $NetBSD: patch-lib_Makefile,v 1.12 2021/04/05 10:12:38 ryoon Exp $ | 1 | $NetBSD: patch-lib_Makefile,v 1.13 2021/05/20 12:23:24 wiz Exp $ | |
2 | 2 | |||
3 | Detect and use third-party libraries (taken from programs/Makefile). | 3 | Detect and use third-party libraries (taken from programs/Makefile). | |
4 | -fvisibility=hidden makes error when linking. | 4 | -fvisibility=hidden makes error when linking. | |
5 | Enable the "install" target on all OS. | 5 | Enable the "install" target on all OS. | |
6 | Fix pkgconfig installation path. | 6 | Fix pkgconfig installation path. | |
7 | 7 | |||
8 | --- lib/Makefile.orig 2021-03-02 22:20:57.000000000 +0000 | 8 | --- lib/Makefile.orig 2021-05-14 14:59:34.000000000 +0000 | |
9 | +++ lib/Makefile | 9 | +++ lib/Makefile | |
10 | @@ -195,6 +195,43 @@ endif | 10 | @@ -204,6 +204,43 @@ endif | |
11 | endif # BUILD_DIR | 11 | endif # BUILD_DIR | |
12 | 12 | |||
13 | 13 | |||
14 | +VOID = /dev/null | 14 | +VOID = /dev/null | |
15 | + | 15 | + | |
16 | +# Make 4.3 doesn't support '\#' anymore (https://lwn.net/Articles/810071/) | 16 | +# Make 4.3 doesn't support '\#' anymore (https://lwn.net/Articles/810071/) | |
17 | +NUM_SYMBOL := \# | 17 | +NUM_SYMBOL := \# | |
18 | + | 18 | + | |
19 | +# thread detection | 19 | +# thread detection | |
20 | +HAVE_PTHREAD := $(shell printf '$(NUM_SYMBOL)include <pthread.h>\nint main(void) { return 0; }' | $(CC) $(FLAGS) -o have_pthread$(EXT) -x c - -pthread 2> $(VOID) && rm have_pthread$(EXT) && echo 1 || echo 0) | 20 | +HAVE_PTHREAD := $(shell printf '$(NUM_SYMBOL)include <pthread.h>\nint main(void) { return 0; }' | $(CC) $(FLAGS) -o have_pthread$(EXT) -x c - -pthread 2> $(VOID) && rm have_pthread$(EXT) && echo 1 || echo 0) | |
21 | +HAVE_THREAD := $(shell [ "$(HAVE_PTHREAD)" -eq "1" -o -n "$(filter Windows%,$(OS))" ] && echo 1 || echo 0) | 21 | +HAVE_THREAD := $(shell [ "$(HAVE_PTHREAD)" -eq "1" -o -n "$(filter Windows%,$(OS))" ] && echo 1 || echo 0) | |
22 | +ifeq ($(HAVE_THREAD), 1) | 22 | +ifeq ($(HAVE_THREAD), 1) | |
23 | +THREAD_MSG := ==> building with threading support | 23 | +THREAD_MSG := ==> building with threading support | |
@@ -41,48 +41,38 @@ Fix pkgconfig installation path. | @@ -41,48 +41,38 @@ Fix pkgconfig installation path. | |||
41 | +endif | 41 | +endif | |
42 | + | 42 | + | |
43 | +# lz4 detection | 43 | +# lz4 detection | |
44 | +HAVE_LZ4 := $(shell printf '$(NUM_SYMBOL)include <lz4frame.h>\n$(NUM_SYMBOL)include <lz4.h>\nint main(void) { return 0; }' | $(CC) $(FLAGS) -o have_lz4$(EXT) -x c - -llz4 2> $(VOID) && rm have_lz4$(EXT) && echo 1 || echo 0) | 44 | +HAVE_LZ4 := $(shell printf '$(NUM_SYMBOL)include <lz4frame.h>\n$(NUM_SYMBOL)include <lz4.h>\nint main(void) { return 0; }' | $(CC) $(FLAGS) -o have_lz4$(EXT) -x c - -llz4 2> $(VOID) && rm have_lz4$(EXT) && echo 1 || echo 0) | |
45 | +ifeq ($(HAVE_LZ4), 1) | 45 | +ifeq ($(HAVE_LZ4), 1) | |
46 | +LZ4CPP = -DZSTD_LZ4COMPRESS -DZSTD_LZ4DECOMPRESS | 46 | +LZ4CPP = -DZSTD_LZ4COMPRESS -DZSTD_LZ4DECOMPRESS | |
47 | +LZ4LD = -llz4 | 47 | +LZ4LD = -llz4 | |
48 | +endif | 48 | +endif | |
49 | + | 49 | + | |
50 | + | 50 | + | |
51 | # macOS linker doesn't support -soname, and use different extension | 51 | # macOS linker doesn't support -soname, and use different extension | |
52 | # see : https://developer.apple.com/library/mac/documentation/DeveloperTools/Conceptual/DynamicLibraries/100-Articles/DynamicLibraryDesignGuidelines.html | 52 | # see : https://developer.apple.com/library/mac/documentation/DeveloperTools/Conceptual/DynamicLibraries/100-Articles/DynamicLibraryDesignGuidelines.html | |
53 | ifeq ($(UNAME), Darwin) | 53 | ifeq ($(UNAME), Darwin) | |
54 | @@ -258,7 +295,8 @@ else # not Windows | 54 | @@ -374,7 +411,6 @@ clean: | |
55 | LIBZSTD = libzstd.$(SHARED_EXT_VER) | |||
56 | .PHONY: $(LIBZSTD) # must be run every time | |||
57 | $(LIBZSTD): CFLAGS += -fPIC -fvisibility=hidden | |||
58 | -$(LIBZSTD): LDFLAGS += -shared | |||
59 | +$(LIBZSTD): CPPFLAGS += $(THREAD_CPP) $(ZLIBCPP) $(LZMACPP) $(LZ4CPP) | |||
60 | +$(LIBZSTD): LDFLAGS += -shared $(THREAD_LD) $(ZLIBLD) $(LZMALD) $(LZ4LD) | |||
61 | ||||
62 | ifndef BUILD_DIR | |||
63 | # determine BUILD_DIR from compilation flags | |||
64 | @@ -349,7 +387,6 @@ clean: | |||
65 | #----------------------------------------------------------------------------- | 55 | #----------------------------------------------------------------------------- | |
66 | # make install is validated only for below listed environments | 56 | # make install is validated only for below listed environments | |
67 | #----------------------------------------------------------------------------- | 57 | #----------------------------------------------------------------------------- | |
68 | -ifneq (,$(filter $(UNAME),Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD NetBSD DragonFly SunOS Haiku)) | 58 | -ifneq (,$(filter $(UNAME),Linux Darwin GNU/kFreeBSD GNU OpenBSD FreeBSD NetBSD DragonFly SunOS Haiku)) | |
69 | 59 | |||
70 | all: libzstd.pc | 60 | all: libzstd.pc | |
71 | 61 | |||
72 | @@ -380,11 +417,7 @@ PCLIBPREFIX := $(if $(findstring $(LIBDI | 62 | @@ -405,11 +441,7 @@ PCLIBPREFIX := $(if $(findstring $(LIBDI | |
73 | # to PREFIX, rather than as a resolved value. | 63 | # to PREFIX, rather than as a resolved value. | |
74 | PCEXEC_PREFIX := $(if $(HAS_EXPLICIT_EXEC_PREFIX),$(EXEC_PREFIX),$${prefix}) | 64 | PCEXEC_PREFIX := $(if $(HAS_EXPLICIT_EXEC_PREFIX),$(EXEC_PREFIX),$${prefix}) | |
75 | 65 | |||
76 | -ifneq (,$(filter $(UNAME),FreeBSD NetBSD DragonFly)) | 66 | -ifneq (,$(filter $(UNAME),FreeBSD NetBSD DragonFly)) | |
77 | - PKGCONFIGDIR ?= $(PREFIX)/libdata/pkgconfig | 67 | - PKGCONFIGDIR ?= $(PREFIX)/libdata/pkgconfig | |
78 | -else | 68 | -else | |
79 | PKGCONFIGDIR ?= $(LIBDIR)/pkgconfig | 69 | PKGCONFIGDIR ?= $(LIBDIR)/pkgconfig | |
80 | -endif | 70 | -endif | |
81 | 71 | |||
82 | ifneq (,$(filter $(UNAME),SunOS)) | 72 | ifneq (,$(filter $(UNAME),SunOS)) | |
83 | INSTALL ?= ginstall | 73 | INSTALL ?= ginstall | |
84 | @@ -450,4 +483,3 @@ uninstall: | 74 | @@ -479,4 +511,3 @@ uninstall: | |
85 | $(RM) $(DESTDIR)$(INCLUDEDIR)/zdict.h | 75 | $(RM) $(DESTDIR)$(INCLUDEDIR)/zdict.h | |
86 | @echo zstd libraries successfully uninstalled | 76 | @echo zstd libraries successfully uninstalled | |
87 | 77 | |||
88 | -endif | 78 | -endif |