Wed Feb 7 16:31:34 2018 UTC ()
sysutils/beats: Update to 6.2.0.

==== Breaking changes

Affecting all Beats

- The log format may differ due to logging library changes.
- The default value for pipelining is reduced to 2 to avoid high
  memory in the Logstash beats input.

Auditbeat

- Split the audit.kernel and audit.file metricsets into their own
  modules
  named auditd and file_integrity, respectively. This change requires
  existing users to update their config.
- Renamed file_integrity module fields.
- Renamed auditd module fields.

Metricbeat

- Rename `golang.heap.system.optained` field to
  `golang.heap.system.obtained`.
- De dot keys in jolokia/jmx metricset to prevent collisions.

==== Bugfixes

Auditbeat

- Fixed an issue where the proctitle value was being truncated.
- Fixed an issue where values were incorrectly interpretted as hex
  data.
- Fixed parsing of the `key` value when multiple keys are present.
- Fix possible resource leak if file_integrity module is used with
  config
  reloading on Windows or Linux.

Filebeat

- Fix variable name for `convert_timezone` in the system module.

Metricbeat

- Fix error `datastore '*' not found` in Vsphere module.
- Fix error `NotAuthenticated` in Vsphere module.
- Fix mongodb session consistency mode to allow command execution on
  secondary nodes.
- Fix kubernetes `state_pod` `status.phase` so that the active phase
  is returned instead of `unknown`.
- Fix error collecting network_names in Vsphere module.
- Fix process cgroup memory metrics for memsw, kmem, and kmem_tcp.
- Fix kafka OffsetFetch request missing topic and partition
  parameters.

Packetbeat

- Fix mysql SQL parser to trim `\r` from Windows Server
  `SELECT\r\n\t1`.

==== Added

Affecting all Beats

- Adding a local keystore to allow user to obfuscate password
- Add autodiscover for kubernetes.
- Add Beats metrics reporting to Xpack.
- Update the command line library cobra and add support for zsh
  completion
- Update to Golang 1.9.2
- Moved `ip_port` indexer for `add_kubernetes_metadata` to all beats.
- `ip_port` indexer now index both IP and IP:port pairs.
- Add the ability to write structured logs.
- Use structured logging for the metrics that are periodically logged
  via the
  `logging.metrics` feature.
- Improve Elasticsearch output metrics to count number of dropped and
  duplicate (if event ID is given) events.
- Add the abilility for the add_docker_metadata process to enrich
  based on process ID.
- The `add_docker_metadata` and `add_kubernetes_metadata` processors
  are now GA, instead of Beta.
- Update go-ucfg library to support top level key reference and cyclic
  key reference for the
  keystore

Auditbeat

- Auditbeat is marked as GA, no longer Beta.
- Add support for BLAKE2b hash algorithms to the file integrity
  module.
- Add support for recursive file watches.

Filebeat

- Add Osquery module.
- Add stream filtering when using `docker` prospector.

Metricbeat

- Add ceph osd_df to metricbeat
- Add field network_names of hosts and virtual machines.
- Add experimental system/raid metricset.
- Add a dashboard for the Nginx module.
- Add experimental mongodb/collstats metricset.
- Update the MySQL dashboard to use the Time Series Visual Builder.
- Add experimental uwsgi module.
- Docker and Kubernetes modules are now GA, instead of Beta.
- Support haproxy stats gathering using http (additionaly to tcp
  socket).
- Support to optionally 'de dot' keys in http/json metricset to
  prevent collisions.

Packetbeat

- Configure good defaults for `add_kubernetes_metadata`.


(fhajny)
diff -r1.23 -r1.24 pkgsrc/sysutils/beats/Makefile
diff -r1.20 -r1.21 pkgsrc/sysutils/beats/distinfo

cvs diff -r1.23 -r1.24 pkgsrc/sysutils/beats/Makefile (switch to unified diff)

--- pkgsrc/sysutils/beats/Makefile 2018/01/22 19:54:56 1.23
+++ pkgsrc/sysutils/beats/Makefile 2018/02/07 16:31:34 1.24
@@ -1,63 +1,63 @@ @@ -1,63 +1,63 @@
1# $NetBSD: Makefile,v 1.23 2018/01/22 19:54:56 fhajny Exp $ 1# $NetBSD: Makefile,v 1.24 2018/02/07 16:31:34 fhajny Exp $
2 2
3DISTNAME= beats-6.1.2 3DISTNAME= beats-6.2.0
4CATEGORIES= sysutils 4CATEGORIES= sysutils
5MASTER_SITES= ${MASTER_SITE_GITHUB:=elastic/} 5MASTER_SITES= ${MASTER_SITE_GITHUB:=elastic/}
6GITHUB_PROJECT= beats 6GITHUB_PROJECT= beats
7GITHUB_TAG= v${PKGVERSION_NOREV} 7GITHUB_TAG= v${PKGVERSION_NOREV}
8 8
9MAINTAINER= filip@joyent.com 9MAINTAINER= filip@joyent.com
10HOMEPAGE= https://www.elastic.co/products/beats 10HOMEPAGE= https://www.elastic.co/products/beats
11COMMENT= Data Shippers for Elasticsearch 11COMMENT= Data Shippers for Elasticsearch
12LICENSE= apache-2.0 12LICENSE= apache-2.0
13 13
14EXTRACT_USING= bsdtar 14EXTRACT_USING= bsdtar
15USE_TOOLS+= gmake 15USE_TOOLS+= gmake
16 16
17GO_DIST_BASE= ${PKGBASE}-${GITHUB_TAG:S/v//} 17GO_DIST_BASE= ${PKGBASE}-${GITHUB_TAG:S/v//}
18GO_SRCPATH= github.com/elastic/beats 18GO_SRCPATH= github.com/elastic/beats
19 19
20# Components to build/install 20# Components to build/install
21BEATS= filebeat heartbeat metricbeat packetbeat 21BEATS= filebeat heartbeat metricbeat packetbeat
22 22
23.for beat in ${BEATS} 23.for beat in ${BEATS}
24CHECK_RELRO_SKIP+= bin/${beat} 24CHECK_RELRO_SKIP+= bin/${beat}
25CONF_FILES+= share/examples/beats/${beat}.yml \ 25CONF_FILES+= share/examples/beats/${beat}.yml \
26 ${PKG_SYSCONFDIR}/${beat}.yml 26 ${PKG_SYSCONFDIR}/${beat}.yml
27.endfor 27.endfor
28 28
29BEATS_DIR?= ${VARBASE}/db/beats 29BEATS_DIR?= ${VARBASE}/db/beats
30BEATS_LOGDIR?= ${VARBASE}/log/beats 30BEATS_LOGDIR?= ${VARBASE}/log/beats
31 31
32FILES_SUBST+= BEATS_DIR=${BEATS_DIR} 32FILES_SUBST+= BEATS_DIR=${BEATS_DIR}
33FILES_SUBST+= BEATS_LOGDIR=${BEATS_LOGDIR} 33FILES_SUBST+= BEATS_LOGDIR=${BEATS_LOGDIR}
34 34
35PKG_SYSCONFSUBDIR= beats 35PKG_SYSCONFSUBDIR= beats
36 36
37SMF_INSTANCES+= ${BEATS} 37SMF_INSTANCES+= ${BEATS}
38 38
39OWN_DIRS+= ${BEATS_DIR} ${BEATS_LOGDIR} 39OWN_DIRS+= ${BEATS_DIR} ${BEATS_LOGDIR}
40 40
41MAKE_ENV+= GOPATH=${WRKDIR}:${PREFIX}/gopkg 41MAKE_ENV+= GOPATH=${WRKDIR}:${PREFIX}/gopkg
42MAKE_ENV+= CGO_LDFLAGS="-L${BUILDLINK_PREFIX.libpcap}/lib ${COMPILER_RPATH_FLAG}${BUILDLINK_PREFIX.libpcap}/lib" 42MAKE_ENV+= CGO_LDFLAGS="-L${BUILDLINK_PREFIX.libpcap}/lib ${COMPILER_RPATH_FLAG}${BUILDLINK_PREFIX.libpcap}/lib"
43BUILD_TARGET= # 43BUILD_TARGET= #
44 44
45INSTALLATION_DIRS+= bin share/examples/beats 45INSTALLATION_DIRS+= bin share/examples/beats
46 46
47do-build: 47do-build:
48.for beat in ${BEATS} 48.for beat in ${BEATS}
49 cd ${WRKSRC}/${beat} && ${BUILD_MAKE_CMD} 49 cd ${WRKSRC}/${beat} && ${BUILD_MAKE_CMD}
50.endfor 50.endfor
51 51
52do-install: 52do-install:
53.for beat in ${BEATS} 53.for beat in ${BEATS}
54 ${INSTALL_PROGRAM} ${WRKSRC}/${beat}/${beat} ${DESTDIR}${PREFIX}/bin 54 ${INSTALL_PROGRAM} ${WRKSRC}/${beat}/${beat} ${DESTDIR}${PREFIX}/bin
55 ${INSTALL_DATA} ${WRKSRC}/${beat}/${beat}.reference.yml \ 55 ${INSTALL_DATA} ${WRKSRC}/${beat}/${beat}.reference.yml \
56 ${DESTDIR}${PREFIX}/share/examples/beats 56 ${DESTDIR}${PREFIX}/share/examples/beats
57 ${INSTALL_DATA} ${WRKSRC}/${beat}/${beat}.yml \ 57 ${INSTALL_DATA} ${WRKSRC}/${beat}/${beat}.yml \
58 ${DESTDIR}${PREFIX}/share/examples/beats 58 ${DESTDIR}${PREFIX}/share/examples/beats
59.endfor 59.endfor
60 60
61.include "../../lang/go/go-package.mk" 61.include "../../lang/go/go-package.mk"
62.include "../../net/libpcap/buildlink3.mk" 62.include "../../net/libpcap/buildlink3.mk"
63.include "../../mk/bsd.pkg.mk" 63.include "../../mk/bsd.pkg.mk"

cvs diff -r1.20 -r1.21 pkgsrc/sysutils/beats/distinfo (switch to unified diff)

--- pkgsrc/sysutils/beats/distinfo 2018/01/22 19:54:56 1.20
+++ pkgsrc/sysutils/beats/distinfo 2018/02/07 16:31:34 1.21
@@ -1,7 +1,7 @@ @@ -1,7 +1,7 @@
1$NetBSD: distinfo,v 1.20 2018/01/22 19:54:56 fhajny Exp $ 1$NetBSD: distinfo,v 1.21 2018/02/07 16:31:34 fhajny Exp $
2 2
3SHA1 (beats-6.1.2.tar.gz) = 6d3bdde2c6f6590681acf6d033dadd50a2d16075 3SHA1 (beats-6.2.0.tar.gz) = b24acdc11f2f5b27ed83e98819f17361f1c7b039
4RMD160 (beats-6.1.2.tar.gz) = 5123a4cc74a79688a27a280d599137b6dd7a76ea 4RMD160 (beats-6.2.0.tar.gz) = cbfe68a0156b02b3d41d63f6bad26a50a662cb08
5SHA512 (beats-6.1.2.tar.gz) = deb2fbfcc8cf490d6a6974b966a78ec141ddce2097beb44134405943dfaac27748bb391a6a82e4980fc27d8f9e7fc1ab06e5d0976473357d89099d9d9141a49a 5SHA512 (beats-6.2.0.tar.gz) = bd91b6fbf88eed18685f803edc732601c475bc0e3025f234b71ac1d23c2f1956141a5ea57768807b6a1cfa580763c945a1f576e727849fd1986834276cf21f0e
6Size (beats-6.1.2.tar.gz) = 17375446 bytes 6Size (beats-6.2.0.tar.gz) = 19405883 bytes
7SHA1 (patch-vendor_github.com_tsg_gopacket_pcap_pcap.go) = 2ef13f84cbf2e1da428e7b08625ffa6111ebcdf5 7SHA1 (patch-vendor_github.com_tsg_gopacket_pcap_pcap.go) = 2ef13f84cbf2e1da428e7b08625ffa6111ebcdf5