Tickets #1103 and #1104

(martin)

Pull up following revision(s) (requested by sevan in ticket #1103):

usr.sbin/mtree/create.c: revision 1.76

Adjust test, we only want to return the structure member if the result
is not NULL.

Heads up by Sascha Wildner @ DragonFly BSD.

(martin)

Provide a LWP_PC for Taylor

(skrll)

attach GICv3 ITS where applicable

(jakllsch)

Allow building when plcom isn't used.

(rjs)

include dev/pci/pcivar.h, we use pci_attach_args directly

(jakllsch)

Sort SEE ALSO. Fix date. Whitespace fixes.

(wiz)

- instead of zeroing struct proc on each allocation, provide a pool cache
  constructor.
- instead of sprinkling memsets, zalloc the whole buffer.

(christos)

aarch64: Add support for ARM Server Base System Architecture (SBSA).
The SBSA is a hardware system architecture for servers based on
64-bit ARM processors. The Server Base Boot Requirements (SBBR)
specification defines a UEFI + ACPI interface for OS bootstrap,
which is supported by a combination of a new UEFI bootloader
(bootaa64.efi) and the addition of ACPI support in the
GENERIC64 kernel config.

(jmcneill)

avoid c99ism.

(mrg)

add a man page for the new mpii, mostly from OpenBSD.

(bouyer)

Add my name in copyright list

(bouyer)

Add mpii(4), a driver for LSI Megaraid Fusion controllers.
Ported from OpenBSD. This driver is MP-safe.
Note that the earlier fusion controllers (Megaraid 2208, codenamed Thunderbold)
are also supported by mfi(4). mpii will take precedence if both drivers
are enabled.
Tested on a
mfii0 at pci6 dev 0 function 0: "PERC H740P Adapter ", firmware 50.3.0-1512, 819
2MB cache
mfii0: interrupting at ioapic2 pin 2
scsibus0 at mfii0: 64 targets, 8 luns per target
scsibus0: waiting 2 seconds for devices to settle...
sd0 at scsibus0 target 0 lun 0: <DELL, PERC H740P Adp, 5.03> disk fixed
sd0: fabricating a geometry
sd0: 99 GB, 102399 cyl, 64 head, 32 sec, 512 bytes/sect x 209714688 sectors
sd0: tagged queueing
sd1 at scsibus0 target 1 lun 0: <DELL, PERC H740P Adp, 5.03> disk fixed
sd1: fabricating a geometry
sd1: 22254 GB, 22788608 cyl, 64 head, 32 sec, 512 bytes/sect x 46671069696 sectors
sd1: fabricating a geometry

It supports bioctl(8) ioctls, as well as sensors for the BBU and logical
drives.

Sponsored by LIP6.

(bouyer)

Add more KASSERTS about locking.

(bouyer)

5717 and newer handle TSO in a sighly different way. From FreeBSD.
While there, use different lowat/hiwat values if MTU is larger than ETHERMTU,
from FreeBSD.
Tested at LIP6 on a
bge0 at pci4 dev 0 function 0: Broadcom BCM5720 Gigabit Ethernet
bge0: APE firmware NCSI 1.4.22.0
bge0: interrupting at msi1 vec 0
bge0: HW config 002b1194, 00006014, 0002aa38, 00000000 0000000c
bge0: ASIC BCM5720 A0 (0x5720000), Ethernet address d0:94:66:8b:9c:18
bge0: setting short Tx thresholds
brgphy0 at bge0 phy 1: BCM5720C 1000BASE-T media interface, rev. 0
with all ipv4 checksums and TSO4 enabled.

(bouyer)

Move registers definitions to a separate file, needed for the upcomning mpii
driver. No functionnal change.

(bouyer)

Add some definitions from OpenBSD, needed by the upcoming mfii driver.
No functionnal change.

(bouyer)

rnd_add_uint32() doens't support concurent calls for the same rnd_source,
call it with dksc->sc_iolock held.

(bouyer)

Mark as done the two entries I added just minutes ago, they are now fixed.

(maxv)

Fix kernel pointer leaks in sysctl_dobuf. While here constify argument.

Also memset the buffer, to prevent leaks (even if there doesn't seem to
be currently).

(maxv)

Fix kernel pointer leaks in sysctl_doevcnt.

While here also fix info leak; there is a big padding so use zalloc.

(maxv)

Mark four issues as fixed, add two more. Netstat was actually
sysctl_unpcblist, so remove it as duplicate.

(maxv)

Fix kernel pointer leaks in the kern.lwp sysctl.

(maxv)

Tickets #1654 and #1655

(martin)

Ticket #1655

(martin)

Ticket #1655

(martin)

Sync to HEAD (requested by mrg in ticket #1655):

libexec/httpd/testsuite/data/.bzremap          up to 1.1
libexec/httpd/testsuite/t12.out                up to 1.1
libexec/httpd/testsuite/t12.in                  up to 1.1
libexec/httpd/testsuite/t13.out                up to 1.1
libexec/httpd/testsuite/t13.in                  up to 1.1
libexec/httpd/testsuite/t14.out                up to 1.1
libexec/httpd/testsuite/t14.in                  up to 1.1
libexec/httpd/testsuite/t15.out                up to 1.1
libexec/httpd/testsuite/t15.in                  up to 1.1
libexec/httpd/CHANGES                          up to 1.28
libexec/httpd/Makefile                          up to 1.27
libexec/httpd/auth-bozo.c                      up to 1.22
libexec/httpd/bozohttpd.8                      up to 1.74
libexec/httpd/bozohttpd.c                      up to 1.96
libexec/httpd/bozohttpd.h                      up to 1.56
libexec/httpd/cgi-bozo.c                        up to 1.44
libexec/httpd/content-bozo.c                    up to 1.16
libexec/httpd/daemon-bozo.c                    up to 1.19
libexec/httpd/dir-index-bozo.c                  up to 1.28
libexec/httpd/lua-bozo.c                        up to 1.15
libexec/httpd/main.c                            up to 1.21
libexec/httpd/ssl-bozo.c                        up to 1.25
libexec/httpd/tilde-luzah-bozo.c                up to 1.16
libexec/httpd/libbozohttpd/Makefile            up to 1.3
libexec/httpd/lua/bozo.lua                      up to 1.3
libexec/httpd/lua/glue.c                        up to 1.5
libexec/httpd/lua/optparse.lua                  up to 1.2
libexec/httpd/testsuite/Makefile                up to 1.11
libexec/httpd/testsuite/html_cmp                up to 1.6
libexec/httpd/testsuite/t3.out                  up to 1.4
libexec/httpd/testsuite/t5.out                  up to 1.4
libexec/httpd/testsuite/t6.out                  up to 1.4
libexec/httpd/testsuite/test-bigfile            up to 1.5
libexec/httpd/testsuite/test-simple            up to 1.5

Cosmetic changes to Lua binding in bozohttpd.

- Don't use negative indicies to read arguments of Lua functions.
- On error, return nil, "error string".
- Use ssize_t for return values from bozo_read() and bozo_write().
- Prefer lstring especially when if saves you from appending NUL and
  doing len + 1 which can potentially wraparound.
- Don't mix C allocations with Lua functions marked with "m" in the Lua
  manual. Those functions may throw (longjump) and leak data allocated
  by C function. In one case, I use luaL_Buffer, in the other case,
  I rearranged calls a bit.

fix ordering of a couple of words.  from Edgar Pettijohn in PR#52375.
thanks!

s/u_int/unsigned/.

from Jan Danielsson.  increases/fixes portability.

PR bin/52194: bozohttpd fails to exec scripts via the -C mechanism
sometimes with EFAULT due to not NULL terminated environment.

Document script handler issues with httpd(8).
From martin@, addressing PR 52194.

While here, use American spelling consistently and upper-case some
abbreviations.

Bump date.

fix output since protocol agnostic change went in.

XXX: i thought someone hooked this into atf already, please do :)

Add support for remapping requested paths via a .bzredirect file.
Fixes PR 52772. Ok: mrg@

Bump date

Remove trailing whitespace.

use __func__ in debug().

fix a denial of service attack against header contents, which
is now bounded at 16KiB.  reported by JP.

avoid memory leak in sending multiple auth headers.
mostly mitigated by previous patch to limit total header size,
but still a real problem here.

note the changes present in bozohttpd 20181118:

o  add url remap support via .bzremap file, from martin%netbsd.org@localhost
o  handle redirections for any protocol, not just http:
o  fix a denial of service attack against header contents, which
  is now bounded at 16KiB.  reported by JP.

from CHANGES:

o  reduce default timeouts, and add expand timeouts to handle the
  initial line, each header, and the total time spent
o  add -T option to expose new timeout settings
o  minor RFC fixes related to timeout handling responses

old timeouts:
60 seconds for initial request like, 60 seconds per header line,
and no whole timeout (though the recent total header size changes
do introduce one that would be about 11 hours.)
new timeouts:
30 seconds for initial request like, 10 seconds per header line,
and a total request time of 600 seconds.

the new global timeout is implemented using CLOCK_MONOTONIC, with
a fallback to CLOCK_REALTIME if monotonic time is unavailable.

reject multiple Host: headers.  besides being protocol standard,
this closes one additional memory leak found by JP.  add a simple
test to check this.

clean up option and usage handling some.

move some #if support into bozohttpd.h.

fix previous: have_debug was reversed.

also fix have_dynamic_content from the previous previous.  re-order
the debug and dynamic content to match the same pattern as everything
else so similar problems are less likely in the future.

- move special files defines into bozohttpd.h, so we can ...
- consolidate all the special file checks into
  bozo_check_special_files() so that all builds check the same
  list of special files, regardless of build options.
- convert "(void)bozo_http_error(...); return -1;" into plain
  "return bozo_http_error(...);"
- fix the call to bozo_check_special_files() to be used on all
  input types.  part of the fixes for failure to reject access
  to /.htpasswd as reported by JP on tech-security.
- use warn_unused_result attribute on bozo_check_special_files(),
  and fix the failures to return failure.  second part of the
  htpasswd access fix.
- update testsuite to use a fixed fake hostname.

call this bozohttpd 20181121.

two fixes reported by mouse:
- don't check contents of 'st' if stat(2) failed.
- round up instead of truncate.  now 10000 byte files say 10kB not 9kB.

use MAP_SHARED for the bzremap file.  avoids netbsd kernel complaining:

WARNING: defaulted mmap() share type to MAP_PRIVATE (pid 15478 command bozohttpd)

many clean ups:
- keep a list of special files and their human names
- remove (void) casts on bozo_http_error()
- fix a few more misuses of bozo_http_error()
- rename check_mapping() to check_remap() and perform some CSE
- switch away from ``%s'' to '%s'
- remove a bunch of #ifdef using new have_feature defines

alpha sort the option switch.

add an assert() check on array bounds.

minor style fixes.  simplify bozo_match_content_map().

(martin)

Sync to HEAD (requested by mrg in ticket #1655):

libexec/httpd/testsuite/data/.bzremap          up to 1.1
libexec/httpd/testsuite/t12.out                up to 1.1
libexec/httpd/testsuite/t12.in                  up to 1.1
libexec/httpd/testsuite/t13.out                up to 1.1
libexec/httpd/testsuite/t13.in                  up to 1.1
libexec/httpd/testsuite/t14.out                up to 1.1
libexec/httpd/testsuite/t14.in                  up to 1.1
libexec/httpd/testsuite/t15.out                up to 1.1
libexec/httpd/testsuite/t15.in                  up to 1.1
libexec/httpd/CHANGES                          up to 1.28
libexec/httpd/Makefile                          up to 1.27
libexec/httpd/auth-bozo.c                      up to 1.22
libexec/httpd/bozohttpd.8                      up to 1.74
libexec/httpd/bozohttpd.c                      up to 1.96
libexec/httpd/bozohttpd.h                      up to 1.56
libexec/httpd/cgi-bozo.c                        up to 1.44
libexec/httpd/content-bozo.c                    up to 1.16
libexec/httpd/daemon-bozo.c                    up to 1.19
libexec/httpd/dir-index-bozo.c                  up to 1.28
libexec/httpd/lua-bozo.c                        up to 1.15
libexec/httpd/main.c                            up to 1.21
libexec/httpd/ssl-bozo.c                        up to 1.25
libexec/httpd/tilde-luzah-bozo.c                up to 1.16
libexec/httpd/libbozohttpd/Makefile            up to 1.3
libexec/httpd/lua/bozo.lua                      up to 1.3
libexec/httpd/lua/glue.c                        up to 1.5
libexec/httpd/lua/optparse.lua                  up to 1.2
libexec/httpd/testsuite/Makefile                up to 1.11
libexec/httpd/testsuite/html_cmp                up to 1.6
libexec/httpd/testsuite/t3.out                  up to 1.4
libexec/httpd/testsuite/t5.out                  up to 1.4
libexec/httpd/testsuite/t6.out                  up to 1.4
libexec/httpd/testsuite/test-bigfile            up to 1.5
libexec/httpd/testsuite/test-simple            up to 1.5

Cosmetic changes to Lua binding in bozohttpd.

- Don't use negative indicies to read arguments of Lua functions.
- On error, return nil, "error string".
- Use ssize_t for return values from bozo_read() and bozo_write().
- Prefer lstring especially when if saves you from appending NUL and
  doing len + 1 which can potentially wraparound.
- Don't mix C allocations with Lua functions marked with "m" in the Lua
  manual. Those functions may throw (longjump) and leak data allocated
  by C function. In one case, I use luaL_Buffer, in the other case,
  I rearranged calls a bit.

fix ordering of a couple of words.  from Edgar Pettijohn in PR#52375.
thanks!

s/u_int/unsigned/.

from Jan Danielsson.  increases/fixes portability.

PR bin/52194: bozohttpd fails to exec scripts via the -C mechanism
sometimes with EFAULT due to not NULL terminated environment.

Document script handler issues with httpd(8).
From martin@, addressing PR 52194.

While here, use American spelling consistently and upper-case some
abbreviations.

Bump date.

fix output since protocol agnostic change went in.

XXX: i thought someone hooked this into atf already, please do :)

Add support for remapping requested paths via a .bzredirect file.
Fixes PR 52772. Ok: mrg@

Bump date

Remove trailing whitespace.

use __func__ in debug().

fix a denial of service attack against header contents, which
is now bounded at 16KiB.  reported by JP.

avoid memory leak in sending multiple auth headers.
mostly mitigated by previous patch to limit total header size,
but still a real problem here.

note the changes present in bozohttpd 20181118:

o  add url remap support via .bzremap file, from martin%netbsd.org@localhost
o  handle redirections for any protocol, not just http:
o  fix a denial of service attack against header contents, which
  is now bounded at 16KiB.  reported by JP.

from CHANGES:

o  reduce default timeouts, and add expand timeouts to handle the
  initial line, each header, and the total time spent
o  add -T option to expose new timeout settings
o  minor RFC fixes related to timeout handling responses

old timeouts:
60 seconds for initial request like, 60 seconds per header line,
and no whole timeout (though the recent total header size changes
do introduce one that would be about 11 hours.)
new timeouts:
30 seconds for initial request like, 10 seconds per header line,
and a total request time of 600 seconds.

the new global timeout is implemented using CLOCK_MONOTONIC, with
a fallback to CLOCK_REALTIME if monotonic time is unavailable.

reject multiple Host: headers.  besides being protocol standard,
this closes one additional memory leak found by JP.  add a simple
test to check this.

clean up option and usage handling some.

move some #if support into bozohttpd.h.

fix previous: have_debug was reversed.

also fix have_dynamic_content from the previous previous.  re-order
the debug and dynamic content to match the same pattern as everything
else so similar problems are less likely in the future.

- move special files defines into bozohttpd.h, so we can ...
- consolidate all the special file checks into
  bozo_check_special_files() so that all builds check the same
  list of special files, regardless of build options.
- convert "(void)bozo_http_error(...); return -1;" into plain
  "return bozo_http_error(...);"
- fix the call to bozo_check_special_files() to be used on all
  input types.  part of the fixes for failure to reject access
  to /.htpasswd as reported by JP on tech-security.
- use warn_unused_result attribute on bozo_check_special_files(),
  and fix the failures to return failure.  second part of the
  htpasswd access fix.
- update testsuite to use a fixed fake hostname.

call this bozohttpd 20181121.

two fixes reported by mouse:
- don't check contents of 'st' if stat(2) failed.
- round up instead of truncate.  now 10000 byte files say 10kB not 9kB.

use MAP_SHARED for the bzremap file.  avoids netbsd kernel complaining:

WARNING: defaulted mmap() share type to MAP_PRIVATE (pid 15478 command bozohttpd)

many clean ups:
- keep a list of special files and their human names
- remove (void) casts on bozo_http_error()
- fix a few more misuses of bozo_http_error()
- rename check_mapping() to check_remap() and perform some CSE
- switch away from ``%s'' to '%s'
- remove a bunch of #ifdef using new have_feature defines

alpha sort the option switch.

add an assert() check on array bounds.

minor style fixes.  simplify bozo_match_content_map().

(martin)

Sync to HEAD (requested by mrg in ticket #1655):

libexec/httpd/testsuite/data/.bzremap          up to 1.1
libexec/httpd/testsuite/t12.out                up to 1.1
libexec/httpd/testsuite/t12.in                  up to 1.1
libexec/httpd/testsuite/t13.out                up to 1.1
libexec/httpd/testsuite/t13.in                  up to 1.1
libexec/httpd/testsuite/t14.out                up to 1.1
libexec/httpd/testsuite/t14.in                  up to 1.1
libexec/httpd/testsuite/t15.out                up to 1.1
libexec/httpd/testsuite/t15.in                  up to 1.1
libexec/httpd/CHANGES                          up to 1.28
libexec/httpd/Makefile                          up to 1.27
libexec/httpd/auth-bozo.c                      up to 1.22
libexec/httpd/bozohttpd.8                      up to 1.74
libexec/httpd/bozohttpd.c                      up to 1.96
libexec/httpd/bozohttpd.h                      up to 1.56
libexec/httpd/cgi-bozo.c                        up to 1.44
libexec/httpd/content-bozo.c                    up to 1.16
libexec/httpd/daemon-bozo.c                    up to 1.19
libexec/httpd/dir-index-bozo.c                  up to 1.28
libexec/httpd/lua-bozo.c                        up to 1.15
libexec/httpd/main.c                            up to 1.21
libexec/httpd/ssl-bozo.c                        up to 1.25
libexec/httpd/tilde-luzah-bozo.c                up to 1.16
libexec/httpd/libbozohttpd/Makefile            up to 1.3
libexec/httpd/lua/bozo.lua                      up to 1.3
libexec/httpd/lua/glue.c                        up to 1.5
libexec/httpd/lua/optparse.lua                  up to 1.2
libexec/httpd/testsuite/Makefile                up to 1.11
libexec/httpd/testsuite/html_cmp                up to 1.6
libexec/httpd/testsuite/t3.out                  up to 1.4
libexec/httpd/testsuite/t5.out                  up to 1.4
libexec/httpd/testsuite/t6.out                  up to 1.4
libexec/httpd/testsuite/test-bigfile            up to 1.5
libexec/httpd/testsuite/test-simple            up to 1.5

Cosmetic changes to Lua binding in bozohttpd.

- Don't use negative indicies to read arguments of Lua functions.
- On error, return nil, "error string".
- Use ssize_t for return values from bozo_read() and bozo_write().
- Prefer lstring especially when if saves you from appending NUL and
  doing len + 1 which can potentially wraparound.
- Don't mix C allocations with Lua functions marked with "m" in the Lua
  manual. Those functions may throw (longjump) and leak data allocated
  by C function. In one case, I use luaL_Buffer, in the other case,
  I rearranged calls a bit.

fix ordering of a couple of words.  from Edgar Pettijohn in PR#52375.
thanks!

s/u_int/unsigned/.

from Jan Danielsson.  increases/fixes portability.

PR bin/52194: bozohttpd fails to exec scripts via the -C mechanism
sometimes with EFAULT due to not NULL terminated environment.

Document script handler issues with httpd(8).
From martin@, addressing PR 52194.

While here, use American spelling consistently and upper-case some
abbreviations.

Bump date.

fix output since protocol agnostic change went in.

XXX: i thought someone hooked this into atf already, please do :)

Add support for remapping requested paths via a .bzredirect file.
Fixes PR 52772. Ok: mrg@

Bump date

Remove trailing whitespace.

use __func__ in debug().

fix a denial of service attack against header contents, which
is now bounded at 16KiB.  reported by JP.

avoid memory leak in sending multiple auth headers.
mostly mitigated by previous patch to limit total header size,
but still a real problem here.

note the changes present in bozohttpd 20181118:

o  add url remap support via .bzremap file, from martin%netbsd.org@localhost
o  handle redirections for any protocol, not just http:
o  fix a denial of service attack against header contents, which
  is now bounded at 16KiB.  reported by JP.

from CHANGES:

o  reduce default timeouts, and add expand timeouts to handle the
  initial line, each header, and the total time spent
o  add -T option to expose new timeout settings
o  minor RFC fixes related to timeout handling responses

old timeouts:
60 seconds for initial request like, 60 seconds per header line,
and no whole timeout (though the recent total header size changes
do introduce one that would be about 11 hours.)
new timeouts:
30 seconds for initial request like, 10 seconds per header line,
and a total request time of 600 seconds.

the new global timeout is implemented using CLOCK_MONOTONIC, with
a fallback to CLOCK_REALTIME if monotonic time is unavailable.

reject multiple Host: headers.  besides being protocol standard,
this closes one additional memory leak found by JP.  add a simple
test to check this.

clean up option and usage handling some.

move some #if support into bozohttpd.h.

fix previous: have_debug was reversed.

also fix have_dynamic_content from the previous previous.  re-order
the debug and dynamic content to match the same pattern as everything
else so similar problems are less likely in the future.

- move special files defines into bozohttpd.h, so we can ...
- consolidate all the special file checks into
  bozo_check_special_files() so that all builds check the same
  list of special files, regardless of build options.
- convert "(void)bozo_http_error(...); return -1;" into plain
  "return bozo_http_error(...);"
- fix the call to bozo_check_special_files() to be used on all
  input types.  part of the fixes for failure to reject access
  to /.htpasswd as reported by JP on tech-security.
- use warn_unused_result attribute on bozo_check_special_files(),
  and fix the failures to return failure.  second part of the
  htpasswd access fix.
- update testsuite to use a fixed fake hostname.

call this bozohttpd 20181121.

two fixes reported by mouse:
- don't check contents of 'st' if stat(2) failed.
- round up instead of truncate.  now 10000 byte files say 10kB not 9kB.

use MAP_SHARED for the bzremap file.  avoids netbsd kernel complaining:

WARNING: defaulted mmap() share type to MAP_PRIVATE (pid 15478 command bozohttpd)

many clean ups:
- keep a list of special files and their human names
- remove (void) casts on bozo_http_error()
- fix a few more misuses of bozo_http_error()
- rename check_mapping() to check_remap() and perform some CSE
- switch away from ``%s'' to '%s'
- remove a bunch of #ifdef using new have_feature defines

alpha sort the option switch.

add an assert() check on array bounds.

minor style fixes.  simplify bozo_match_content_map().

(martin)

Fix kernel pointer leaks in sysctl_unpcblist.

(maxv)

Sync to HEAD (requested by mrg in ticket #1104)

libexec/httpd/testsuite/data/.bzremap          up to 1.1
libexec/httpd/testsuite/t12.out                up to 1.1
libexec/httpd/testsuite/t12.in                  up to 1.1
libexec/httpd/testsuite/t13.out                up to 1.1
libexec/httpd/testsuite/t13.in                  up to 1.1
libexec/httpd/testsuite/t14.out                up to 1.1
libexec/httpd/testsuite/t14.in                  up to 1.1
libexec/httpd/testsuite/t15.out                up to 1.1
libexec/httpd/testsuite/t15.in                  up to 1.1
libexec/httpd/CHANGES                          up to 1.28
libexec/httpd/auth-bozo.c                      up to 1.22
libexec/httpd/bozohttpd.8                      up to 1.74
libexec/httpd/bozohttpd.c                      up to 1.96
libexec/httpd/bozohttpd.h                      up to 1.56
libexec/httpd/cgi-bozo.c                        up to 1.44
libexec/httpd/content-bozo.c                    up to 1.16
libexec/httpd/daemon-bozo.c                    up to 1.19
libexec/httpd/dir-index-bozo.c                  up to 1.28
libexec/httpd/main.c                            up to 1.21
libexec/httpd/ssl-bozo.c                        up to 1.25
libexec/httpd/tilde-luzah-bozo.c                up to 1.16
libexec/httpd/lua/bozo.lua                      up to 1.3
libexec/httpd/lua/glue.c                        up to 1.5
libexec/httpd/lua/optparse.lua                  up to 1.2
libexec/httpd/testsuite/Makefile                up to 1.11
libexec/httpd/testsuite/html_cmp                up to 1.6
libexec/httpd/testsuite/t3.out                  up to 1.4
libexec/httpd/testsuite/t5.out                  up to 1.4
libexec/httpd/testsuite/t6.out                  up to 1.4
libexec/httpd/testsuite/test-bigfile            up to 1.5
libexec/httpd/testsuite/test-simple            up to 1.5

Cosmetic changes to Lua binding in bozohttpd.

- Don't use negative indicies to read arguments of Lua functions.
- On error, return nil, "error string".
- Use ssize_t for return values from bozo_read() and bozo_write().
- Prefer lstring especially when if saves you from appending NUL and
  doing len + 1 which can potentially wraparound.
- Don't mix C allocations with Lua functions marked with "m" in the Lua
  manual. Those functions may throw (longjump) and leak data allocated
  by C function. In one case, I use luaL_Buffer, in the other case,
  I rearranged calls a bit.

fix ordering of a couple of words.  from Edgar Pettijohn in PR#52375.
thanks!

s/u_int/unsigned/.

from Jan Danielsson.  increases/fixes portability.

PR bin/52194: bozohttpd fails to exec scripts via the -C mechanism
sometimes with EFAULT due to not NULL terminated environment.

Document script handler issues with httpd(8).
From martin@, addressing PR 52194.

While here, use American spelling consistently and upper-case some
abbreviations.

Bump date.

fix output since protocol agnostic change went in.

XXX: i thought someone hooked this into atf already, please do :)

Add support for remapping requested paths via a .bzredirect file.
Fixes PR 52772. Ok: mrg@

Bump date

Remove trailing whitespace.

use __func__ in debug().

fix a denial of service attack against header contents, which
is now bounded at 16KiB.  reported by JP.

avoid memory leak in sending multiple auth headers.
mostly mitigated by previous patch to limit total header size,
but still a real problem here.

note the changes present in bozohttpd 20181118:

o  add url remap support via .bzremap file, from martin%netbsd.org@localhost
o  handle redirections for any protocol, not just http:
o  fix a denial of service attack against header contents, which
  is now bounded at 16KiB.  reported by JP.

from CHANGES:

o  reduce default timeouts, and add expand timeouts to handle the
  initial line, each header, and the total time spent
o  add -T option to expose new timeout settings
o  minor RFC fixes related to timeout handling responses

old timeouts:
60 seconds for initial request like, 60 seconds per header line,
and no whole timeout (though the recent total header size changes
do introduce one that would be about 11 hours.)
new timeouts:
30 seconds for initial request like, 10 seconds per header line,
and a total request time of 600 seconds.

the new global timeout is implemented using CLOCK_MONOTONIC, with
a fallback to CLOCK_REALTIME if monotonic time is unavailable.

reject multiple Host: headers.  besides being protocol standard,
this closes one additional memory leak found by JP.  add a simple
test to check this.

clean up option and usage handling some.

move some #if support into bozohttpd.h.

fix previous: have_debug was reversed.

also fix have_dynamic_content from the previous previous.  re-order
the debug and dynamic content to match the same pattern as everything
else so similar problems are less likely in the future.

- move special files defines into bozohttpd.h, so we can ...
- consolidate all the special file checks into
  bozo_check_special_files() so that all builds check the same
  list of special files, regardless of build options.
- convert "(void)bozo_http_error(...); return -1;" into plain
  "return bozo_http_error(...);"
- fix the call to bozo_check_special_files() to be used on all
  input types.  part of the fixes for failure to reject access
  to /.htpasswd as reported by JP on tech-security.
- use warn_unused_result attribute on bozo_check_special_files(),
  and fix the failures to return failure.  second part of the
  htpasswd access fix.
- update testsuite to use a fixed fake hostname.

call this bozohttpd 20181121.

two fixes reported by mouse:
- don't check contents of 'st' if stat(2) failed.
- round up instead of truncate.  now 10000 byte files say 10kB not 9kB.

use MAP_SHARED for the bzremap file.  avoids netbsd kernel complaining:

WARNING: defaulted mmap() share type to MAP_PRIVATE (pid 15478 command bozohttpd)

many clean ups:
- keep a list of special files and their human names
- remove (void) casts on bozo_http_error()
- fix a few more misuses of bozo_http_error()
- rename check_mapping() to check_remap() and perform some CSE
- switch away from ``%s'' to '%s'
- remove a bunch of #ifdef using new have_feature defines

alpha sort the option switch.

add an assert() check on array bounds.

minor style fixes.  simplify bozo_match_content_map().

(martin)

KNF, no functional change.

(maxv)

Pull up following revision(s) (requested by sevan in ticket #1654):

usr.sbin/mtree/create.c: revision 1.76

Adjust test, we only want to return the structure member if the result
is not NULL.

Heads up by Sascha Wildner @ DragonFly BSD.
Adjust test, we only want to return the structure member if the result
is not NULL.

(martin)

Fix kernel pointer leaks in sysctl_inpcblist.

(maxv)

Fix kernel pointer leaks in the kern.file sysctl, same as kern.file2.

(maxv)

Rename fill_file -> fill_file2, since that's the KERN_FILE2 sysctl.

(maxv)

Fix kernel info leak, we do a blunt copy of struct proc, but it has
padding. So zero out the structure on each allocation. And copy field by
field while here, because many fields should be hidden by COND_SET_VALUE.

(maxv)

Add some ThunderX CPU Ids

(skrll)

Handle ThunderX errata

(skrll)

Handle Cavium AHCI/RAID controller BAR weirdness.

Support 64bit BARs as well.

(skrll)

Fixup the retry loop wrt with XHCI_DISABLE_MSI{,X}

(skrll)

Regen

(skrll)

Add Rockchip vendor ID and a device. Requested by jak@

From OpenBSD

(skrll)

Add a whole bunch of Cavium ThunderX devices

(skrll)

add warn_unused_result.

(christos)

- add FALLTHROUGH comment
- one return is usually enough.

(christos)

appease lint

(christos)

one semicolon is usually enough.

(christos)

PR/53682: Jordan Lewis: use newlines instead of padded spaces when restoring
multi-line histories.

(christos)

Support device nodes that have no entry in /dev, identify them by major:minor
numbers like the original Linux code.

While here, fix a memory leak.

(mlelstv)

Grammar improvements.

(wiz)

call this bozohttpd 20181124.

(mrg)

fix a bug in the rework for -i option:  move the real code in place.

for some reason gcc does not warn about this:

  case 'x':
    stuff_here();
    break;

    other_stuff_here();
    break;

and the other_stuff_here() was what was mis-placed.

should fix atf failures in networking.

(mrg)

attron(), attroff() - don't take a shortcut.

(uwe)

s/time/val/ to avoid shadowing a global indentifier.

(mrg)

Fix the <> redirection operator, which has been broken since it was
first implemented in response to PR bin/4966  (PR Feb 1998, fix Feb 1999).

The file named should not be truncated.

No other shell truncates the file (<> was added to FreeBSD sh in Oct 2000,
and did not include O_TRUNC) and POSIX certainly does not suggest that
should happen (just that the file is to be created if it does not exist.)

Bug pointed out in off-list e-mail by Martijn Dekker

(kre)

Handle eval $'continue\ncommand' (and similar) in a loop correctly ...
"command" should not be executed.  (The issue affects multi-line
eval strings only - ie: commands after the next \n are not skipped).

Bug noted by Martijn Dekker in off-list e-mail.

Fix from FreeBSD:
src/bin/sh/eval.c: Revision 272983 Sun Oct 12 13:12:06 2014 UTC by jilles

(kre)

Avoid long option names that differ only in character case.
Change Xtrace (the name) to xlock instead.  Aside from the different
name, there is no change to functionality.

(kre)

Use MSIX when available

(jmcneill)

Only allocate what we need for ITT tables

(jmcneill)

Use acpi_intr_establish

(jmcneill)

Update comments to help explain what's going on

(skrll)

Enable CPU_THUNDERX

(skrll)

Fix LPI pending table size, use correct LPI conf offset in gicv3_lpi_block_irqs, and set bit[7]=1 for G1NS interrupts when writing to the LPI configuration table.

(jmcneill)

Fix ITT size, only need to MAPD once per device.

(jmcneill)

Fix so the setcontext call is via the PLT and libpthread can override

(skrll)

Fix RTLD_DEBUG_RELOC build

(skrll)

wattr_set - turn off all wide attributes (fix unedited copy/paste).

(uwe)

Rename the reserved argument from "opt" to "opts" to match SUS text.

(uwe)

Refactor.  Move code to turn attributes on/off into separate
functions.  Express both old and new functions to manipulate
attributes using those functions.  Check that the the new API's opts
argument (reserved by the standard for future use) is NULL and error
out if not (like getcchar/setcchar).  No functional change intended.

(uwe)

Trailing whitespace

(skrll)

minor style fixes.  simplify bozo_match_content_map().

(mrg)

When merging entries with the keyboard map, print only the resulting changes.

While here, replace bcopy with standad memcpy.

(mlelstv)

Drop a few redundant casts of a variable to its own type.

(uwe)

Move getattrs() and wcolor_set() so that they are with their peers and
so that wide and non-wide functions are in the same order.  While here,
make __wcolor_set() static.  No functional change intended.

(uwe)

Drop HAVE_WCHAR ifdefs from code that is not even compiled with !HAVE_WCHAR.

We still try to mainain the ability to build our curses with
!HAVE_WCHAR, but it doesn't make sense to provide stubs for new wide
API functions that just error out when !HAVE_WCHAR.  Any code that
only uses old API (and can work with !HAVE_WCHAR curses) doesn't use
those new functions.  The code that uses new API obviosly cannot work
when all the new API is stubbed out.

So the plan is to drop the stubs.  This commit does that for files
that are not even compiled with !HAVE_WCHAR (not only those stubs are
useless, they were not even there to begin with).

Same object code is generated for the normal HAVE_WCHAR case.  Nothing
is even recompiled for !HAVE_WCHAR.

Ok by blymn@ jdc@ roy@

(uwe)

We need insstr.c for !HAVE_WCHAR too.

(uwe)

Typo in comment

(skrll)

Make armv7.img boot on the DE0 Nano SoC. Requires u-boot from -current pkgsrc.

(aymeric)

Switch the DE0 Nano SoC to the GENERIC kernel.

(aymeric)

use correct interrupt index

fixes intrctl list

from jmcneill@

(jakllsch)

G/C __APCS_26__ support

(skrll)

add an assert() check on array bounds.

(mrg)

alpha sort the option switch.

(mrg)

- Add wm_k1_workaround_lv() from FreeBSD. It's PCH2 specifc:
    Workaround to set the K1 beacon duration for 82579 parts in 10Mbps.
    Disable K1 for 1000 and 100 speeds.
- Make wm_link_stall_workaround_hv() and move an 82578 specific code into it.
  Don't apply the workaround if BMCR_LOOP bit is set. Same as FreeBSD.
- Add comment. Modify comment.

(msaitoh)

Apply MADT interrupt source overrides to interrupts established via
acpi_md_intr_establish.

(jmcneill)

build fix until someone is brave enough to remove this kernel

(skrll)

many clean ups:
- keep a list of special files and their human names
- remove (void) casts on bozo_http_error()
- fix a few more misuses of bozo_http_error()
- rename check_mapping() to check_remap() and perform some CSE
- switch away from ``%s'' to '%s'
- remove a bunch of #ifdef using new have_feature defines

(mrg)

fix condition code. x1==0 is parent.

(ryo)

Add missing pmap_update after pmap_kenter_pa, noted by Kamil.

(maxv)

Decode Intel/AMD MONITOR/MWAIT leaf.

(msaitoh)

Add Intel/AMD MONITOR/MWAIT leaf.

(msaitoh)

Add ATF for IPv6 NAT-T.

We use IPv6 NAT-T to avoid IPsec slowing down caused by dropping ESP packets
by some Customer Premises Equipments (CPE). I implement ATF to test such
situation.

I think it can also work with nat66, but I have not tested to the fine details.

(knakahara)

Support IPv6 NAT-T. Implemented by hsuenaga@IIJ and ohishi@IIJ.

Add ATF later.

(knakahara)

Try to provide the typesetting help requested.

(uwe)

_REG_LR should be _lwp_exit

(skrll)

Fix some register names in comments

(skrll)

Fix a comment

(skrll)

- RISC OS hands us the graphics hardware in BGR mode when running 32bit colour
  pass that info on to genfb/gffb so X can show colours correctly
- set genfb properties on gffb as well

(macallan)

A few hints that sets may come in .tar.xz format (instead of .tgz)

(martin)

Sprinkle a few references to .tar.xz files (as alternative to .tgz files)

(martin)

Add (optional) support for expanded static menu texts - that is: whatever
the application programmer defines as expansion, e.g. to implement
parameter substitution.
While here add rudimentary documentation of the dynamic messages
feature (so at least the parser and the syntax documented here
are in sync).
The man page could use some typesetting help...

(martin)

further de-cargocult the new mmap() methods

(macallan)

don't bother reading ofw properties for platinumfb

(scole)

use MAP_SHARED for the bzremap file.  avoids netbsd kernel complaining:

WARNING: defaulted mmap() share type to MAP_PRIVATE (pid 15478 command bozohttpd)

(mrg)

Pull up following revision(s) (requested by maxv in ticket #1652):

sys/compat/netbsd32/netbsd32_socket.c: revision 1.48 (via patch)

Fix inverted logic, which leads to buffer overflow. Detected by kASan.

(martin)

revert PMAP_DIRECT until tested; requested by mrg@

(jdolecek)

Decode package, core and SMT id if CPUID 0x0b is available on Intel processor.
If the value is different from the kernel value, we should fix the kernel code.

TODO: Use 0x1f if it's available.

(msaitoh)

Add Intel CPUID Extended Topology Enumeration Fn0000000b definitions.

(msaitoh)

Tickets #1652 and #1653

(martin)

Pull up following revision(s) (requested by maxv in ticket #1653):

sys/kern/kern_event.c: revision 1.104

Fix kernel info leak. There are 4 bytes of padding in struct kevent.
[  287.537676] kleak: Possible leak in copyout: [len=40, leaked=4]
[  287.537676] #0 0xffffffff80b7c41a in kleak_note <netbsd>
[  287.547673] #1 0xffffffff80b7c49a in kleak_copyout <netbsd>
[  287.557677] #2 0xffffffff80b1d32d in kqueue_scan.isra.1.constprop.2 <netbsd>
[  287.557677] #3 0xffffffff80b1dc6a in kevent1 <netbsd>
[  287.567683] #4 0xffffffff80b1dcb0 in sys___kevent50 <netbsd>
[  287.567683] #5 0xffffffff8025ab3c in sy_call <netbsd>
[  287.577688] #6 0xffffffff8025ad6e in sy_invoke <netbsd>
[  287.587693] #7 0xffffffff8025adf4 in syscall <netbsd>

(martin)

Tickets #1652 and #1653

(martin)

Pull up following revision(s) (requested by maxv in ticket #1653):

sys/kern/kern_event.c: revision 1.104

Fix kernel info leak. There are 4 bytes of padding in struct kevent.
[  287.537676] kleak: Possible leak in copyout: [len=40, leaked=4]
[  287.537676] #0 0xffffffff80b7c41a in kleak_note <netbsd>
[  287.547673] #1 0xffffffff80b7c49a in kleak_copyout <netbsd>
[  287.557677] #2 0xffffffff80b1d32d in kqueue_scan.isra.1.constprop.2 <netbsd>
[  287.557677] #3 0xffffffff80b1dc6a in kevent1 <netbsd>
[  287.567683] #4 0xffffffff80b1dcb0 in sys___kevent50 <netbsd>
[  287.567683] #5 0xffffffff8025ab3c in sy_call <netbsd>
[  287.577688] #6 0xffffffff8025ad6e in sy_invoke <netbsd>
[  287.587693] #7 0xffffffff8025adf4 in syscall <netbsd>

(martin)

Tickets #1652 and #1653

(martin)

Pull up following revision(s) (requested by maxv in ticket #1653):

sys/kern/kern_event.c: revision 1.104

Fix kernel info leak. There are 4 bytes of padding in struct kevent.
[  287.537676] kleak: Possible leak in copyout: [len=40, leaked=4]
[  287.537676] #0 0xffffffff80b7c41a in kleak_note <netbsd>
[  287.547673] #1 0xffffffff80b7c49a in kleak_copyout <netbsd>
[  287.557677] #2 0xffffffff80b1d32d in kqueue_scan.isra.1.constprop.2 <netbsd>
[  287.557677] #3 0xffffffff80b1dc6a in kevent1 <netbsd>
[  287.567683] #4 0xffffffff80b1dcb0 in sys___kevent50 <netbsd>
[  287.567683] #5 0xffffffff8025ab3c in sy_call <netbsd>
[  287.577688] #6 0xffffffff8025ad6e in sy_invoke <netbsd>
[  287.587693] #7 0xffffffff8025adf4 in syscall <netbsd>

(martin)

Pull up following revision(s) (requested by maxv in ticket #1652):

sys/compat/netbsd32/netbsd32_socket.c: revision 1.48 (via patch)

Fix inverted logic, which leads to buffer overflow. Detected by kASan.

(martin)

Pull up following revision(s) (requested by maxv in ticket #1652):

sys/compat/netbsd32/netbsd32_socket.c: revision 1.48 (via patch)

Fix inverted logic, which leads to buffer overflow. Detected by kASan.

(martin)

Tickets #1100, #1101 and #1102

(martin)

Pull up following revision(s) (requested by maxv in ticket #1102):

sys/kern/kern_event.c: revision 1.104

Fix kernel info leak. There are 4 bytes of padding in struct kevent.
[  287.537676] kleak: Possible leak in copyout: [len=40, leaked=4]
[  287.537676] #0 0xffffffff80b7c41a in kleak_note <netbsd>
[  287.547673] #1 0xffffffff80b7c49a in kleak_copyout <netbsd>
[  287.557677] #2 0xffffffff80b1d32d in kqueue_scan.isra.1.constprop.2 <netbsd>
[  287.557677] #3 0xffffffff80b1dc6a in kevent1 <netbsd>
[  287.567683] #4 0xffffffff80b1dcb0 in sys___kevent50 <netbsd>
[  287.567683] #5 0xffffffff8025ab3c in sy_call <netbsd>
[  287.577688] #6 0xffffffff8025ad6e in sy_invoke <netbsd>
[  287.587693] #7 0xffffffff8025adf4 in syscall <netbsd>

(martin)

Pull up following revision(s) (requested by maxv in ticket #1101):

sys/net/rtsock.c: revision 1.244

Fix kernel info leak. There are 2 bytes of padding in struct if_msghdr.
[  944.607323] kleak: Possible leak in copyout: [len=176, leaked=2]
[  944.617335] #0 0xffffffff80b7c44a in kleak_note <netbsd>
[  944.627332] #1 0xffffffff80b7c4ca in kleak_copyout <netbsd>
[  944.627332] #2 0xffffffff80c91698 in sysctl_iflist_if <netbsd>
[  944.637336] #3 0xffffffff80c91d3c in sysctl_iflist <netbsd>
[  944.647343] #4 0xffffffff80c93855 in sysctl_rtable <netbsd>
[  944.647343] #5 0xffffffff80b5b328 in sysctl_dispatch <netbsd>
[  944.657346] #6 0xffffffff80b5b62e in sys___sysctl <netbsd>
[  944.667354] #7 0xffffffff8025ab3c in sy_call <netbsd>
[  944.667354] #8 0xffffffff8025ad6e in sy_invoke <netbsd>
[  944.677365] #9 0xffffffff8025adf4 in syscall <netbsd>

(martin)

Pull up following revision(s) (requested by maxv in ticket #1100):

sys/kern/kern_exec.c: revision 1.462

Fix stack info leak. There are 2x4 bytes of padding in struct ps_strings.
[  223.896199] kleak: Possible leak in copyout: [len=32, leaked=8]
[  223.906430] #0 0xffffffff80224d0a in kleak_note <netbsd>
[  223.906430] #1 0xffffffff80224d8a in kleak_copyout <netbsd>
[  223.918363] #2 0xffffffff80b1e26c in copyoutpsstrs <netbsd>
[  223.926560] #3 0xffffffff80b1e331 in copyoutargs <netbsd>
[  223.936216] #4 0xffffffff80b21768 in execve_runproc <netbsd>
[  223.946225] #5 0xffffffff80b21cc9 in execve1 <netbsd>
[  223.946225] #6 0xffffffff8025a89c in sy_call <netbsd>
[  223.956225] #7 0xffffffff8025aace in sy_invoke <netbsd>
[  223.966232] #8 0xffffffff8025ab54 in syscall <netbsd>

(martin)

kcpuset_ffs returns the cpu number plus one, so make sure to subtract it

(jmcneill)

- AMD also reports CPUID 7's highest subleaf. Print it.
- Use macro.

(msaitoh)

two fixes reported by mouse:
- don't check contents of 'st' if stat(2) failed.
- round up instead of truncate.  now 10000 byte files say 10kB not 9kB.

(mrg)

EINVAL (22) is a valid return value for ARM mmap routines; we need to
return -1 for invalid mmap attempts.

(thorpej)

- move special files defines into bozohttpd.h, so we can ...
- consolidate all the special file checks into
  bozo_check_special_files() so that all builds check the same
  list of special files, regardless of build options.
- convert "(void)bozo_http_error(...); return -1;" into plain
  "return bozo_http_error(...);"
- fix the call to bozo_check_special_files() to be used on all
  input types.  part of the fixes for failure to reject access
  to /.htpasswd as reported by JP on tech-security.
- use warn_unused_result attribute on bozo_check_special_files(),
  and fix the failures to return failure.  second part of the
  htpasswd access fix.
- update testsuite to use a fixed fake hostname.

call this bozohttpd 20181121.

(mrg)

Make TI compile and convert TI to generic start

Compile tested only (obviously)

(skrll)

Sort

(skrll)

G/C

(skrll)

options<space><tab>

(skrll)

- Use ci_feat_val[7] as CPUID 7 %edx to match x86/cpu.h
- AMD also has CPUID 6.
- Remove unused code for coretemp.
- Consistently use descs[] instead of data[].

(msaitoh)

Modify comment. No functional change:
- AMD also has CPUID 0x06 and 0x0d.
- PCOMMIT was obsoleted.

(msaitoh)

Compare pointers to NULL, not to zero.

(uwe)

Drop bogus cast.

(uwe)

Don't hide assignments inside tests.

(uwe)

Implement PMAP_DIRECT / pmap_direct_process() in support of experimental
UBC optimizations (compile-tested only for now)

PR kern/53124

(jdolecek)

add IA64_DCR_DEFAULT, more changes from FreeBSD

(scole)

need to use PGO_NOBLOCKALLOC also in ubc_alloc_direct() case, same
as non-direct code - otherwise the code tries to acquire the wapbl
lock again in genfs_getpages(), and panic due to locking against itself

towards PR kern/53124

(jdolecek)

s/failing/failed/ for the aprint_error()

(jdolecek)

Fix locking for readdir code (Brett Lymn)

(christos)

Convert all static menu struct initializiations to C99 name initializer
format - prerequisite for an upcoming evil hack (tm).
No functional change intended.

(martin)

Fix color pair handling.  color_pair argument is a pair number.

(uwe)