- sync with latest from iana
- add ttcp

(christos)

exclude shared libraries that are currently in use from removal.

(christos)

When setting up a "use whole disk" single outer partition, force an
empty set of inner partitions immediately,

This avoids reading old (stale) partitions (e.g. disklabel that
survived cleaning and re-creating the MBR with the MBR NetBSD partition
starting at the same offset) later.

(martin)

After deleting all partitions, reset alignment to the values we would
have used on an empty disk.

(martin)

Add KASAN_PANIC, an option to turn KASAN warning into kernel panics,
requested by Siddharth. While here clarify a little.

(maxv)

Add rnd(9) support.

(msaitoh)

explicitly initialize sensor->state

(macallan)

Make this work.

(jmcneill)

fix typo

(tnn)

add sunxihstimer* at fdt?

(tnn)

sunxihstimer: add support for Allwinner High-Speed Timer

(tnn)

Bump file system size slightly

(martin)

Update TODO.ptrace

Drop compat32 entries as they were mostly addressed.
Drop MD specific calls, it's up to port's CPU to contain various features
like PT_STEP.

(kamil)

cleanup obsolete file selection from sets and refactor font synchronization.
The font config files are not in sets, so they are still hard-coded.

(christos)

Add missing newline.

(isaki)

select the powerd scripts from the sets

(christos)

boot_ufs (primary bootloader) expects /boot OMAGIC a.out.

(isaki)

Fix compile error (s/LAPIC_PCINT/LAPIC_LVT_PCINT/)

(msaitoh)

Add support "interrupts-extended".

* fdtbus_get_phandle_with_data().
  Add utility subroutine to get phandle with data.

(hkenken)

- Dump LAPIC and I/O APIC correctly.
  - Don't print redirect target on LAPIC.
  - Fix DEST_MASK:
    - DEST_MASK is not 1 bit but 2 bit.
    - Add missing "\0"s to print decoded name correctly.
  - Support both LAPIC and I/O APIC correctly in apic_format_redir().
- Improve output of some bits using with snprintb()'s "F\B\1" and ":\V".

(msaitoh)

Use the generated "postinstall" in the objdir for postinstall-check
and postinstall-fix targets - we do not have a simple postinstall script
in the source tree any more.

(martin)

Simplify the _ARM32_NEED_BUS_DMA_BOUNCE #ifdefs and rely on compiler
optimisation of the bouncing = false case.

Drain the write buf (aka DSB) in more cases

Catch all CPUs that support speculation. (thunderx isn't CPU_CORTEX)

(skrll)

rtadvd: fix rdnss and dnssl lifetime assignment

Treat it the same as a prefix valid time as per the RFC.
This allows to set a zero value to remove the assignment from the node.

(roy)

No functional change:
- Rename macros:
  - ICR, LVT and MSIDATA can share the bit definitions. Remove redundant
    definitions and use the common macros.
  - Consistently use LAPIC_LVT_ for all local vector table's macro names.
- Use __BITS().
- Add definition for TSC-deadline (LAPIC_LVT_TMM_TSCDLT).

(msaitoh)

in nvme_attach() when creating the admin queue to probe the device info,
and also in nvme_dmamem_alloc(), allow as many DMA segment as would be
maximally needed for the size, rather than hard coding '2' for the form
and '1' for the latter.

now ld@nvme on i386 doesn't crash and i see at least 1.3GB/sec.

(mrg)

KASSERT() -> KASSERTMSG() message in _bus_dmamem_alloc_range().

(mrg)

make the script MI again (same across all archs)

(christos)

build dynamically the list of compat archsubdirs.

(christos)

Enhance the GDB support for NetBSD

- Enable VFORK events
- Add syscall number for SCE/SCX events
- Add commented out posix_spawn(3) events

(kamil)

remove obsolete library files for all the "compat" subdirs not just amd64
and sparc64.

(christos)

make all lines look the same, and put one arch per line.

(christos)

Fix aarch64

(christos)

Anchor the egrep search to avoid npf.conf matching pf.conf, but don't
anchor $ so that blacklistd machines blackist.

(christos)

Enable vfork(2) ATF tests in t_ptrace_wait*

The racing issues are gone in my local setup.

(kamil)

Welcome to 8.99.45!

struct lwp includes now l_vforkwaiting.

(kamil)

Correct use-after-free issue in vfork(2)

In the previous behavior vforking parent was keeping pointer to a child
and checking whether it clears a PL_PPWAIT in its bitfield p_lflag. However
a child can go invalid between exec/exit event from child and waking up
vforked parent and this can cause invalid pointer read and in the worst
scenario kernel crash.

In the new behavior vforked child keeps a reference to vforked parent LWP
and sets a value l_vforkwaiting to false. This means that vforked child
can finish its work, exec/exit and be terminated and once parent will be
woken up it will read its own field whether its child is still blocking.

Add new field in struct lwp: l_vforkwaiting protected by proc_lock.
In future it should be refactored and all PL_PPWAIT users transformed to
l_vforkwaiting and next l_vforkwaiting probably transformed into a bit
field.

This is another attempt of fixing this bug after <rmind> from 2012 in
commit:

Author: rmind <rmind@NetBSD.org>
Date:  Sun Jul 22 22:40:18 2012 +0000

    fork1: fix use-after-free problems.  Addresses PR/46128 from Andrew Doran.
    Note: PL_PPWAIT should be fully replaced and modificaiton of l_pflag by
    other LWP is undesirable, but this is enough for netbsd-6.

The new version no longer performs unsafe access in l_lflag changing the
LP_VFORKWAIT bit.

Verified with ATF t_vfork and t_ptrace* tests and they are no longer
causing any issues in my local setup.

Fixes PR/46128 by Andrew Doran

(kamil)

fix eager sed that broke xorg_glamor.

(christos)

1. fix /etc/defaults/*.conf files
    a. there are more rc.conf.append arch than only for x86, deal with them too.
    b. populate new /etc/defaults/rc.conf files
2. merge sed patterns
3. deal with empty exclude lists

(christos)

Disable debug output

(martin)

Fix the error handling in ehci_pci_attach(): if we got a USB<2 device we
won't call ehci_init(), so don't call ehci_detach() in ehci_pci_detach().

Fixes a panic seen on a recent Lenovo machine, which has an USB 1.1
controller; ehci_detach() was getting called while 'sc' had not been
completely initialized.

(maxv)

Random style in ehci, also KM_SLEEP does not fail.

(maxv)

Indent consistently. No functional change.

(msaitoh)

Consistency in keyword order and contents:
debug*,xorg -> xorg,debug*
xorg,debug*,*,obsolete -> xorg,obsolete,*

(christos)

add ahcisata at pci

(jmcneill)

When merging existing partitions into our install description, mark
them as to-be-mounted.

(martin)

Do not use dynamic size adjustments on install descriptions based
on existing partitions - we need to keep them fixed to not confuse
free space calculation.

(martin)

Package naming to xbase md files

(uki)

In the new world order disks may come without any partitioning scheme
attached - so the user may have to select one.

(martin)

Modify LAPIC_LVT_CMCI's comment to be consistent with other LVT's.
No functional change.

(msaitoh)

lapic_dump(): Print CMCI and thermal local vector table, too.

(msaitoh)

Whitespace fix. No functional change.

(msaitoh)

Remove GPT and extended partitioning support on size restrained install
media.

(martin)

Remove GPT boot (not available for sparc64 yet)

(martin)

Fix unitialized variable

(martin)

Ooops, fix misaplied patch from ticket #1281

(martin)

No functional change:
- Simplify some code for readability.
- KNF a little.

(msaitoh)

Use armv6_start.S

(hkenken)

make this build and likely work with the new sysinst world order.

(mrg)

Try to load swcrypto if we we did not find any software drivers.

(christos)

don't always panic when modunload crypto (int the pool destroy code, because
the pools are busy). XXX: this is still racy; we need to prevent creating
more sessions while destroying.

(christos)

make pool assertion messages consistent.

(christos)

handle $SOURCEMODE

(christos)

Correct inversed condition for dying process in sigswitch()

If a process is exiting and it was not asked to relock proc_lock, do not
free the mutex as it causes panic. This bug is a timing bug as the faulty
condition is not deterministic and fires only somtimes, but is quickly
triggerable when executed in an infinite loop.

Detected and reported with LLDB test-suite by <mgorny>

(kamil)

Fix typo in comment (missing 'need')

(pgoyette)

Support configuring ranges where only prefetchable memory is defined

(jmcneill)

Use ranges from the device tree.

(jmcneill)

make DPRINTF use varyadic cpp macros, and merge with IPSECLOG.

(christos)

fix typo in comment, improve error message, add default case handling to
set error.

(christos)

Add missing npf.boot.conf

(christos)

Allow set_affinity calls before PEs are brought online. We store the
desired target PE if set_affinity is called early and restore the routes
when the PE comes alive.

(jmcneill)

Remove hard-coded lists of rc files and generate them dynamically from the
sets. Fixes issues with automount, npf_boot etc. that were never updated here!

(christos)

Add new ATF ptrace(2) tests for posix_spawn, reusing tests for fork/vfork

New tests:
- posix_spawn_detach_spawner
- posix_spawn_kill_spawner
- posix_spawn_singalmasked
- posix_spawn_singalignored

All test pass.

(kamil)

Remove unused macro

(maya)

APFS ASR CLI CLS VES XSLT

(sevan)

FRAND RAND

(sevan)

Avoid LOCKDEBUG pserialize panic by implementing suggestion #1 from

    http://mail-index.netbsd.org/current-users/2019/02/24/msg035220.html:

Convert the mutex to spin-lock at IPL_NET (but it is excessive) and
convert the memory allocations in that code path to KM_NOSLEEP.

(christos)

Add missing address check. This broke things like:

crash -w
w /l ipsec_debug 1

with an invalid address, because it found the first readonly segment and
returned EFAULT. I guess this never worked properly, but this got exposed
when maxv made text and rodata actually R/O?

(christos)

Remove superfluous Pp.

(wiz)

Fill silence if the last block of the first track is not filled.

(isaki)

Describe about get_props() properties.

(isaki)

Fix typo.

(wiz)

Fix typo.

(wiz)

Try to make posix_spawn(3) note in ptrace(2) less confusing

(kamil)

Rephrase sentence about vfork+exec in posix_spawn(3)

Try to make it less confusing.

Requested by <joerg>

(kamil)

Missing files from commit for ticket #1280:

        sys/arch/x86/x86/hypervvar.h: revision 1.1
        sys/dev/hyperv/genfb_vmbus.c: revision 1.1
        sys/dev/hyperv/genfb_vmbusvar.h: revision 1.1
        sys/dev/hyperv/hvkbd.c: revision 1.1
        sys/dev/hyperv/hvkbdvar.h: revision 1.1

Added drivers for Hyper-V Synthetic Keyboard and Video device.

Avoid undefined reference to `hyperv_guid_video' without vmbus(4).

Avoid undefined reference to `hyperv_is_gen1' without hyperv(4).

Use efi_probe().

(martin)

revert rev 1.4:
>Adjust priority mappings, NFCI

it has some unintended change that makes nvme hangy.  ok @jmcneill.

(mrg)

Tickets #1280 and #1281

(martin)

Pull up the following revisions (via patch) requested by mrg in ticket #1281:

libexec/httpd/CHANGES 1.31-1.40
libexec/httpd/Makefile 1.28
libexec/httpd/auth-bozo.c 1.23-1.24
libexec/httpd/bozohttpd.8 1.75-1.79
libexec/httpd/bozohttpd.c 1.100-1.113
libexec/httpd/bozohttpd.h 1.58-1.60
libexec/httpd/cgi-bozo.c 1.46-1.48
libexec/httpd/daemon-bozo.c 1.20-1.21
libexec/httpd/dir-index-bozo.c 1.29-1.32
libexec/httpd/ssl-bozo.c 1.26
libexec/httpd/testsuite/Makefile 1.12-1.13
libexec/httpd/testsuite/t11.out 1.2
libexec/httpd/testsuite/test-bigfile 1.6
libexec/httpd/testsuite/test-simple 1.6

Don't display special files in the directory index.  They aren't
served, but links to them are generated.
---
All from "Rajeev V. Pillai" <rajeev_v_pillai@yahoo.com>:
- use html tables for directory index.
- don't include "index.html" in html headers
- additional escaping of names
- re-add top/bottom borders
- adds an aquamarine table header
- Zebra-stripes table rows using CSS instead of code
- fix CGI '+' param and error handling.
- remove unused parameter to daemon_poll_err().
- avoid sign extension in % handling
fix a few problems pointed out by clang static analyzer:
- bozostrnsep() may return with "in = NULL", so check for it.
- nul terminating in bozo_escape_rfc3986() can be simpler
- don't use uniinit variables in check_remap()
- don't use re-used freed data in check_virtual().
- fix bozoprefs->size setting when increasing the size (new total was
  being added to the prior total.)
  however, bozostrdup() may reference request->hr_file.
---
Add ssl specific timeout value (30s).  If SSL_accept() doesn't
work with in this timeout value, ssl setup now fails.
---
Fix handling of bozo_set_timeout() timeouts (and `-T' option parsing)
---
Avoid .htpasswd exposure to authenticated users when .htpasswd is
in the slashdir too.
---
Avoid possible NULL dereference when sending a big request that timeout.
---
Use strings.h for strcasecmp (on linux)
---
Account for cgihandler being set when counting the number of CGI environment
headers we are about to set. Avoids an assertion failure (and overruninng
the array) later.

(martin)

Revert "Route all interrupts to the primary PE by default"

(jmcneill)

Print interrupt details

(skrll)

Pull up following revision(s) (requested by nonaka in ticket #1280):

sys/arch/x86/x86/consinit.c: revision 1.29
sys/dev/hyperv/vmbusvar.h: revision 1.2
sys/dev/hyperv/genfb_vmbusvar.h: revision 1.1
sys/arch/x86/x86/x86_autoconf.c: revision 1.78
sys/arch/x86/x86/identcpu.c: revision 1.91
sys/arch/x86/x86/hyperv.c: revision 1.2
sys/arch/x86/x86/hyperv.c: revision 1.3
sys/arch/x86/x86/hyperv.c: revision 1.4
sys/arch/i386/conf/GENERIC: revision 1.1207
sys/dev/wscons/wsconsio.h: revision 1.123
sys/arch/x86/x86/hypervvar.h: revision 1.1
sys/arch/amd64/conf/GENERIC: revision 1.528
sys/dev/hyperv/files.hyperv: revision 1.2
sys/arch/x86/include/autoconf.h: revision 1.6
sys/dev/hyperv/hyperv_common.c: revision 1.2
sys/arch/xen/x86/autoconf.c: revision 1.23
sys/arch/x86/pci/pci_machdep.c: revision 1.86
sys/dev/hyperv/hvkbd.c: revision 1.1
sys/dev/hyperv/hypervvar.h: revision 1.2
sys/dev/acpi/vmbus_acpi.c: revision 1.2
sys/dev/hyperv/vmbus.c: revision 1.3
sys/dev/hyperv/hvkbdvar.h: revision 1.1
sys/dev/hyperv/genfb_vmbus.c: revision 1.1

Added drivers for Hyper-V Synthetic Keyboard and Video device.

Avoid undefined reference to `hyperv_guid_video' without vmbus(4).

Avoid undefined reference to `hyperv_is_gen1' without hyperv(4).

Use efi_probe().

(martin)

Trailing whitespace

(skrll)

Add rkpcie, rkpciephy

(jmcneill)

Enable RK3399 PCIe.

(jmcneill)

Use Xr.

(wiz)

Route all interrupts to the primary PE by default

(jmcneill)

Adjust priority mappings, NFCI

(jmcneill)

Fail gracefully if gicv3_its_set_affinity is called before a cpu is
brought online.

(jmcneill)

move creds_msdos.8 into the normal place and install it.

(mrg)

Comment fix

(skrll)

Debug output improvement

(skrll)

Rework internal data structures and "interfaces to user interface" functions
to get rid of all disklabel assumptions.

Previously (even for GPT partitioning) struct disklabel was used, which
obviously breaks large disk setups. Also many MD parts and parts of the
user interface assumed (a) a struct disklabel is used internally to
store partitioning information and (b) partitions are named 'a' ... $MAXPART.

Get rid of this and replace it with a quite abstract interface that should
be able to deal with all variants in partition storage:

- partitions are stored in a (partly abstract) struct disk_partitions
  and most parts of it are only accessed via accessor functions provided
  by a "partitioning scheme".

- implement partitioning schemes for MBR, disklabel and GPT (with likely
  RDB [amiga] and Apple Partition Map [mac*] to follow soon)

- partitioning schemes may be cascaded, e.g. on x86 when using MBR as
  "outer partitions", we have disklabel as "inner partitions".

- all user interface goes via accessor functions in the partitioning scheme,
  some of which return pointers to special user interface descriptors
  (e.g. to allow editing partition flags, which are scheme specific)

Overall the user interface changes (in this initial step) are minimal but
noticable. A new Anita is needed for automatic test setups - many thanks
to Andreas Gustafsson for lots of early testing and a new Anita version,
and to Manuel Bouyer for cooperation and tests of the Anita release.

This work was sponsored by The NetBSD Foundation, Inc.

(martin)

Fix build with -Wgnu-designator in the ZFS code

struct buf buf = { b_bcount: MAXPHYS }; is a legacy style designator
extension and this raised a compiler error reported by a.rin@mix.

(kamil)

update this to as much reality of 2019 as i can find on the web.

(mrg)

various cleanups inspired by reviews:
- clean up variable usage
- be explicit that $ssh_userkeys is global
- don't assig id output to a variable not used

(mrg)

Print ICH/PCH's NVM version.

(msaitoh)

Fix double free: key_setsaval() free's newsav by calling key_freesaval()
and key_api_update() calls key_delsav() when key_setsaval() fails which
calls key_freesaval() again...

(christos)

explicitly strip carriage return so that non-unix text files work.

(mrg)

Document that posix_spawn(3) uses a dedicated syscall

vfork+exec operations are done in one go. This is important information for
programs that wrap posix_spawn(3).

(kamil)

Add new PTRACE_POSIX_SPAWN tests in ptrace(3)

Add test:
- eventmask_preserved_posix_spawn
- fork9..fork16
- vfork9..vfork16
- posix_spawn1..16

New tests verify semantics of PTRACE_POSIX_SPAWN.

All tests pass.

(kamil)

Document PTRACE_POSIX_SPAWN in man-page

(kamil)

Welcome to 8.99.44!

posix_spawn(3) + ptrace(2) integration changed 'struct proc'.

(kamil)

Add support for PTRACE_POSIX_SPAWN to report posix_spawn(3) events

posix_spawn(3) is a first class syscall in NetBSD, different to
(V)FORK+EXEC as these operations are executed in one go. This differs to
Linux and FreeBSD, where posix_spawn(3) is implemented with existing kernel
primitives (clone(2), vfork(2), exec(3)) inside libc.

Typically LLDB and GDB software is aware of FORK/VFORK events. As discussed
with the LLDB community, instead of slicing the posix_spawn(3) operation
into phases emulating (V)FORK+EXEC(+VFORK_DONE) and returning intermediate
state to the debugger, that might have abnormal state, introduce new event
type: PTRACE_POSIX_SPAWN.

A debugger implementor can easily map it into existing fork+exec semantics
or treat as a distinct event.

There is no functional change for existing debuggers as there was no
support for reporting posix_spawn(3) events on the kernel side.

(kamil)

MRO

(sevan)

Typo, also fix copy & pasted license

(martin)

Improve error message

(pgoyette)

Need rumpdev_disk for rumpfs_zfs.

(hannken)

Initial commit of FDTised Xilinx Zynq-7000 support.  Tested with

qemu-system-arm -M xilinx-zynq-a9 -dtb zynq-zed.dtb -kernel netbsd.ub \
    -serial /dev/null -serial stdio

Based on a set of diffs/files from rjs@

sys/arch/arm/zynq is kept in place to allow existing kernels (e.g.
ZEDBOARD and PARALLELLA) to continue to build/work during the transition,
but eventually sys/arch/arm/zynq will be deleted.

(skrll)

Add a help script to check for untranslated messages

(martin)

Quote the name "Ed" to avoid confusion with the macro "Ed".

(wiz)

Trailing whitespace

(skrll)

Correct outdated note that posix_spawn(3) is implemented with vfork(2)

The original FreeBSD libc code uses vfork(2), it's not the case for NetBSD
as there is a dedicated kernel syscall.

(kamil)

Use more markup, fix some typos.

(wiz)

add a method to add user accounts or ssh keys to the embedded
(installable) images which may be run entirely headless and
have no current method to edit the installation without another
netbsd host to modify the root (FFS) partition.

creds_msdos reads the creds.txt file from the msdos boot
partition and provides 4 basic methods:

sshkeyfile <user> <path on msdos>
sshkey <user> <entry>
useraddhash <user> <passwd hash>
useradd <user> <passwd>

the first two create a user with ssh key(s), and the second
two create a user with a password.  if the last method is used
and raw passwords are given, the creds.txt file will be
shredded and deleted by rm -P.

inspired by a request from a pine64 user.  ok jmcneill@.

(mrg)

Fixed bug in curses library keyname, test now passes.

(blymn)

Bracket strings being validated with markers to ensure sneaky whitespeace
is noticed.

(blymn)

Fix typo for unknown key keyname return.

(blymn)

There is no 1:1 relation between cv_signal() and cv_timedwait() as
the latter implicitly calls cv_signal() on error.

This leads to "tq_waiting > 0" with "tq_running == 0" and the
taskq stalls.

Change task_executor() to increment and decrement "tq_waiting"
and always check and run the queue after cv_timedwait().

Use mstohz(), fix timeout and sort includes.

Addresses PR port-xen/54273: "zpool create pool xbd2" panics DOMU kernel

(hannken)

Try to retrieve the per-disk maximum transfer size and use it instead
of MAXPHYS.  Eagerly waiting for the merge of tls-maxphys.

Addresses PR port-xen/54273: "zpool create pool xbd2" panics DOMU kernel

(hannken)

In the "got %d/%d" message printed at the end of the pingsize test,
make the latter number show the actual number of ICMP packets the test
attempted to send.  Thus, the two numbers can now be meaningfully
compared, and their difference indicates the number of packets lost.

(gson)

Fix dupwin test.

(blymn)

fix derwin test.

(blymn)

turn on MKLLVMRT for aarch64 X11 builds.

with llvmpipe vs swrast, on pinebook 1080p i see 6x speed up for glxgears,
seamonkey & google maps is significantly faster, and ksudoku is workable.

(mrg)

Add posix_spawn(3) ATF tests in t_ptrace_wait*

New tests verify whether forking process reports forking events to a
debugger.

Right now there is no support in the kernel for this system.

(kamil)

Sync with HEAD

(christos)

Add more verbosity to debug messages in t_ptrace_wait

Log func() file:line for each debug message.

Most messages are similar one with the other and this change allows easier
navigation in the code.

(kamil)

Use AUDIO_SCALEDOWN() macro rather than seemingly strange ifdefs.
Discussed on source-changes-d.

(isaki)

Add missing newline to some error messages.

(isaki)

Call get_props() once at attach.

(isaki)

it's html not himl.  should fix build.

(mrg)

since uvm_faut() will fail if cache maintain instructions (e.g., "dc cvau".
that has ESR.WnR=1 = write access) for a read only page causes a data abort trap,
It shoulde be treat the access type as read access in a data abort with
cache operation (ESR_ISS_DATAABORT_CM=1)

pointed out and tested by mrg@. thanks

(ryo)

mark several things that are only built with MKLLVMRT=yes with 'llvmrt'.

from kre.

(mrg)

shmctl(SHM_LOCK) does not need to mess with mappings of the shm segment,
uvm_obj_wirepages() is sufficient.  this fixes the problem reported in
https://syzkaller.appspot.com/bug?id=71f9271d761f5b6ed517a18030dc04f0135e6179

(chs)

merge conflicts, regen man pages.

(christos)

new openssl

(christos)

new openssl man page

(christos)

Init bpll in a way that brings the big cluster's PLL out of "slow mode".
While here, fix a few typos in the cpul's rate table.

(jmcneill)

fix format

(christos)

make this compile again without ddb

(christos)

rearrange some parts of attach/detach to avoid partial-attach
leading to detach crash.

(mrg)

Add a script that allows a check file to be created by cutting and
pasting the contents of the square brackets in the "Excess nn bytes
from slave" message emitted when the director is running in verbose
mode (-v).

(blymn)

Adjust check files for changes in cursor positioning.

(blymn)