mark failed

(christos)

should terminate and does with ktrace, but it does not normally.

(christos)

Now add the file I really meant to add.

(christos)

revert copyright change.

(christos)

more tests

(christos)

Correctly report memory size, not clock rate when VERBOSE_INIT_ARM.

(rin)

rumpdefs.h, rumperr.h and rumperrno2host.h are generated from makerumpdefs.sh.
Don't edit those files directly. Use __inline instead of inline in the
script file. OK'd by christos.

(msaitoh)

Need to keep track of the requested size, when realloc is used under kASan.
Maybe we could use mh_rqsz by default.

(maxv)

There is no possible reason that <sys/asan.h> can be useful to
userland, all it contains is a few prototypes for kernel functions.
So, don't install asan.h in /usr/include/sys (if it ever gains
anything which would be useful, then this can be changed).

Note: I have simply removed /usr/includ/esys/asan.hit from the sets
list, rather than marking it obsolete - it has not been there for
very long, If you get build problems (sets list errors) from an
update build because you managed to install it during the last few
hours, just remove asan.h from /usr/include/sys

(kre)

Revert previous - it was wrong, and on the wrong branch!

(pgoyette)

Add the new sys/kasan.h to the distrib sets lists

(pgoyette)

Add the new sys/kasan.h to the distrib sets lists

Finish fixing the build.

(pgoyette)

Conditionalize inclusion of kasan.h so that rump can build.

(pgoyette)

Fix cvs id.

(rjs)

Use __SHIFTOUT to extract MPIDR affinity levels

(jmcneill)

Add support for kASan on amd64. Written by me, with some parts inspired
from Siddharth Muralee's initial work. This feature can detect several
kinds of memory bugs, and it's an excellent feature.

It can be enabled by uncommenting these three lines in GENERIC:

#makeoptions KASAN=1 # Kernel Address Sanitizer
#options KASAN
#no options SVS

The kernel is compiled without SVS, without DMAP and without PCPU area.
A shadow area is created at boot time, and it can cover the upper 128TB
of the address space. This area is populated gradually as we allocate
memory. With this design the memory consumption is kept at its lowest
level.

The compiler calls the __asan_* functions each time a memory access is
done. We verify whether this access is legal by looking at the shadow
area.

We declare our own special memcpy/memset/etc functions, because the
compiler's builtins don't add the __asan_* instrumentation.

Initially all the mappings are marked as valid. During dynamic
allocations, we add a redzone, which we mark as invalid. Any access on
it will trigger a kASan error message. Additionally, the compiler adds
a redzone on global variables, and we mark these redzones as invalid too.
The illegal-access detection works with a 1-byte granularity.

For now, we cover three areas:

- global variables
- kmem_alloc-ated areas
- malloc-ated areas

More will come, but that's a good start.

(maxv)

Clarify reference counting of uvm_map.

(riastradh)

Clarify that bus_dmamem_alloc boundary can be zero for no constraint.

(riastradh)

Compute the pointer earlier, not in the return statement. No functional
change.

(maxv)

Retire KMEM_REDZONE and KMEM_POISON.

KMEM_REDZONE is not very efficient and cannot detect read overflows. KASAN
can, and will be used instead.

KMEM_POISON is enabled along with KMEM_GUARD, but it is redundant, since
the latter can detect read UAFs contrary to the former. In fact maybe
KMEM_GUARD should be retired too, because there are many cases where it
doesn't apply.

Simplifies the code.

(maxv)

Note import of dhcpcd-7.0.8

(roy)

Sync

(roy)

make sure that nbtools_compat.h is the first thing included for generated files

(christos)

avoid redefinition of the package macros.

(christos)

PR toolchain/53511

_NETBSD_SOURCE and nbtool_config.h don't play well together...
(unbreak tools build on netbsd host)

(kre)

Allow this to compile on NetBSD

(jmcneill)

OK'd by maxv:
- Add cpuid 7 edx L1D_FLUSH bit.
- Add IA32_ARCH_SKIP_L1DFL_VMENTRY bit.
- Add IA32_FLUSH_CMD MSR.

(msaitoh)

PR/53511: Palle Lyckegaard: Fix compiling flex on a Solaris 11 host system

(christos)

Avoid uninitialized warning.

(christos)

expat-2.2.6 out

(wiz)

Suspend the getrfkill thread while we're suspended.

Otherwise it tries to futz with device registers, which doesn't work,
and who knows, maybe is bad.

(riastradh)

What we have created, we must destroy.

(riastradh)

PR bin/48875 (is related, and ameliorated, but not exactly "fixed")

Import a whole set of tree evaluation enhancements from FreeBSD.

With these, before forking, the shell predicts (often) when all it will
have to do after forking (in the parent) is wait for the child and then
exit with the status from the child, and in such a case simply does not
fork, but rather allows the child to take over the parent's role.

This turns out to handle the particular test case from PR bin/48875 in
such a way that it works as hoped, rather than as it did (the delay there
was caused by an extra copy of the shell hanging around waiting for the
background child to complete ... and keeping the command substitution
stdout open, so the "real" parent had to wait in case more output appeared).

As part of doing this, redirection processing for compound commands gets
moved out of evalsubshell() and into a new evalredir(), which allows us
to properly handle errors occurring while performing those redirects,
and not mishandle (as in simply forget) fd's which had been moved out
of the way temporarily.

evaltree() has its degree of recursion reduced by making it loop to
handle the subsequent operation: that is instead of (for any binop
like ';' '&&' (etc)) where it used to
evaltree(node->left);
evaltree(node->right);
return;
it now does (kind of)
next = node;
while ((node = next) != NULL) {
next = NULL;

if (node is a binary op) {
evaltree(node->left);
if appropriate /* if && test for success, etc */
next = node->right;
continue;
}
/* similar for loops, etc */
}
which can be a good saving, as while the left side (now) tends to be
(usually) a simple (or simpleish) command, the right side can be many
commands (in a command sequence like a; b; c; d; ...  the node at the
top of the tree will now have "a" as its left node, and the tree for
b; c; d; ... as its right node - until now everything was evaluated
recursively so it made no difference, and the tree was constructed
the other way).

if/while/... statements are done similarly, recurse to evaluate the
condition, then if the (or one of the) body parts is to be evaluated,
set next to that, and loop (previously it recursed).

There is more to do in this area (particularly in the way that case
statements are processed - we can avoid recursion there as well) but
that can wait for another day.

While doing all of this we keep much better track of when the shell is
just going to exit once the current tree is evaluated (with a new
predicate at_eof() to tell us that we have, for sure, reached the end
of the input stream, that is, this shell will, for certain, not be reading
more command input) and use that info to avoid unneeded forks.  For that
we also need another new predicate (have_traps()) to determine of there
are any caught traps which might occur - if there are, we need to remain
to (potentially) handle them, so these optimisations will not occur (to
make the issue in PR 48875 appear again, run the same code, but with a
trap set to execute some code when a signal (or EXIT) occurs - note that
the trap must be set in the appropriate level of sub-shell to have this
effect, any caught traps are cleared in a subshell whenever one is created).

There is still work to be done to handle traps properly, whatever
weirdness they do (some of which is related to some of this.)

These changes do not need man page updates, but 48875 does - an update
to sh.1 will be forthcoming once it is decided what it should say...

Once again, all the heavy lifting for this set of changes comes directly
(with thanks) from the FreeBSD shell.

XXX pullup-8 (but not very soon)

(kre)

show correct relocation address when overflowed.

(ryo)

Handle p->p_mqueue_cnt in a symmetric manner.

While this change does mean that each open mqd_t counts against the
limit, it also means that p_mqueue_cnt will never wrap below 0.

Discovered by the Rust nix crate test suite.  It opens the same mq twice
(once for writes, once for reads), and then proceeds to close each of
them, which resulted in p_mqueue_cnt wrapping to (u_int)-1, preventing
the process from opening any more mqueues, and all subsequent
mq(3)-related tests to fail.

(jakllsch)

Remove FloatToString from NetBSD build since it uses float/double

(jmcneill)

PR bin/48875

Revert the changes that were made 19 May 2016 (principally eval.c 1.125)
and the bug fixes in subsequent days (eval.c 1.126 and 1.127) and also
update some newer code that was added more recently which acted in
accordance with those changes (make that code be as it would have been
if the changes now being reverted had never been made).

While the changes made did solve the problem, in a sense, they were
never correct (see the PR for some discussion) and it had always been
intended that they be reverted.  However, in practical sh code, no
issues were reported - until just recently - so nothing was done,
until now...

After this commit, the validate_fn_redirects test case of the sh ATF
test t_redir will fail.  In particular, the subtest of that test
case which is described in the source (of the test) as:
This one is the real test for PR bin/48875
will fail.

Alternative changes, not to "fix" the problem in the PR, but to
often avoid it will be coming very soon - after which that ATF
test will succeed again.

XXX pullup-8

(kre)

NFC: DEBUG mode only change.  When tracing, show >&- as ">&-"
rather than ">&-1" (the same op as >&n where internally n < 0
means "close")

(kre)

fix a bug in the previous change: don't hide the break; behind DEBUG_EXEC.
should fix PR#53538.  tested on erlite.

(mrg)

3RDPARTY: latest Mesa actually is 8.1.6 for now.

(wiz)

Clean up leftover when converting intr_establish() to fdtbus_intr_establish().
The latter accept only flags 0 or FDT_INTR_MPSAFE. For both cases, it add
IST_LEVEL flag for underlying intr_establish() function.

OK skrll

(rin)

Commit work in progress GENERIC configuration without the other necessary
changes at this point

(skrll)

Some changes to bring back exynos4 support and make exynos5 support more
modern/generic

- Provide a exynos_platform_early_putchar based on CONSADDR and remove
  EXYNOS_CONSOLE_EARLY
- Provide devmaps for exynos4 and exynos5
- Simplify exynos_bootstrap
- Update exynos_start.S to use exynos_platform_early_putchar - this
  needs a fix in a9_subr.S for arm_cpuinit to save lr in a callee save
  register and not use ip.  Maybe this change is safe now, but too much
  testing required to commit it now.

(skrll)

Drop a duplicate instruction line

No functional change intended.

(kamil)

This makes no sense static.  (Can't break unused code anyway!)

(riastradh)

Revert previous and do it the way it is supposed to be done.
Thanks to the heads up from rjs@

(kre)

Use sys/stdint.h instead of stdint.h on NetBSD

(jmcneill)

Allow the symbols in the newly added conf_ssl.c to be exposed as globals.

(kre)

Add conf_ssl.c to build.

(rjs)

More fallout from new gnu-efi ... EFI_SIMPLE_NETWORK_PROTOCOL
is now EFI_SIMPLE_NETWORK_PROTOCOL_GUID

(kre)

mention acpica 20180810

(christos)

merge conflicts

(christos)

use the right variables (fix cut-n-pastos)

(christos)

make sure rid and idx are initialized.

(christos)

vdev_inuse might not be called and spare_guid contains random stuff.

(christos)

remove NOGCCERROR; hides real issues.

(christos)

G/C

(skrll)

Note EARLYCONS in comment

(skrll)

Fix a bug introduced in the previous revision;
We don't define arm32 anywhere, and majors.aarch64 is used unconditionally.

(rin)

OpenSSL 1.1.0i

(christos)

merge conflicts

(christos)

Simplify the conditions. Fixes compilation of native amd64 without direct
map.

(maxv)

More gnu-efi update fallout ... the symbol EFI_SIMPLE_NETWORK_PROTOCOL
has been replaced with EFI_SIMPLE_NETWORK_PROTOCOL_GUID and the old
one (EFI_SIMPLE_NETWORK_PROTOCOL) is now something completely different.

Adapt...  (should help the ia64 build)

(kre)

In the older debug code (not using the new macros added in the
previous rev) the two values (node name, and node number) were
arbitrarily printed in different formats and orders (depending
upon my mood at the time I guess...)  The new macros will standardise
that usage (in the debug output) once some use of them actually begins.

When the macros were added, I arbitrarily copied the format of one
use I was looking at at that instant (the one which inspired the change),
but after gazing at DEBUG mode output over the intervening time, I
have concluded that I did not pick the easiest to read/follow format.

So, even before they are used, change the style...    Also, conform
to standard PRIxxxx macro style by omitting the leading '%'.

NFC (since they aren't used at all, anywhere, yet, not even the
possibility of anything changing!)

(kre)

Start using the kernel ld script.

There are still issues with the .init placement and ./build.sh creating bad
images.

(reinoud)

- add some G5-specific setup
- OF_claim() more heap space on G5
With this, and -DHEAP_VARIABLE my G5s boot from harddisk

(macallan)

parse G5 device paths

(macallan)

Fix build the easiest way...

Restructure to allow generic builds will come later.

(skrll)

Remove big outdated comment, remove unused macros, remove XXX that has
nothing to do here, style.

(maxv)

Whitespace

(skrll)

Add a deprecation note in each of the PF man pages (instead of just pf.4),
so that it's really clear.

(maxv)

Add the values of "algo" in the grammar, and use # as comment marker for
man-k.org (and others) not to highlight things in an incorrect way.

(maxv)

Add missing quote in static-rule, it causes man-k.org (and other tools)
to wrongly highlight the grammar.

(maxv)

Replace "rproc"->"proc" in the grammar (spotted by he@), and slightly
reword.

(maxv)

Replace () by [] in tcp-flags.

Fix proc-opts, the value is optional, noted by he@.

(maxv)

Deal with gnu-efi upgrade - "efilib.h" now provides a prototype
for VPrint() so it is no longer needed here, particularly not a
slightly different prototype.  Fixes the amd64 i386 & ia64 builds.

(kre)

gnu-efi: Import version 3.0.8.

(jmcneill)

gnu-efi 3.0.8 has been imported

(jmcneill)

No need for private versions of memset/memcpy on NetBSD

(jmcneill)

Rename ALIGN macro to EFI_ALIGN

(jmcneill)

Merge conflicts

(jmcneill)

libisccfg uses libdns...

(christos)

NFC - a build structure code layout change only.

This generates nodenames.h which is a file that used to begin
#ifdef DEBUG
(line 1) and end with
#endif
(last line) with no intervening (matching) #else ... ie: for DEBUG use only.

That led to situations where non-debug code would like to make use
of the info provided, if DEBUG was enabled, needed to add #ifdef DEBUG
at the point of use.

Avoid that by providing new macros that are always defined (DEBUG or not,
so now we have a #else) which allow code to be written to make use of
the extra DEBUG info, if it is available, or not, if not.

While here, add double-include protection on the generated .h file
(just being cautious - nothing is ever going to cause it to get
included anywhere twice - or it shouldn't) and add the traditional
comments on the #else and #endif stuff (which is also really useless
as no-one is really expected to ever read the generated file).  Never mind.

Nothing yet (elsewhere in the sh source) uses the new macros, so there's
even less chance of this changing anything than there would otherwise be.

(kre)

get rid of kernelbase

(christos)

Try freebsd's pkg-info as well

From John Hein, via Nikolai Lifanov. PR misc/52684

(maya)

add strncasecmp

(christos)

toolify.

(christos)

From FreeBSD:

When using WPA2, EAPOL-Key frames with the Encrypted flag and without the MIC
flag set, the data field was decrypted first without verifying the MIC.  When
the dta field was encrypted using RC4, for example, when negotiating TKIP as
a pairwise cipher, the unauthenticated but decrypted data was subsequently
processed.  This opened wpa_supplicant(8) to abuse by decryption and recovery
of sensitive information contained in EAPOL-Key messages.

See https://w1.fi/security/2018-1/unauthenticated-eapol-key-decryption.txt
for a detailed description of the bug.

XXX: pullup-8

(christos)

Remove extra slash in path
Update MesaDemos path
More version info for components in our tree

(sevan)

Improve wording.

(maxv)

Improve the "Map" section a little.

(maxv)

Document the "flags" keyword.

(maxv)

Improve the "Rules" section: better explain the "final" keyword (it is
the same as PF's "quick", so use the same wording), and document the
"return" options.

While here simplify the man code, suggested by wiz.

(maxv)

Add quotes around the option names, to match the actual npf conf.

(maxv)

Enlighten the "Procedures" section. In particular document the "no-df"
option. Also replace "normalisation" -> "normalization", to match the
name of the rule.

(maxv)

mandoc_xr.c is now in libmandoc (where it should be) it no longer
needs to be here (why having it broke building I did not look to see,
it should be possible to replace a file from a library).

(kre)

In the latest mandoc (mdocml) the signature (prototype) of
mparse_alloc() altered - update the call here to compensate.

This fixes the build (of makemandb), but I am not sure that
the changed version is what is desired - someone who knows
something about all of this should validate ... I just copied
the invocation from mandoc's demandoc.c (which seems likely
to be at least a similar kind of usage).

(kre)

mandoc needs mandoc_xr.c and (because we do not have it in libc, which
should remain the state forever IMO) compat_recallocarray.c

And now that compat_recallocarray() is in libmandoc we no longer
need to manually add its source to mandoc (either the full, or the
tools builds).

(kre)

man_term.c needs -Wno-error=array-bounds for the exact same reason
as libmandoc/mandoc-validate.c

And as we do not have recallocarray() in libc, we need the compat
source file for the full build, as well as for tools builds.

(kre)

mandoc-validate.c cannot deal with -Werror=array-bounds so disable it.
The code could probably be redone to not need this, but this is the
simple fix (and requires no upstream co-ordination)

(kre)

Add recallocarray prototype.

(nakayama)

Final changes for 200 hour contract.  Still a lot of work to do.
With these changes, Station mode works with an open AP.

(phil)

Update version info for our versions of bozohttpd & bsd-family-tree.

(sevan)

fix comment

(jdolecek)

Sync with FreeBSD

(sevan)

minor KNF

(jdolecek)

mark XXXSMP also wakeup() calls

(jdolecek)

(sevan)

Expose re{c,}allocarray decls in current.

(christos)

More version updates
Switch sljit from svn rev to current release
Add urls for smbfs, timeout, libproc, librtld_db, netcat

(sevan)

Tickets #973, #974, #975 and #976

(martin)

Pull up following revision(s) (requested by ozaki-r in ticket #975):

sys/netinet6/nd6_rtr.c: revision 1.144

Don't call find_pfxlist_reachable_router, which may sleep, in a
pserialize read section

Found by knakahara@

(martin)

Pull up following revision(s) (requested by ozaki-r in ticket #974):

sys/net/if_tun.c: revision 1.145
sys/net/if_tun.c: revision 1.146

tun: fix locking against myself

filt_tunread is called with tun_lock held from tun_output (via tun_output =>
selnotify => knote), so we must not take tun_lock in filt_tunread.  The bug
is triggered only if a tun is used through kqueue.

Found by k-goda@IIJ

Fix tun(4) kevent locking

filt_tunread gets called in two contexts:
- by calls to selnotify in if_tun.c (or knote, as the case may be,
  but not here), in which case tp->tun_lock is held; and
- by internal logic in kevent, in which tp->tun_lock is not held.

The standard convention to discriminate between these two cases is by
setting the kernel-only NOTE_SUBMIT bit in the hint to selnotify or
knote; then in filt_*:

        if (hint & NOTE_SUBMIT)
                KASSERT(mutex_owned(&tp->tun_lock));
        else
                mutex_enter(&tp->tun_lock);
        ...
        if (hint & NOTE_SUBMIT)
                KASSERT(mutex_owned(&tp->tun_lock));
        else
                mutex_exit(&tp->tun_lock);

Pointed out by and patch from riastradh@
Tested by ozaki-r@ (only the former path)

(martin)

Pull up following revision(s) (requested by dolecek in ticket #973):

sys/arch/xen/xen/xennetback_xenbus.c: revision 1.68 (patch)

disestablish interrupt handler regardless of the state whenever it was
setup, i.e. also when the instance is DISCONNECTING already
fixes PR port-xen/53487 by Bert Kiers; fix found and reported by
Dennis Lindroos

XXX pullup netbsd-8

(martin)

fix typo in comment

(ryo)

MODULAR support

(ryo)

fix relocation type. 277 is R_AARCH64_ADD_ABS_LO12_NC

(ryo)

PR standards/53525: move getsubopt to stdlib.h

(martin)

PR standards/53525: move getsubopt() to stdlib.h

(martin)

add missing compat_recallocarray.c to the HOSTPROG part.

(mrg)

On train to Cambridge for BSDCam
More upstream version updates.
code.google.com urls for Kyua are dead and now redirects to github repo.

(sevan)

Remove useless header arm/broadcom/bcm2835reg.h

From Aymeric Vincent on port-arm

(skrll)

G/C

(skrll)

Some CPU specific ACTLR bit definitions

(skrll)

KNF

(skrll)

Fix includes (sys/cdefs.h then sys/param.h)

(skrll)

Sprinkle #include "opt_cputypes.h"

(skrll)

sort #include "opt_..." entries

(skrll)

sort #include "opt_..." entries

(skrll)

Add __KERNEL_RCSID

(skrll)

Resolve every route(4) message type before printing anything more about it
other than the type and length.

This solves the issue where RTM_ONEWADDR is received and it tries to
parse route information from it.

(roy)

Note removal of etherip, add entry about ASLR in amd64, and improve the
ipkdb entry.

(maxv)

Initialize n before mtrr_set in arch_phys_wc_del.

From mrg@.

XXX pullup-7
XXX pullup-8

(riastradh)

Exit, don't reenter, the mutex...!@#*@$!&.

From mrg@.

XXX pullup-7
XXX pullup-8

(riastradh)

Retire EtherIP, we have L2TP instead.

(maxv)

Fix gcc build when MKCOMPAT=no.

(rjs)

Ticket #1630

(martin)

Pull up following revision(s) (requested by maxv in ticket #1630):

sys/netinet6/frag6.c: revision 1.64

Kick zero-sized fragments. We can't allow them to enter; two fragments
could be put at the same offset.

(martin)

Ticket #1630

(martin)

Pull up following revision(s) (requested by maxv in ticket #1630):

sys/netinet6/frag6.c: revision 1.64

Kick zero-sized fragments. We can't allow them to enter; two fragments
could be put at the same offset.

(martin)

Ticket #1630

(martin)

Pull up following revision(s) (requested by maxv in ticket #1630):

sys/netinet6/frag6.c: revision 1.64

Kick zero-sized fragments. We can't allow them to enter; two fragments
could be put at the same offset.

(martin)

Regen for ticket #1628

(martin)

PR bin/42184 PR bin/52687  (detailing the same bug).

Fix "command not found" handling so that the error message
goes to stderr (after any redirections are applied).

More importantly, in

foo > /tmp/junk

/tmp/junk should be created, before any attempt is made
to execute (the assumed non-existing) "foo".

All this was always true for any command (not found command)
containing a / in its name

foo/bar >/tmp/junk  2>>/tmp/errs

would have created /tmp/junk, then complained (in /tmp/errs)
about foo/bar not being found.  Now that happens for ordinary
commands as well.

The fix (which I found when I saw differences between our
code and FreeBSD's, where, for the benefit of PR 42184,
this has been fixed, sometime in the past 9 years) is
frighteningly simple.  Simply do not short circuit execution
(or print any error) when the initial lookup fails to
find the command - it will fail anyway when we actually
try running it.  The cost is a (seemingly unnecessary,
except that it really is) fork in this case.

This is what I had been planning, but I expected it would
be much more difficult than it turned out....

XXX pullup-8

(kre)

remove stray "fi" to unbreak build

(gson)

prepend libns

(christos)

prepend libns

(christos)

make things compile.

(christos)

new mdocml

(christos)

merge conflicts

(christos)

Replace references to etherip by l2tp. Etherip was already not enabled
anyway.

(maxv)

Sort SEE ALSO.

(wiz)

Remove superfluous Pps.

(wiz)

Replace etherip by l2tp in the "see also" sections.

(maxv)

Enlighten a little.

(maxv)

Enable L2TP on all x86 configurations, not just native amd64.

(maxv)

no need machine local ddb command pmaphist any more.

(ryo)

Don't call find_pfxlist_reachable_router, which may sleep, in a pserialize read section

Found by knakahara@

(ozaki-r)

Remove Paul Vixie as maintainer, replace with ISC as they are the upstream.

(roy)

Check pserialize_not_in_read_section for adaptive mutexes and rwlocks

The overhead of the checks is not negligible so they're turned on only if both
DEBUG and LOCKDEBUG are enabled.

(ozaki-r)