1
0
mirror of https://git.FreeBSD.org/src.git synced 2024-11-23 07:31:31 +00:00
Commit Graph

5889 Commits

Author SHA1 Message Date
Kyle Evans
160c36eae4 localedata: add some exceptions to utf8proc widths
Hangul Jamo medial vowels and final consonants are reportedly combining
characters that won't take up any columns on their own and should be
reported as zero-width, so add an exception for these as well to reflect
how they work in practice.  This conforms to how other implementations
(e.g., glibc) treat these characters.

Reviewed by:	bapt (earlier version), jkim
Sponsored by:	Klara, Inc.
Differential Revision:	https://reviews.freebsd.org/D47472
2024-11-13 16:12:42 -06:00
Ed Maste
3750ccefb8 Retire MK_PROFILE infrastructure
It was disabled by default in fe52b7f60e.  We planned to (but did not)
remove the option before FreeBSD 14.  Remove it now, for FreeBSD 15.

Relnotes:	Yes
Reviewed by:	imp
Sponsored by:	The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D31558
2024-11-12 12:11:51 -05:00
Vladimir Kondratyev
5036d9652a rtlbtfw: Firmware loader for Realtek 87XX/88XX bluetooth USB adaptors
Firmware files are available in the comms/rtlbt-firmware port.

Sponsored by:	Future Crew LLC
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D46739
2024-11-07 02:30:29 +03:00
Mark Johnston
d14c38ceb8 sys: Avoid relying on pollution from refcount.h
Fix up headers which previously assumed that refcount.h includes
systm.h, and make them more self-contained.  Then, replace the systm.h
include in refcount with kassert.h.

Reviewed by:	imp, kib
MFC after:	1 week
Differential Revision:	https://reviews.freebsd.org/D47450
2024-11-05 18:22:20 +00:00
Jose Luis Duran
9e84289f2c
git-arc: Prefer echo over printf
Prefer echo over printf.  Prevent the newline character from being
translated by using 'blank' instead of 'space' in the re_format.

This change was reviewed in:

https://reviews.freebsd.org/D47289

Committed separately for clarity.

Suggested by:	des
Approved by:	emaste (mentor)
2024-11-05 02:10:16 +00:00
Jose Luis Duran
2377c19a8c
git-arc: Trap on every mktemp
Trap:

- EXIT (0)
- HUP  (1)
- INT  (2)
- QUIT (3)
- TRAP (5)
- USR1 (10)
- TERM (15)

every time mktemp is called to reduce the chances of leaving stray files
or directories with possible sensitive data inside.

We avoid using a template with mktemp, as some operating systems may use
unpredictable base paths by default (macOS).

Suggested by:	des
Reviewed by:	emaste, 0mp, des (earlier), markj
Approved by:	emaste (mentor)
Differential Revision:	https://reviews.freebsd.org/D47289
2024-11-05 02:10:16 +00:00
Jose Luis Duran
019981e00f
git-arc: Fix typo s/Truning/Turning/
While here standardize white space.
No functional change.

Approved by:	emaste (mentor)
2024-11-05 02:10:16 +00:00
Jose Luis Duran
aa90b92ac2
git-arc: Fix find_author() for external users
When an external user submits a review in Phabricator, the find_author()
subroutine may receive the author_name and author_addr as "null" from
the JSON API with git-arc patch.

This "null" string gets tested for length by "[ -n", and returning that
is greater than zero, in other words, the shell does not understand that
"null" means nothing in this case.

Fix it by adding a guard, that sets an empty string when the content is
"null".

While here, standardize the indentation style for find_author()

Reviewed by:	emaste, markj
Approved by:	emaste (mentor)
Differential Revision:	https://reviews.freebsd.org/D46789
2024-11-05 02:10:15 +00:00
Mark Johnston
a0069f16fe tools: Add a couple of utilities which were useful for testing SO_SPLICE
Sponsored by:	Klara, Inc.
Sponsored by:	Stormshield

Differential Revision:	https://reviews.freebsd.org/D47308
2024-11-01 14:02:40 +00:00
Pat Maddox
66a56e411c mfc-candidates: Support GitHub mirror naming conventions
GitHub repository mirrors are named freebsd-src and
freebsd-ports. Additionally, GitHub permits remote URLs with or
without the .git suffix.

Signed-off-by: Pat Maddox <pat@patmaddox.com>
Pull Request: https://github.com/freebsd/freebsd-src/pull/1483
2024-10-31 10:57:31 -04:00
Brooks Davis
50b5a37a12 src.conf.5: LOADER_BIOS_TEXTONLY default change
WITH_LOADER_BIOS_TEXTONLY is now the default so document
WITHOUT_LOADER_BIOS_TEXTONLY.

Fixes:		23dee252da loader: Change this BIOS tradeoff...
2024-10-30 19:35:57 +00:00
Mark Johnston
207ab5f4f1 rc.d/opensm: Only install when MK_OFED_EXTRA is set
opensm itself is only installed when MK_OFED_EXTRA is set, so it only
makes sense for the same to be true of the rc script.

PR:		257646
Reviewed by:	kib
Differential Revision:	https://reviews.freebsd.org/D47313
2024-10-29 13:01:00 +00:00
Wolfram Schneider
9d585fc395 absolute-symlink.sh: check for absolute symlinks on a FreeBSD system
The purpose of this script is to detect absolute symlinks on
a machine, e.g.:

    /etc/localtime -> /usr/share/zoneinfo/UTC

Some of these absolute symbolic links can be created intentionally,
but it is usually better to use relative symlinks.

You can run the script after `make installworld', or any other
make targets thats installs files.

You can also check your local ports with:

   env ABSOLUTE_SYMLINK_DIRS=/usr/local ./absolute-symlink.sh
2024-10-26 08:31:19 +00:00
Robert Clausecker
d8cd2d0833 depend-cleanup.sh: clean up after hash function removal from libcrypt
The hash function removal changed the mangled names of MD[45] and
SHA{256,512} hash function identifiers.  Clean these files to pick
up the symbol change.

Reported by:	bapt
Tested by:	brooks
Fixes:		cb5e41b160
2024-10-25 22:56:04 +02:00
Jose Luis Duran
3ab8697d9e git-arc: Do not echo unescaped literals to jq
Store the json blobs in temporary files instead of variables, and feed
them to jq for parsing.

When echoing "\n", the new line will become a literal new line, and
therefore, invalid json input:

```
jq: parse error: Invalid string: control characters from U+0000 through U+001F must be escaped ...
```

To reproduce:

    % git arc patch -c D12345

Reviewed by:	0mp, imp, markj
Approved by:	markj (mentor)
MFC after:	1 week
Differential Revision:	https://reviews.freebsd.org/D46767
2024-10-25 15:23:02 +02:00
Jose Luis Duran
7d875598fc git-arc: Make patch with reviewers more portable
Avoid an ArcanistUsageException:

    Provide method parameters on stdin as a JSON blob.

Due to an invalid JSON input on strict POSIX-compliant shells (macOS):

    echo '{
            "constraints": {"phids": [-n,"PHID-USER-xxx",]}
          }'                          ^^^               ^

Change the non-portable "echo -n" to a printf.

Reviewed by:	0mp, imp, markj
Approved by:	markj (mentor)
MFC after:	1 week
Differential Revision:	https://reviews.freebsd.org/D46781
2024-10-25 15:22:52 +02:00
Brooks Davis
8b2e7da708 llvm19: permit incremental builds from llvm18
Detect and delete out of date clang-tblgen produced output.  I found it
sufficent for compilation to delete only arm_*.inc files, but it seems
safer to regenerate all output and a few extra clang-tblgen runs pales
in comparison to the full build we're doing at this point.

Reviewed by:	dim, emaste
Differential Revision:	https://reviews.freebsd.org/D47270
2024-10-23 23:38:18 +01:00
Dimitry Andric
0fca6ea1d4 Merge llvm-project main llvmorg-19-init-18630-gf2ccf80136a0
This updates llvm, clang, compiler-rt, libc++, libunwind, lld, lldb and
openmp to llvm-project main llvmorg-19-init-18630-gf2ccf80136a0, the
last commit before the upstream release/19.x branch was created.

PR:		280562
MFC after:	1 month
2024-10-23 20:26:01 +02:00
Kyle Evans
8306900075 cross-build: fix missing <sys/md4.h> the proper way
Add it to tools/build/Makefile with a short note of where it's needed,
rather than hamfistedly copying it into the tools/build hierarchy.

Reported by:	jrtc27
Reviewed by:	jrtc27
Fixes:	aad507854e ("Fix the cross-build after recent commits")
Differential Revision:	https://reviews.freebsd.org/D46854
2024-10-18 15:53:15 -05:00
Jessica Clarke
0bdf2535d4 tools/build/cross-build: Don't include sys/uio.h from linux limits.h
This creates a circular dependency for OpenZFS's libspl in sys/uio.h,
and it shouldn't be needed since the system limits.h already defines
IOV_MAX, so delete it, and unconditionally assert that to be the case.
Otherwise the re-include of libspl's sys/uio.h tries to use PAGESIZE
before it has been defined by OpenZFS's own sys/param.h.

Fixes:		7a7741af18 ("zfs: merge openzfs/zfs@b10992582")
MFC after:	1 week
2024-10-18 21:39:37 +01:00
Jessica Clarke
d41a40f484 depend-cleanup.sh: Clean up after riscv static binary IFUNC addition
reloc.c is conditionally included by libc_start1.c so existing builds
don't feature it in the .depend file and won't know they need to rebuild
libc_start1.c.

MFC after:	1 week
2024-10-18 19:15:30 +01:00
Graham Percival
6e1fc01180 manuals: Fix "unusual .Xr" warnings with a script
These were reported by `mandoc -T lint ...` as warnings:
- unusual Xr order
- unusual Xr punctuation

Fixes made by script in https://github.com/Tarsnap/freebsd-doc-scripts

Signed-off-by:	Graham Percival <gperciva@tarsnap.com>
Reviewed by:	mhorne, Alexander Ziaee <concussious.bugzilla@runbox.com>
Sponsored by:	Tarsnap Backup Inc.
Pull Request:	https://github.com/freebsd/freebsd-src/pull/1464
2024-10-15 17:18:14 -03:00
Baptiste Daroussin
c5dee76368 unicode: revert to 15, more work is needed for 16 2024-10-14 17:59:39 +02:00
Baptiste Daroussin
18626e1f86 Unicode: prepare update to unicode 16 and CLDR 45 2024-10-14 10:43:38 +02:00
Hartmut Brandt
bc7afab6a1 Fix compilation of bsnmp tests.
PR:		277539
Submitted by:	John F. Carr
2024-10-14 10:23:18 +02:00
Ed Maste
c008b8f585 git-arc: minor manpage edits
Explicitly mention that it requires the arcanist port or package, and
edit some grammar and markup.

Reviewed by:	markj
Sponsored by:	The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D47060
2024-10-11 11:14:43 -04:00
Martin Matuska
73c7cb57a4 depend-cleanup.sh: Add a rule to work around zfs arc_os.c dependency changes 2024-10-11 09:23:30 +02:00
Martin Matuska
7a7741af18 zfs: merge openzfs/zfs@b10992582
Notable upstream pull request merges:
 #9416  -multiple zio_compress: introduce max size threshold
 #10018 a10e552b9 Adding Direct IO Support
 #15147 e419a63bf xattr dataset prop: change defaults to sa
 #15454 7e957fde7 send/recv: open up additional stream feature flags
 #15810 0d77e738e Defer resilver only when progress is above a threshold
 #15921 3cf2bfa57 Allocate zap_attribute_t from kmem instead of stack
 #16483 -multiple dmu_objset: replace dnode_hash impl with cityhash4
 #16485 8be2f4c3d zio_resume: log when unsuspending the pool
 #16491 88433e640 sys/types32.h: Remove struct timeval32 from libspl header
 #16496 f245541e2 zfs_file: implement zfs_file_deallocate for FreeBSD 14
 #16511 308f7c2f1 Fix an uninitialized data access
 #16529 29c9e6c32 Fix handling of DNS names with '-' in them for sharenfs
 #16531 ddf5f34f0 Avoid fault diagnosis if multiple vdevs have errors
 #16539 6f50f8e16 zfs_log: add flex array fields to log record structs
 #16546 d40d40913 Evicting too many bytes from MFU metadata
 #16551 3014dcb76 Reduce and handle EAGAIN errors on AIO label reads
 #16554 80645d658 FreeBSD: restore zfs_znode_update_vfs()
 #16565 832f66b21 FreeBSD: Sync taskq_cancel_id() returns with Linux
 #16567 48d1be254 Properly release key in spa_keystore_dsl_key_hold_dd()
 #16569 141368a4b Restrict raidz faulted vdev count
 #16583 c84a37ae9 lua: add flex array field to TString type
 #16584 86737c592 Avoid computing strlen() inside loops
 #16587 d34d4f97a snapdir: add 'disabled' value to make .zfs inaccessible
 #16593 224393a32 feature: large_microzap
 #16597 412105977 Temporarily disable Direct IO by default
 #16605 4ebe674d9 ARC: Cache arc_c value during arc_evict()

Backported pull request merges:
 #16613 ab777f436 Return boolean_t in inline functions of
                  lib/libspl/include/sys/uio.h
 #16616 efeb60b86 FreeBSD: ignore some includes when not building kernel
 #16635 ---TBD--- zdb: fix printf format in dump_zap()

Obtained from:	OpenZFS
OpenZFS commit:	b109925820
OpenZFS tag:	2.3.0-rc1
2024-10-11 08:43:49 +02:00
Peter Holm
94a294e59d stress2: Added test scenarios for bug report 2024-10-03 13:41:33 +02:00
Dag-Erling Smørgrav
2201f7c49f Build BSD diff3 if GNU diff3 is disabled.
MFC after:	3 weeks
Sponsored by:	Klara, Inc.
Reviewed by:	kevans
Differential Revision:	https://reviews.freebsd.org/D46799
2024-10-02 17:55:06 +02:00
Andrew Turner
8e95079e17 buf_ring: Add a threaded test
Add a threaded test for buf_ring.h used to help find issues with it on
architectures with a weak memory order.

Sponsored by:	Arm Ltd
Differential Revision:	https://reviews.freebsd.org/D46158
2024-09-30 12:04:24 +00:00
Kyle Evans
aad507854e Fix the cross-build after recent commits
- Provide a sys/md4.h in the cross-build environment to fix bootstrap
    of libmd.
- flua now exposes WTRAPPED which isn't incredibly common- make it
    conditional, we probably won't be using it in any bootstrap context
    any time soon.

Fixes:	442e0975ee ("Consolidate md4 implementations written in C")
Fixes:	c2caf3b331 ("flua: posix: add more useful functions [...]")
2024-09-30 00:08:49 -05:00
Konstantin Belousov
eade2001aa jemalloc: set LG_VADDR to 64 on amd64
and allow to revert it back to 48 with WITHOUT_JEMALLOC_LG_VADDR_WIDE build
option.

Reviewed by:	andrew, emaste
Sponsored by:	Advanced Micro Devices (AMD)
Sponsored by:	The FreeBSD Foundation
MFC after:	1 week
Differential revision:	https://reviews.freebsd.org/D46686
2024-09-27 01:54:25 +03:00
Ahmad Khalifa
599273f942 Copy the new ia32 loader
This handles copying in install-boot.sh and bsdinstall's bootconfig.

install-boot.sh:
make_esp_file now optionally takes extra arguments so it can copy
multiple files. This is used by the amd64 release scripts.
make_esp_device also takes an extra optional argument for efibootname.
This is currently unused, but it can be used in the future to do
something like:
make_esp_device loader.efi bootx64
make_esp_device loader_ia32.efi bootia32

Reviewed by: imp
Pull Request: https://github.com/freebsd/freebsd-src/pull/1098
2024-09-20 08:45:10 -06:00
Ahmad Khalifa
fe3f792f9a Add build option for the ia32 loader
In preparation for supporting 64-bit machines with 32-bit UEFI firmware,
add a build option for compiling the ia32 loader. Currently unused.

Reviewed by: imp
Pull Request: https://github.com/freebsd/freebsd-src/pull/1098
2024-09-20 08:45:05 -06:00
Peter Holm
4f4b483d31 stress2: Added a comment about a problem found and fixed 2024-09-16 10:17:50 +02:00
Jessica Clarke
b9c5eab0f3 depend-cleanup.sh: Fix overzealous syscall.S cleanup on amd64
Just as we skip the cleanup for i386 due to still having a custom
syscall.S, we also need to do the same for lib32 on amd64, so filter it
out of ALL_libcompats here.

Fixes:	a650ec0e55 ("lib{c,sys}: fix incremental builds")
2024-09-10 18:54:45 +01:00
Jessica Clarke
1a55697719 depend-cleanup.sh: Fix overzealous syscall.S cleanup on non-amd64
Although there is no longer a syscall.S in the source tree, the
generated file is still called syscall.S, so the syscall\.S regex still
matches the .depend file. Previously it looked like:

    syscall.o \
      /path/to/src/lib/libc/MACHINE/sys/syscall.S \
      ...

or

    syscall.o \
      /path/to/src/lib/libsys/MACHINE/syscall.S \
      ...

Now it looks like:

    syscall.o: syscall.S \
      ...

Thus, match on the file having a directory specified, to distinguish it from
the generated case where it's adjacent in the OBJDIR. Note the .* is needed due
to the use of egrep -w.

Fixes:	3a4b04e82d ("depend-cleanup.sh: Simplify handling for stale syscall.S")
2024-09-10 18:54:45 +01:00
Jessica Clarke
0980d0a037 depend-cleanup.sh: Fix overzealous abd_os.c cleanup
A source file with the same name is still used to build an abd_os.o, it
just comes from a different directory. Thus we need to include part of
the path in the regex too. Technically zfs/abd_os\.c would suffice given
it's now in sys/contrib/openzfs/lib/libzpool/abd_os.c, but this seems
clearer and less likely to have future false-positives.

Fixes:	fd3d3240b0 ("depend-cleanup.sh: Add a rule to work around abd_os.c dependency changes")
2024-09-10 18:54:45 +01:00
Jessica Clarke
cc30f4ae67 depend-cleanup.sh: Extend clean_dep to support a custom regex
This will avoid having to duplicate the loop every time the default
regex isn't good enough, and will be used by upcoming commits.
2024-09-10 18:54:44 +01:00
Jessica Clarke
e546c3950a depend-cleanup.sh: Fix overzealous rescue.mk cleanup
grep -q -v means "are there any lines that don't match", not "are there
no lines that match", and since the file has lines other than ones with
nvme_util.o when up-to-date this triggers on every build.

Fixes:		26a09db3ad ("Fix incremental build with WITH_NVME newly enabled")
MFC after:	1 week
2024-09-10 17:33:06 +01:00
Jessica Clarke
7ce171bd42 depend-cleanup.sh: Fix pretend (-n) mode
Fixes:		26a09db3ad ("Fix incremental build with WITH_NVME newly enabled")
MFC after:	1 week
2024-09-10 17:14:37 +01:00
Mark Johnston
fd3d3240b0 depend-cleanup.sh: Add a rule to work around abd_os.c dependency changes
Fixes incremental buildworld after the latest OpenZFS import.

Fixes:	e2df9bb441 ("zfs: merge openzfs/zfs@b10992582")
Sponsored by:	Klara, Inc.
2024-09-10 15:29:39 +00:00
Wolfram Schneider
c77ca9a72c stale-symlink-buildworld.sh: improve documentation 2024-09-09 14:55:29 +00:00
Mark Johnston
24affded3d src.conf: Add a MK_ZFS_TESTS knob
The in-tree ZFS test suite is somewhat outdated and I see a number of
failures there.  I tend to think that we want to integrate the OpenZFS
test suite somehow, replacing the legacy one, though it's also possible
to run that as a separate test suite.

In any case, if one wants to run the OpenZFS test suite separately, it's
useful to be able to disable installation of the legacy ZFS test suite,
so let's provide a src.conf option to do that.

Reviewed by:	asomers
MFC after:	2 weeks
Differential Revision:	https://reviews.freebsd.org/D46476
2024-09-07 14:36:28 +00:00
Val Packett
7b9c9f8004 cross-build: fix fake_sysctl/tzsetup
The error was always returned, even after handling the sysctl, breaking
installworld under Linux.

Sponsored by:		https://www.patreon.com/valpackett

Reviewed by: imp
Pull Request: https://github.com/freebsd/freebsd-src/pull/1376
2024-09-06 12:34:32 -06:00
Peter Holm
f6fd5af80a stress2: Do not wait forever for swap usage 2024-08-30 10:04:46 +02:00
Peter Holm
c7c3f6351e stress2: Update comments and remove one test 2024-08-29 09:59:16 +02:00
Jessica Clarke
18aef07cfa beinstall: Pass -B to etcupdate
Since commit 246364454f ("etcupdate: Use new buildetc and installetc
targets when available"), beinstall has been much slower for the
etcupdate step, as it's been doing a kernel-toolchain (admittedly
without LLVM itself being built). Given beinstall requires an object
tree to already have been built and just installs it, we can pass -B to
beinstall to reuse that tree rather than build kernel-toolchain in
another one.

Reported by:	olivier
Tested by:	olivier
MFC after:	1 week
2024-08-28 23:36:56 +01:00
John Baldwin
0a5996443b src.conf.5: Fix spelling typo
Sponsored by:	AFRL, DARPA
2024-08-20 07:54:12 -04:00