1
0
mirror of https://git.FreeBSD.org/src.git synced 2024-11-23 07:31:31 +00:00
Commit Graph

5904 Commits

Author SHA1 Message Date
Igor Ostapenko
976ab1425d git-arc: Document how a reviewer group can be referenced
Reviewed by:	concussious.bugzilla_runbox.com, markj
Approved by:	markj (mentor)
Differential Revision:	https://reviews.freebsd.org/D47669
2024-11-21 10:36:50 +00:00
Jose Luis Duran
87e87fecb1
nanobsd: Remove dependency on bsdlabel
The bsdlabel utility is deprecated, gpart should be used instead:

  - Offset the first 16 sectors, just like bsdlabel did (used for
    metadata)
  - Use a freebsd-ufs partition type (regardless bsdlabel creating a
    '!0')

Reviewed by:	emaste, imp
Approved by:	emaste (mentor)
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D47653
2024-11-20 22:31:56 +00:00
Peter Holm
43778a593f stress2: Added zfs test scenarios 2024-11-18 10:46:28 +01:00
Peter Holm
55aa53fbf2 stress2: Added a zfs regression test scenario 2024-11-18 10:40:16 +01:00
Ed Maste
2c2f741363 mfc-candidates: Improve hash expansion
`git rev-parse` is the canonical way to turn a short hash (or other
commit-ish) into a full hash.

Sponsored by:	The FreeBSD Foundation
2024-11-16 09:56:07 -05:00
Jose Luis Duran
12cbad923d
nanobsd: Fix typos
Fix a number of typos in the code or comments.
Files under dhcpd, embedded, pcengines, and rescue were intentionally
omitted. These directories will be reviewed at a later date.

PR:		269884
Reviewed by:	imp, zlei
Approved by:	emaste (mentor)
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D47587
2024-11-16 07:11:16 +00:00
Jose Luis Duran
0f7b0db5dd
nanobsd: Fix cust_comconsole search patterns
The current patterns are outdated, and may produce "offifexists", after
e310437971 ("For video consoles, only launch a getty if the device
exists.").

Fix the expressions to:

1. Disable getty(8) on the virtual syscons(4) or vt(4) terminals
   (/dev/ttyv*).
2. Enable the use of the first serial port as the system console.

Reviewed by:	imp
Approved by:	emaste (mentor)
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D47586
2024-11-16 07:08:24 +00:00
Jose Luis Duran
4223c668e4
nanobsd: Use the real path for NANO_PACKAGE_DIR
As users may have the Pkg directory as a symbolic link to the NanoBSD
"package dump directory".  In commit 9af130ae8c, cust_pkgng() was
greatly improved, however as a side effect of using a nullfs mount, the
directories and files must not be symlinks.

Fix it by using NANO_PACKAGE_DIR realpath().

PR:		269884
Reviewed by:	imp
Approved by:	emaste (mentor)
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D47532
2024-11-16 07:06:14 +00:00
Jose Luis Duran
4db04f5e3a
nanobsd: Update fill_pkg.sh
fill_pkg.sh is a script that links a package and its dependencies from a
"package dump" directory (like /usr/ports/packages/All) to a specified
directory (NANO_PACKAGE_DIR), for cust_pkgng()[*].

Update the script by:

- Using `make package-name` instead of `make -V pkgname`
- Looking for package files with *.pkg instead of *.txz
- Adding a -c option that copies the files instead of linking them[*]

[*] After 9af130ae8c cust_pkgng() cannot be used with a directory
populated by fill_pkg.sh, because it uses a nullfs mount, which doesn't
follow symlinks, therefore the links inside NANO_PACKAGE_DIR will not
work.

PR:		269884
Reviewed by:	imp
Approved by:	emaste (mentor)
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D47531
2024-11-16 07:01:27 +00:00
Jose Luis Duran
e5579f98c0
nanobsd: Avoid read-only file system warnings
The default setting of some loader or rc variables generate warnings
because the file system is read-only:

Set the following options to avoid printing these warnings:

/boot/defaults/loader.conf:

- hostuuid_load="NO" to disable loading /etc/hostid early at boot time
- entropy_cache_load="NO" to disable loading cached entropy at boot time
- kern.random.initial_seeding.disable_bypass_warnings="1" to disable
  logging a warning if the 'bypass_before_seeding' knob is enabled
  (enabled by default) and a request is submitted prior to initial
  seeding

/etc/defaults/rc.conf:

- kldxref_enable="NO" to disable building linker.hints files with
  kldxref(8)
- entropy_boot_file="NO" to disable very early (used at early boot-time)
  entropy caching through reboots
- entropy_dir="NO" to disable caching entropy via cron

While here, move rc.conf options before sourcing vendor.conf, so they
can be overridden.

PR:		277601
Reviewed by:	imp
Approved by:	emaste (mentor)
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D47502
2024-11-16 06:55:57 +00:00
Jose Luis Duran
3c5d19a40d
nanobsd: Fix parallel make
The NANO_NCPU (number of CPUs) value gets ignored by the build script
when setting the NANO_PMAKE (parallel make) value.

Fix it by setting the NANO_PMAKE later in the process.

PR:		277269
Reviewed by:	imp, emaste
Approved by:	emaste (mentor)
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D47476
2024-11-16 06:55:25 +00:00
Jose Luis Duran
999f288a0e
nanobsd: Add missing options to usage()
-B suppress installs (both kernel and world)
-I build disk image from existing build/install
-W suppress installworld

PR:		277269
Reviewed by:	imp, emaste
Approved by:	emaste (mentor)
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D47475
2024-11-16 06:54:58 +00:00
Ed Maste
586c651f2b mfc_candidates: remove leftover message
When I first converted mfc-candidates to Lua I did not implement -X
(exclude file), and just emitted a message that -X wasn't implemented.
Support was implemented before I pushed the change but I forgot to
remove the message.

Fixes: 48f3fcabea ("mfc-candidates: Convert to Lua")
Sponsored by: The FreeBSD Foundation
2024-11-15 16:39:23 -05:00
Ed Maste
48f3fcabea mfc-candidates: Convert to Lua
d51c590023 added a Lua script to process the lists of candidate and
completed MFC commits to address sorting issues in the original shell
implementation.

Instead of having a mix of shell and Lua, just implement the entire
tool in Lua.  This is more maintainable and gives a reasonable
improvement in performace.

Reviewed by:	imp
Sponsored by:	The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D47416
2024-11-15 15:09:53 -05:00
Kyle Evans
0f30aed105 localedata: update widths.txt after recent Hangul exceptions
Sponsored by:	Klara, Inc.
2024-11-13 16:12:42 -06:00
Kyle Evans
160c36eae4 localedata: add some exceptions to utf8proc widths
Hangul Jamo medial vowels and final consonants are reportedly combining
characters that won't take up any columns on their own and should be
reported as zero-width, so add an exception for these as well to reflect
how they work in practice.  This conforms to how other implementations
(e.g., glibc) treat these characters.

Reviewed by:	bapt (earlier version), jkim
Sponsored by:	Klara, Inc.
Differential Revision:	https://reviews.freebsd.org/D47472
2024-11-13 16:12:42 -06:00
Ed Maste
3750ccefb8 Retire MK_PROFILE infrastructure
It was disabled by default in fe52b7f60e.  We planned to (but did not)
remove the option before FreeBSD 14.  Remove it now, for FreeBSD 15.

Relnotes:	Yes
Reviewed by:	imp
Sponsored by:	The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D31558
2024-11-12 12:11:51 -05:00
Vladimir Kondratyev
5036d9652a rtlbtfw: Firmware loader for Realtek 87XX/88XX bluetooth USB adaptors
Firmware files are available in the comms/rtlbt-firmware port.

Sponsored by:	Future Crew LLC
MFC after:	1 month
Differential Revision:	https://reviews.freebsd.org/D46739
2024-11-07 02:30:29 +03:00
Mark Johnston
d14c38ceb8 sys: Avoid relying on pollution from refcount.h
Fix up headers which previously assumed that refcount.h includes
systm.h, and make them more self-contained.  Then, replace the systm.h
include in refcount with kassert.h.

Reviewed by:	imp, kib
MFC after:	1 week
Differential Revision:	https://reviews.freebsd.org/D47450
2024-11-05 18:22:20 +00:00
Jose Luis Duran
9e84289f2c
git-arc: Prefer echo over printf
Prefer echo over printf.  Prevent the newline character from being
translated by using 'blank' instead of 'space' in the re_format.

This change was reviewed in:

https://reviews.freebsd.org/D47289

Committed separately for clarity.

Suggested by:	des
Approved by:	emaste (mentor)
2024-11-05 02:10:16 +00:00
Jose Luis Duran
2377c19a8c
git-arc: Trap on every mktemp
Trap:

- EXIT (0)
- HUP  (1)
- INT  (2)
- QUIT (3)
- TRAP (5)
- USR1 (10)
- TERM (15)

every time mktemp is called to reduce the chances of leaving stray files
or directories with possible sensitive data inside.

We avoid using a template with mktemp, as some operating systems may use
unpredictable base paths by default (macOS).

Suggested by:	des
Reviewed by:	emaste, 0mp, des (earlier), markj
Approved by:	emaste (mentor)
Differential Revision:	https://reviews.freebsd.org/D47289
2024-11-05 02:10:16 +00:00
Jose Luis Duran
019981e00f
git-arc: Fix typo s/Truning/Turning/
While here standardize white space.
No functional change.

Approved by:	emaste (mentor)
2024-11-05 02:10:16 +00:00
Jose Luis Duran
aa90b92ac2
git-arc: Fix find_author() for external users
When an external user submits a review in Phabricator, the find_author()
subroutine may receive the author_name and author_addr as "null" from
the JSON API with git-arc patch.

This "null" string gets tested for length by "[ -n", and returning that
is greater than zero, in other words, the shell does not understand that
"null" means nothing in this case.

Fix it by adding a guard, that sets an empty string when the content is
"null".

While here, standardize the indentation style for find_author()

Reviewed by:	emaste, markj
Approved by:	emaste (mentor)
Differential Revision:	https://reviews.freebsd.org/D46789
2024-11-05 02:10:15 +00:00
Mark Johnston
a0069f16fe tools: Add a couple of utilities which were useful for testing SO_SPLICE
Sponsored by:	Klara, Inc.
Sponsored by:	Stormshield

Differential Revision:	https://reviews.freebsd.org/D47308
2024-11-01 14:02:40 +00:00
Pat Maddox
66a56e411c mfc-candidates: Support GitHub mirror naming conventions
GitHub repository mirrors are named freebsd-src and
freebsd-ports. Additionally, GitHub permits remote URLs with or
without the .git suffix.

Signed-off-by: Pat Maddox <pat@patmaddox.com>
Pull Request: https://github.com/freebsd/freebsd-src/pull/1483
2024-10-31 10:57:31 -04:00
Brooks Davis
50b5a37a12 src.conf.5: LOADER_BIOS_TEXTONLY default change
WITH_LOADER_BIOS_TEXTONLY is now the default so document
WITHOUT_LOADER_BIOS_TEXTONLY.

Fixes:		23dee252da loader: Change this BIOS tradeoff...
2024-10-30 19:35:57 +00:00
Mark Johnston
207ab5f4f1 rc.d/opensm: Only install when MK_OFED_EXTRA is set
opensm itself is only installed when MK_OFED_EXTRA is set, so it only
makes sense for the same to be true of the rc script.

PR:		257646
Reviewed by:	kib
Differential Revision:	https://reviews.freebsd.org/D47313
2024-10-29 13:01:00 +00:00
Wolfram Schneider
9d585fc395 absolute-symlink.sh: check for absolute symlinks on a FreeBSD system
The purpose of this script is to detect absolute symlinks on
a machine, e.g.:

    /etc/localtime -> /usr/share/zoneinfo/UTC

Some of these absolute symbolic links can be created intentionally,
but it is usually better to use relative symlinks.

You can run the script after `make installworld', or any other
make targets thats installs files.

You can also check your local ports with:

   env ABSOLUTE_SYMLINK_DIRS=/usr/local ./absolute-symlink.sh
2024-10-26 08:31:19 +00:00
Robert Clausecker
d8cd2d0833 depend-cleanup.sh: clean up after hash function removal from libcrypt
The hash function removal changed the mangled names of MD[45] and
SHA{256,512} hash function identifiers.  Clean these files to pick
up the symbol change.

Reported by:	bapt
Tested by:	brooks
Fixes:		cb5e41b160
2024-10-25 22:56:04 +02:00
Jose Luis Duran
3ab8697d9e git-arc: Do not echo unescaped literals to jq
Store the json blobs in temporary files instead of variables, and feed
them to jq for parsing.

When echoing "\n", the new line will become a literal new line, and
therefore, invalid json input:

```
jq: parse error: Invalid string: control characters from U+0000 through U+001F must be escaped ...
```

To reproduce:

    % git arc patch -c D12345

Reviewed by:	0mp, imp, markj
Approved by:	markj (mentor)
MFC after:	1 week
Differential Revision:	https://reviews.freebsd.org/D46767
2024-10-25 15:23:02 +02:00
Jose Luis Duran
7d875598fc git-arc: Make patch with reviewers more portable
Avoid an ArcanistUsageException:

    Provide method parameters on stdin as a JSON blob.

Due to an invalid JSON input on strict POSIX-compliant shells (macOS):

    echo '{
            "constraints": {"phids": [-n,"PHID-USER-xxx",]}
          }'                          ^^^               ^

Change the non-portable "echo -n" to a printf.

Reviewed by:	0mp, imp, markj
Approved by:	markj (mentor)
MFC after:	1 week
Differential Revision:	https://reviews.freebsd.org/D46781
2024-10-25 15:22:52 +02:00
Brooks Davis
8b2e7da708 llvm19: permit incremental builds from llvm18
Detect and delete out of date clang-tblgen produced output.  I found it
sufficent for compilation to delete only arm_*.inc files, but it seems
safer to regenerate all output and a few extra clang-tblgen runs pales
in comparison to the full build we're doing at this point.

Reviewed by:	dim, emaste
Differential Revision:	https://reviews.freebsd.org/D47270
2024-10-23 23:38:18 +01:00
Dimitry Andric
0fca6ea1d4 Merge llvm-project main llvmorg-19-init-18630-gf2ccf80136a0
This updates llvm, clang, compiler-rt, libc++, libunwind, lld, lldb and
openmp to llvm-project main llvmorg-19-init-18630-gf2ccf80136a0, the
last commit before the upstream release/19.x branch was created.

PR:		280562
MFC after:	1 month
2024-10-23 20:26:01 +02:00
Kyle Evans
8306900075 cross-build: fix missing <sys/md4.h> the proper way
Add it to tools/build/Makefile with a short note of where it's needed,
rather than hamfistedly copying it into the tools/build hierarchy.

Reported by:	jrtc27
Reviewed by:	jrtc27
Fixes:	aad507854e ("Fix the cross-build after recent commits")
Differential Revision:	https://reviews.freebsd.org/D46854
2024-10-18 15:53:15 -05:00
Jessica Clarke
0bdf2535d4 tools/build/cross-build: Don't include sys/uio.h from linux limits.h
This creates a circular dependency for OpenZFS's libspl in sys/uio.h,
and it shouldn't be needed since the system limits.h already defines
IOV_MAX, so delete it, and unconditionally assert that to be the case.
Otherwise the re-include of libspl's sys/uio.h tries to use PAGESIZE
before it has been defined by OpenZFS's own sys/param.h.

Fixes:		7a7741af18 ("zfs: merge openzfs/zfs@b10992582")
MFC after:	1 week
2024-10-18 21:39:37 +01:00
Jessica Clarke
d41a40f484 depend-cleanup.sh: Clean up after riscv static binary IFUNC addition
reloc.c is conditionally included by libc_start1.c so existing builds
don't feature it in the .depend file and won't know they need to rebuild
libc_start1.c.

MFC after:	1 week
2024-10-18 19:15:30 +01:00
Graham Percival
6e1fc01180 manuals: Fix "unusual .Xr" warnings with a script
These were reported by `mandoc -T lint ...` as warnings:
- unusual Xr order
- unusual Xr punctuation

Fixes made by script in https://github.com/Tarsnap/freebsd-doc-scripts

Signed-off-by:	Graham Percival <gperciva@tarsnap.com>
Reviewed by:	mhorne, Alexander Ziaee <concussious.bugzilla@runbox.com>
Sponsored by:	Tarsnap Backup Inc.
Pull Request:	https://github.com/freebsd/freebsd-src/pull/1464
2024-10-15 17:18:14 -03:00
Baptiste Daroussin
c5dee76368 unicode: revert to 15, more work is needed for 16 2024-10-14 17:59:39 +02:00
Baptiste Daroussin
18626e1f86 Unicode: prepare update to unicode 16 and CLDR 45 2024-10-14 10:43:38 +02:00
Hartmut Brandt
bc7afab6a1 Fix compilation of bsnmp tests.
PR:		277539
Submitted by:	John F. Carr
2024-10-14 10:23:18 +02:00
Ed Maste
c008b8f585 git-arc: minor manpage edits
Explicitly mention that it requires the arcanist port or package, and
edit some grammar and markup.

Reviewed by:	markj
Sponsored by:	The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D47060
2024-10-11 11:14:43 -04:00
Martin Matuska
73c7cb57a4 depend-cleanup.sh: Add a rule to work around zfs arc_os.c dependency changes 2024-10-11 09:23:30 +02:00
Martin Matuska
7a7741af18 zfs: merge openzfs/zfs@b10992582
Notable upstream pull request merges:
 #9416  -multiple zio_compress: introduce max size threshold
 #10018 a10e552b9 Adding Direct IO Support
 #15147 e419a63bf xattr dataset prop: change defaults to sa
 #15454 7e957fde7 send/recv: open up additional stream feature flags
 #15810 0d77e738e Defer resilver only when progress is above a threshold
 #15921 3cf2bfa57 Allocate zap_attribute_t from kmem instead of stack
 #16483 -multiple dmu_objset: replace dnode_hash impl with cityhash4
 #16485 8be2f4c3d zio_resume: log when unsuspending the pool
 #16491 88433e640 sys/types32.h: Remove struct timeval32 from libspl header
 #16496 f245541e2 zfs_file: implement zfs_file_deallocate for FreeBSD 14
 #16511 308f7c2f1 Fix an uninitialized data access
 #16529 29c9e6c32 Fix handling of DNS names with '-' in them for sharenfs
 #16531 ddf5f34f0 Avoid fault diagnosis if multiple vdevs have errors
 #16539 6f50f8e16 zfs_log: add flex array fields to log record structs
 #16546 d40d40913 Evicting too many bytes from MFU metadata
 #16551 3014dcb76 Reduce and handle EAGAIN errors on AIO label reads
 #16554 80645d658 FreeBSD: restore zfs_znode_update_vfs()
 #16565 832f66b21 FreeBSD: Sync taskq_cancel_id() returns with Linux
 #16567 48d1be254 Properly release key in spa_keystore_dsl_key_hold_dd()
 #16569 141368a4b Restrict raidz faulted vdev count
 #16583 c84a37ae9 lua: add flex array field to TString type
 #16584 86737c592 Avoid computing strlen() inside loops
 #16587 d34d4f97a snapdir: add 'disabled' value to make .zfs inaccessible
 #16593 224393a32 feature: large_microzap
 #16597 412105977 Temporarily disable Direct IO by default
 #16605 4ebe674d9 ARC: Cache arc_c value during arc_evict()

Backported pull request merges:
 #16613 ab777f436 Return boolean_t in inline functions of
                  lib/libspl/include/sys/uio.h
 #16616 efeb60b86 FreeBSD: ignore some includes when not building kernel
 #16635 ---TBD--- zdb: fix printf format in dump_zap()

Obtained from:	OpenZFS
OpenZFS commit:	b109925820
OpenZFS tag:	2.3.0-rc1
2024-10-11 08:43:49 +02:00
Peter Holm
94a294e59d stress2: Added test scenarios for bug report 2024-10-03 13:41:33 +02:00
Dag-Erling Smørgrav
2201f7c49f Build BSD diff3 if GNU diff3 is disabled.
MFC after:	3 weeks
Sponsored by:	Klara, Inc.
Reviewed by:	kevans
Differential Revision:	https://reviews.freebsd.org/D46799
2024-10-02 17:55:06 +02:00
Andrew Turner
8e95079e17 buf_ring: Add a threaded test
Add a threaded test for buf_ring.h used to help find issues with it on
architectures with a weak memory order.

Sponsored by:	Arm Ltd
Differential Revision:	https://reviews.freebsd.org/D46158
2024-09-30 12:04:24 +00:00
Kyle Evans
aad507854e Fix the cross-build after recent commits
- Provide a sys/md4.h in the cross-build environment to fix bootstrap
    of libmd.
- flua now exposes WTRAPPED which isn't incredibly common- make it
    conditional, we probably won't be using it in any bootstrap context
    any time soon.

Fixes:	442e0975ee ("Consolidate md4 implementations written in C")
Fixes:	c2caf3b331 ("flua: posix: add more useful functions [...]")
2024-09-30 00:08:49 -05:00
Konstantin Belousov
eade2001aa jemalloc: set LG_VADDR to 64 on amd64
and allow to revert it back to 48 with WITHOUT_JEMALLOC_LG_VADDR_WIDE build
option.

Reviewed by:	andrew, emaste
Sponsored by:	Advanced Micro Devices (AMD)
Sponsored by:	The FreeBSD Foundation
MFC after:	1 week
Differential revision:	https://reviews.freebsd.org/D46686
2024-09-27 01:54:25 +03:00
Ahmad Khalifa
599273f942 Copy the new ia32 loader
This handles copying in install-boot.sh and bsdinstall's bootconfig.

install-boot.sh:
make_esp_file now optionally takes extra arguments so it can copy
multiple files. This is used by the amd64 release scripts.
make_esp_device also takes an extra optional argument for efibootname.
This is currently unused, but it can be used in the future to do
something like:
make_esp_device loader.efi bootx64
make_esp_device loader_ia32.efi bootia32

Reviewed by: imp
Pull Request: https://github.com/freebsd/freebsd-src/pull/1098
2024-09-20 08:45:10 -06:00
Ahmad Khalifa
fe3f792f9a Add build option for the ia32 loader
In preparation for supporting 64-bit machines with 32-bit UEFI firmware,
add a build option for compiling the ia32 loader. Currently unused.

Reviewed by: imp
Pull Request: https://github.com/freebsd/freebsd-src/pull/1098
2024-09-20 08:45:05 -06:00