1
0
mirror of https://git.FreeBSD.org/src.git synced 2024-12-04 09:09:56 +00:00
freebsd/tools/regression
Marcel Moolenaar e717c486b3 MFp4:
o  Add mount and umount actions so that partitions can be in use.
o  Extend the testing of the add verb to include overlapping
   partitions.
o  Add tests for the remove verb. this includes tests to remove
   a partition when in use (i.e. is mounted).
o  Add a MD5 checksum to the output of the conf action so that
   it can be tested. Make sure the MD5 doesn't vary based on
   certain dynamic behaviour that is irrelevant to the output.
o  Add MD5 checksums to the expected result of conf actions.
2006-04-10 04:13:44 +00:00
..
aio Style: NO_MAN doesn't need any value. 2006-03-15 10:46:38 +00:00
atm Add a regression test for the ATM call control stuff. 2004-08-13 09:27:21 +00:00
audit/audit_pipe_ioctl Merge Perforce change 93572 from TrustedBSD audit3 branch: 2006-03-19 15:47:53 +00:00
bin/sh Test that variable assignments preceding special built-ins affect the current 2006-04-09 09:38:29 +00:00
ccd/layout
fifo Add two small tests to set and clear two file I/O flags using ioctl on 2005-09-13 17:25:35 +00:00
fsx Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
gaithrstress Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
geom Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
geom_concat Finish conversion of gconcat(8) regression tests to the new framework. 2005-12-07 01:24:25 +00:00
geom_eli Add regression test which verifies that options -P and -i cannot be used 2006-02-12 02:07:56 +00:00
geom_gate Switch over to a different, more flexible test output protocol that's 2004-11-11 19:47:55 +00:00
geom_gpt MFp4: 2006-04-10 04:13:44 +00:00
geom_mirror - Make use of geom_subr.sh to improve regression tests. 2005-12-07 01:27:23 +00:00
geom_nop - Make use of geom_subr.sh to improve regression tests. 2005-12-07 01:27:23 +00:00
geom_raid3 Convert graid3(8) regression tests to the new framework. 2005-12-07 01:28:59 +00:00
geom_shsec Convert gshsec(8) regression tests to the new framework. 2005-12-07 01:29:50 +00:00
geom_stripe Convert gstripe(8) regression tests to the new framework. 2005-12-07 01:30:44 +00:00
geom_uzip Use mkuzip(8) instead of create_compressed_fs. 2005-09-29 22:41:20 +00:00
ia64/unaligned Wrap calls to memcpy(3) in a function called block_copy(). This way, 2005-01-28 02:58:32 +00:00
include/tgmath Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
lib Style: NO_MAN doesn't need any value. 2006-03-15 10:46:38 +00:00
mac/mac_bsdextended Those who are ungodlike should be returned an error. 2005-04-16 18:41:00 +00:00
mlock Style: NO_MAN doesn't need any value. 2006-03-15 10:46:38 +00:00
mqueue Add code to test POSIX message queue. 2005-11-26 13:19:09 +00:00
msdosfs Adding another multi-byte characters related regression test for recent 2006-01-01 01:28:31 +00:00
net80211 Catching up with the latest crypto API changes in net80211. 2005-05-05 13:16:30 +00:00
netatalk/simple_send Change s_net to s_node when printing the destination address. 2006-03-17 20:14:25 +00:00
netinet Add a second pass to the close-before-accept test using a call to the 2006-04-03 11:57:41 +00:00
netipx Add spxabort, a simple netipx/spx regression test that triggers 2006-03-27 00:03:37 +00:00
nfsmmap Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
p1003_1b Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
pipe Add two more pipe regression tests. Not yet hooked into the test framework. 2005-01-21 06:46:18 +00:00
redzone9 Add simple tests which verify that redzone(9) works properly. 2006-01-31 11:20:13 +00:00
security Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
sigqueue Add code to test queued SIGCHLD. 2005-11-08 09:19:44 +00:00
sockets Add a simple regression test that creates and tears down route sockets, 2006-04-09 14:48:38 +00:00
sysvmsg Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
sysvsem Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
sysvshm Start the dreaded NOFOO -> NO_FOO conversion. 2004-12-21 08:47:35 +00:00
tls NO_MAN is not needed here. 2006-03-16 15:18:17 +00:00
ufs/uprintf Small regression test tool to generate two forms of ENOSPC on a file 2005-09-19 16:29:36 +00:00
usr.bin Add tests for -t option with short tty name - pkill(1) should accept both 2005-11-07 16:56:16 +00:00
geom_subr.sh Add file with helper functions for geom tools regression tests. 2005-12-07 01:20:18 +00:00
README Replace a mention of the ia64_unaligned directory with one of the 2005-01-02 21:40:36 +00:00
TODO Switch over to a different, more flexible test output protocol that's 2004-11-11 19:47:55 +00:00

$FreeBSD$

This directory is for regression test programs.

A regression test program is one that will exercise a particular bit of the
system to check that we have not reintroduced an old bug.

Tests should be implemented in files with a .t extension.  Each .t file
can contain more than one test, and can be implemented in any scripting
language -- /bin/sh, Perl...

The test protocol is quite simple.  At its most basic, each .t file should, 
when run, print a line in this format:

   1..m

where m is the number of tests that will be run.

Each test should produce a single line of output.  This line should start
with one of

   ok n
   not ok n

to indicate whether or not the test succeeded.  'n' is the test's number.
Anything after this on the line (up to the first '#' if present) is 
considered to be the name of the test.  Naming tests is optional, but 
encouraged.

A test may be written which is conditional, and may need to be skipped.
For example, the netatalk tests require 'options NETATALK' in the kernel.
A test may be skipped by printing '# skip Reason for skipping' after the
test name.  For example,

    ok 1 - netatalk # skip 'options NETATALK' not compiled in

A test may be flagged as 'todo'.  This indicates that you expect the test
to fail (perhaps because the necessary functionality hasn't been written
yet).  'todo' tests are expected to fail, so when they start working the
test framework can alert you to this happy occurence.  Flag these tests 
with a '# TODO' comment after the test name

    not ok 1 - infiniteloop # TODO write test for an infinite loop

This is modelled on the protocol followed by the Test::Harness Perl
module (and therefore much of the automated testing carried out by the 
Perl community).  More documentation can be found at:

    http://search.cpan.org/~petdance/Test-Harness-2.42/lib/Test/Harness.pm

To run the tests and parse their output install the devel/p5-Test-Harness
port.  This includes the prove(1) command which is used to run the tests
and collate the output.

    prove geom_concat		# run all the tests in geom_concat
    prove -r lib		# run all tests in lib/, and subdirectories
    prove -r -v lib		# as above, with verbose output
    prove -r			# run *all* the tests

Tests that are for parts of the base system should go into a directory here
which is the same as their path relative to src/, for example the uuencode(1)
utility resides in src/usr.bin/uuencode so its regression test resides in
src/tools/regression/usr.bin/uuencode.

Please make a subdir per other regression test, and add a brief description to
this file.

geom		Some tests and an out-of-kernel simulator for the GEOM code
ia64		ia64 specific regression tests
nfsmmap		Some tests to exercise some tricky cases in NFS and mmap
p1003_1b	Exercise 1003.1B scheduler
pipe		Pipe code regression test
fsx		General filesystem exerciser
sysvmsg 	SysV IPC Message Queue Regression Utility
sysvsem 	SysV IPC Semaphore Regression Utility
sysvshm 	SysV IPC Shared Memory Regression Utility
gaithrstress	General threaded getaddrinfo(3) exerciser