1
0
mirror of https://git.FreeBSD.org/src.git synced 2024-11-23 07:31:31 +00:00
freebsd/contrib/kyua
Igor Ostapenko 99689201a1 kyua: Do not count skipped as passed in test cmd
It changes output of 'kyua test' CLI command only. Hence, other outputs
like junit are kept intact for CI and other use cases. It's meant to
improve UX of attended use cases.

The issue is that the following can be tricky to interpret:

  222/222 passed (0 failed)

It can be read as all tests are passed, but it might be a summary line
of all tests skipped due to some requirement is not met.

It's reworked to easily distinguish such cases:

  222/222 passed (0 broken, 0 failed, 0 skipped)
  0/222 passed (0 broken, 0 failed, 222 skipped)

The overall formula is:

  <actually passed>/<total> (<details about not actually passed ones>)

Suggested by:	kp
Reviewed by:	ngie, markj
Approved by:	markj (mentor)
Differential Revision:	https://reviews.freebsd.org/D46653
2024-10-05 10:22:22 +00:00
..
admin
bootstrap
cli
doc
drivers
engine
examples
integration
m4
misc
model
os/freebsd
store
utils
.cirrus.yml
.gitignore
.travis.yml
AUTHORS
configure.ac
CONTRIBUTING.md
CONTRIBUTORS
Doxyfile.in
INSTALL.md
Kyuafile
LICENSE
main.cpp
Makefile.am
NEWS.md
README.md

Welcome to the Kyua project!

Kyua is a testing framework for infrastructure software, originally designed to equip BSD-based operating systems with a test suite. This means that Kyua is lightweight and simple, and that Kyua integrates well with various build systems and continuous integration frameworks.

Kyua features an expressive test suite definition language, a safe runtime engine for test suites and a powerful report generation engine.

Kyua is for both developers and users, from the developer applying a simple fix to a library to the system administrator deploying a new release on a production machine.

Kyua is able to execute test programs written with a plethora of testing libraries and languages. The library of choice is ATF, for which Kyua was originally designed, but simple, framework-less test programs and TAP-compliant test programs can also be executed through Kyua.

Kyua is licensed under a liberal BSD 3-clause license. This is not an official Google product.

Read more about Kyua in the About wiki page.

Download

The latest version of Kyua is 0.13 and was released on August 26th, 2016.

Download: kyua-0.13.

See the release notes for information about the changes in this and all previous releases.

Installation

You are encouraged to install binary packages for your operating system wherever available:

  • Fedora 20 and above: install the kyua-cli package with yum install kyua-cli.

  • FreeBSD 10.0 and above: install the kyua package with pkg install kyua.

  • NetBSD with pkgsrc: install the pkgsrc/devel/kyua package.

  • OpenBSD with packages: install the kyua package with pkg_add kyua.

  • OS X (with Homebrew): install the kyua package with brew install kyua.

Should you want to build and install Kyua from the source tree provided here, follow the instructions in the INSTALL.md file.

You should also install the ATF libraries to assist in the development of test programs. To that end, see the ATF project page.

Contributing

Want to contribute? Great! But please first read the guidelines provided in CONTRIBUTING.md.

If you are curious about who made this project possible, you can check out the list of copyright holders and the list of individuals.

Support

Please use the kyua-discuss mailing list for any support inquiries.

Homepage: https://github.com/jmmv/kyua/