freebsd-ports/benchmarks/Makefile

# $FreeBSD$
#

    COMMENT = Benchmarking tools

    SUBDIR += autobench
    SUBDIR += blogbench
    SUBDIR += bonnie
    SUBDIR += bonnie++
    SUBDIR += dbench
    SUBDIR += dbs
    SUBDIR += dkftpbench
    SUBDIR += fhourstones
    SUBDIR += filebench
    SUBDIR += flops
    SUBDIR += forkbomb
    SUBDIR += geekbench
    SUBDIR += gsbench
    SUBDIR += gtkperf
    SUBDIR += himenobench
    SUBDIR += hpl
    SUBDIR += hs-criterion
    SUBDIR += httperf
    SUBDIR += imb
    SUBDIR += iozone
    SUBDIR += iozone21
    SUBDIR += iperf
    SUBDIR += libmicro
    SUBDIR += lmbench
    SUBDIR += mdtest
    SUBDIR += nbench
    SUBDIR += netio
    SUBDIR += netperf
    SUBDIR += netperfmeter
    SUBDIR += netpipe
    SUBDIR += nqueens
    SUBDIR += nttcp
    SUBDIR += nuttcp
    SUBDIR += octave-forge-benchmark
    SUBDIR += p5-Benchmark-Forking
    SUBDIR += p5-Benchmark-Stopwatch
    SUBDIR += pathchirp
    SUBDIR += pathload
    SUBDIR += pathrate
    SUBDIR += pear-Benchmark
    SUBDIR += phoronix-test-suite
    SUBDIR += pipebench
    SUBDIR += pnetmark
    SUBDIR += polygraph
    SUBDIR += polygraph31
    SUBDIR += postal
    SUBDIR += postmark
    SUBDIR += pybench
    SUBDIR += raidtest
    SUBDIR += randomio
    SUBDIR += rubygem-railsbench
    SUBDIR += scimark2
    SUBDIR += scimark2c
    SUBDIR += siege
    SUBDIR += sipp
    SUBDIR += slowloris
    SUBDIR += stream
    SUBDIR += super-smack
    SUBDIR += sysbench
    SUBDIR += tcpblast
    SUBDIR += thrulay
    SUBDIR += ttcp
    SUBDIR += ubench
    SUBDIR += unixbench
    SUBDIR += webbench
    SUBDIR += xdd
    SUBDIR += xengine

.include <bsd.port.subdir.mk>
Change Id->FreeBSD. 1999-08-25 04:58:03 +00:00			`# $FreeBSD$`
New Makefile with bonnie, iozone, lmbench and tcpblast. Welcome to your new home, babies! 1995-07-13 00:03:08 +00:00			`#`

Remove category pkg/COMMENT files in favour of a COMMENT variable in the category makefile. Submitted by: Matthew Seaman <m.seaman@infracaninophile.co.uk> PR: 59651 2004-04-02 07:29:48 +00:00			`COMMENT = Benchmarking tools`

add autobench 2.0.1 Automating the process of benchmarking a web server 2003-10-20 16:46:17 +00:00			`SUBDIR += autobench`
Blogbench is a portable filesystem benchmark that tries to reproduce the load of a real-world busy file server. It stresses the filesystem with multiple threads performing random reads, writes and rewrites in order to get a realistic idea of the scalability and the concurrency a system can handle. WWW: http://blogbench.pureftpd.org/ PR: ports/77490 Submitted by: Janos Mohacsi <janos.mohacsi@bsd.hu> 2005-02-14 21:04:04 +00:00			`SUBDIR += blogbench`
New Makefile with bonnie, iozone, lmbench and tcpblast. Welcome to your new home, babies! 1995-07-13 00:03:08 +00:00			`SUBDIR += bonnie`
add bonnie++ Performance Test of Filesystem I/O 2001-03-24 16:39:32 +00:00			`SUBDIR += bonnie++`
Add dbench 1.3, a simulation of the Ziff-Davis netbench benchmark. PR: 35055 Submitted by: Andrew Shevtsov <nyxo@dnuc.polyn.kiae.su> 2002-02-24 03:46:12 +00:00			`SUBDIR += dbench`
Enable DBS. 1998-08-01 23:36:52 +00:00			`SUBDIR += dbs`
Add dkftpbench 0.45, dkftpbench is an FTP benchmark program inspired by SPECweb99. The result of the benchmark is a number-of-simultaneous-users rating; after running the benchmark properly, you have a good idea how many simultaneous dialup clients a server can support. The target bandwidth per client is set at 28.8 kilobits/second to model dialup users; this is important for servers on the real Internet, which often serve thousands of clients on only 10 MBits/sec of bandwidth. PR: ports/73006 Submitted by: Roman Bogorodskiy <bogorodskiy@inbox.ru> 2004-10-26 18:45:44 +00:00			`SUBDIR += dkftpbench`
This integer benchmark solves positions in the game of connect-4, as played on a vertical 7x6 board. This takes about 10 minutes on contemporary PCs. WWW: http://homepages.cwi.nl/~tromp/c4/fhour.html PR: ports/105778 Submitted by: trasz <trasz at pin.if.uz.zgora.pl> 2006-11-23 11:56:19 +00:00			`SUBDIR += fhourstones`
Add new port benchmarks/filebench Filebench is quick to set up and use unlike many of the commercial benchmarks which it can emulate. It is also a handy tool for micro-benchmarking storage subsystems and studying the relationships of complex applications such as relational databases with their storage without having to incur the costs of setting up those applications, loading data and so forth. Filebench uses loadable workload personalities in a common framework to allow easy emulation of complex applications upon file systems. The workload personalities use a Workload Definition Language to define the workload's model. WWW: http://www.solarisinternals.com/wiki/index.php/FileBench WWW: http://www.fsl.cs.sunysb.edu/~vass/filebench/ PR: ports/153750 Submitted by: "Tom Judge" <tom@tomjudge.com> Approved by: fjoe (mentor) 2011-01-09 08:08:50 +00:00			`SUBDIR += filebench`
Add flops, floating point benchmark to give your MFLOPS rating. Inspired by: NetBSD pkgsrc 2005-07-06 10:02:08 +00:00			`SUBDIR += flops`
Add forkbomb 1.0, system stress testing tool. PR: ports/61717 Submitted by: Radim Kolar Approved by: nork (mentor/implicitly) 2004-01-22 17:57:44 +00:00			`SUBDIR += forkbomb`
Geekbench is a cross-platform benchmark suite for Mac OS X, Windows, Solaris, and Linux. Geekbench is designed to measure the performance an average application can expect from both the processor and the memory subsystem. Geekbench's benchmarks are written in platform-neutral C++, and have no platform-specific optimizations. Geekbench is compiled with what we consider the de-facto standard compiler for each platform, with the compiler switches suggested by the compiler vendor for release code. WWW: http://www.geekpatrol.ca/geekbench/ PR: ports/106533 Submitted by: Gea-Suan Lin <gslin@gslin.org> 2008-04-05 18:25:40 +00:00			`SUBDIR += geekbench`
This is GSBench for GNUstep. It started as a simple conversion of NXBench for NEXTSTEP. I rewrote the entire application for version 0.5 in order to have an open architecture which allows the integration of other benchmarks by using bundles. WWW: http://www.nice.ch/~phip/softcorner.html 2006-12-14 20:16:43 +00:00			`SUBDIR += gsbench`
GtkPerf is an application designed to test GTK+ performance. The point is to create common testing platform to run predefined GTK+ widgets (opening comboboxes, toggling buttons, scrolling text yms.) and this way define the speed of device/platform. WWW: http://gtkperf.sourceforge.net PR: ports/96162 Submitted by: Andreas Kohn <andreas@syndrom23.de> 2006-05-01 13:26:55 +00:00			`SUBDIR += gtkperf`
Add Himeno Benchmark. this suite was made by HIMENO, Ryutaro, for evaluation of performance of the calculation of incompressible flow analysis. This program solves Poisson equation by Jacobi's iterative method which have many loops 2004-08-16 08:14:12 +00:00			`SUBDIR += himenobench`
High Performance Computing Linpack Benchmark - needs an MPI implementation (mpich and lam are supported by this port) - needs an Basic Linear Algebra Subprograms implementation like atlas (default) or blas (both are supported by this port) tested on alpha (5), amd64 (5) and i386 (4 and 5) 2004-02-25 18:06:01 +00:00			`SUBDIR += hpl`
This Haskell library provides a powerful but simple way to measure the performance of Haskell code. It provides both a framework for executing and analysing benchmarks and a set of driver functions that makes it easy to build and run benchmarks, and to analyse their results. WWW: http://hackage.haskell.org/package/criterion PR: ports/142495 Submitted by: Jacula Modyun <jacula(at)gmail.com> 2010-01-12 21:53:30 +00:00			`SUBDIR += hs-criterion`
- Move httperf from www to benchmarks category Noticed by: ben @ EFNet Repocopied by: marcus 2004-06-10 06:22:15 +00:00			`SUBDIR += httperf`
The idea of IMB is to provide a concise set of elementary MPI benchmark kernels. With one executable, all of the supported benchmarks, or a subset specified by the command line, can be run. The rules, such as time measurement (including a repetitive call of the kernels for better clock synchronization), message lengths, selection of communicators to run a particular benchmark (inside the group of all started processes) are program parameters. WWW: http://www.intel.com/cd/software/products/asmo-na/eng/cluster/mpi/219848.htm PR: ports/105665 Submitted by: trasz <trasz at pin.if.uz.zgora.pl> 2006-11-20 21:26:53 +00:00			`SUBDIR += imb`
New Makefile with bonnie, iozone, lmbench and tcpblast. Welcome to your new home, babies! 1995-07-13 00:03:08 +00:00			`SUBDIR += iozone`
Add iozone21. 2000-01-14 02:08:53 +00:00			`SUBDIR += iozone21`
- Move iperf from net to benchmarks PR: ports/81201 Submitted by: Marcus Grando <marcus@corp.grupos.com.br> (maintainer) Repocopy by: marcus 2005-05-21 20:09:28 +00:00			`SUBDIR += iperf`
Add libmicro - a set of portable benchmarks of system calls from opensolaris project. Approved by: perky (mentor) In collaboration with: gnn 2005-08-28 09:05:53 +00:00			`SUBDIR += libmicro`
New Makefile with bonnie, iozone, lmbench and tcpblast. Welcome to your new home, babies! 1995-07-13 00:03:08 +00:00			`SUBDIR += lmbench`
The mdtest software is used for testing the metadata performance of a file system. WWW: http://www.llnl.gov/icc/lc/siop/ PR: ports/112237 Submitted by: Chao Shin <quakelee at cn.freebsd.org> 2007-04-30 07:10:52 +00:00			`SUBDIR += mdtest`
Activate nbench. 1998-03-27 12:29:00 +00:00			`SUBDIR += nbench`
Add netio, a simple network benchmark 2005-01-09 19:10:24 +00:00			`SUBDIR += netio`
Add netperf. 1996-08-04 08:45:44 +00:00			`SUBDIR += netperf`
NetPerfMeter is a network performance meter for the UDP, TCP, SCTP and DCCP transport protocols over IPv4 and IPv6. It simultaneously transmits bidirectional flows to an endpoint and measures the resulting flow bandwidths and QoS. The results are written as vector and scalar files. The vector files can e.g. be used to create plots of the results. WWW: http://www.iem.uni-due.de/~dreibh/netperfmeter/ PR: ports/148994 Approved by: tabthorpe (mentor) 2010-09-21 14:17:23 +00:00			`SUBDIR += netperfmeter`
Activate netpipe. 1999-02-21 00:05:45 +00:00			`SUBDIR += netpipe`
Add nqueens 1.0, n-queens problem benchmark. PR: ports/78274 Submitted by: NAKAJI Hiroyuki <nakaji(at)jp.freebsd.org> 2005-05-25 10:52:42 +00:00			`SUBDIR += nqueens`
[REPOCOPY WAITING] ports/net/nttcp and ports/net/ttcp appear miscategorized Julian Elischer suggested a new category "net/benchmarks" because he believes that too many ports are listed under net/. Checking into it, I noticed that these two ports are described as benchmarking programs. In the Porters' Handbook, the net category is described as "miscellaneous networking software". The benchmarks category seems more specific so I feel that it is preferable. PR: ports/39095 Submitted by: Trevor Johnson <trevor@jpj.net> 2004-01-16 01:38:55 +00:00			`SUBDIR += nttcp`
nuttcp is a network performance measurement tool intended for use by network and system managers. Its most basic usage is to determine the raw TCP (or UDP) network layer throughput by transferring memory buffers from a source system across an interconnecting network to a destination system, either transferring data for a specified time interval, or alternatively transferring a specified number of bytes. nuttcp is based on nttcp, but have several useful features such as a server mode, rate limiting, multiple parallel streams, and timer based usage. WWW: http://www.lcp.nrl.navy.mil/nuttcp/ PR: ports/137876 Submitted by: Andy Clark <andrewclarkii at gmail.com> 2009-09-03 19:03:12 +00:00			`SUBDIR += nuttcp`
The octave-forge package is the result of The GNU Octave Repositry project, which is intended to be a central location for custom scripts, functions and extensions for GNU Octave. contains the source for all the functions plus build and install scripts. This is benchmark. The package contains code used to benchmark speed of Octave. WWW: http://octave.sourceforge.net/ PR: 127301 Submitted by: Stephen Montgomery-Smith <stephen at math dot missouri dot edu> 2008-09-24 07:26:36 +00:00			`SUBDIR += octave-forge-benchmark`
Add p5-Benchmark-Forking 0.99, run benchmarks in separate processes. PR: ports/107593 Submitted by: Gea-Suan Lin <gslin at gslin.org> 2007-01-08 03:48:30 +00:00			`SUBDIR += p5-Benchmark-Forking`
Add p5-Benchmark-Stopwatch 0.03, simple timing of stages of your code. PR: ports/102468 Submitted by: Gea-Suan Lin <gslin at gslin.org> 2006-09-30 08:08:28 +00:00			`SUBDIR += p5-Benchmark-Stopwatch`
Add pathchirp. pathChirp is a new active probing tool for estimating the available bandwidth on a communication network path. Based on the concept of "self-induced congestion", pathChirp features an exponential flight pattern of probes we call a chirp. Packet chirps offer several significant advantages over current probing schemes based on packet pairs or packet trains. By rapidly increasing the probing rate within each chirp, pathChirp obtains a rich set of information from which to dynamically estimate the available bandwidth. WWW: http://www.spin.rice.edu/Software/pathChirp/ PR: ports/81293 Submitted by: dikshie <dikshie@lapi.itb.ac.id> 2005-05-23 23:17:37 +00:00			`SUBDIR += pathchirp`
Add pathload. Pathload is a tool that can estimate the available bandwidth of network paths. WWW: http://www.cc.gatech.edu/fac/Constantinos.Dovrolis/pathload.html PR: ports/81294 Submitted by: dikshie <dikshie@lapi.itb.ac.id> 2005-05-23 23:20:51 +00:00			`SUBDIR += pathload`
Add pathrate. Pathrate is a tool that can estimate the capacity of network paths. An important feature of Pathrate is that it is robust to cross traffic effects, meaning that it can measure the path capacity even when the path is significantly loaded. This is crucial, since the hardest paths to measure are the heavily loaded ones. WWW: http://www.cc.gatech.edu/fac/Constantinos.Dovrolis/pathrate.html PR: ports/81295 Submitted by: dikshie <dikshie@lapi.itb.ac.id> 2005-05-23 23:23:23 +00:00			`SUBDIR += pathrate`
Add pear-Benchmark 1.2.1, framework to benchmark PHP scripts or function calls. PR: 71528 Submitted by: Antônio Carlos Venâncio Júnior 2004-10-18 15:11:32 +00:00			`SUBDIR += pear-Benchmark`
New port -- Phoronix Benchmarking Suite Approved by: miwi(mentor) Feature safe: yes 2010-02-22 18:38:12 +00:00			`SUBDIR += phoronix-test-suite`
misc/pipebench -> benchmarks/pipebench 2003-01-18 03:17:18 +00:00			`SUBDIR += pipebench`
Add pnetmark, a benchmark program for Common Language Runtime (C#) PR: ports/64641 Submitted by: michael johnson <ahze@ahze.net> 2004-03-25 20:12:35 +00:00			`SUBDIR += pnetmark`
Enter polygraph, a benchmarking tool for Web proxies. 1999-04-14 20:39:06 +00:00			`SUBDIR += polygraph`
Please repocopy benchmarks/polygraph to benchmarks/polygraph31 I'm going to update the polygraph port to a more reasonable release; I'd like it to be a new port which I can maintain. PR: ports/124405 Submitted by: Adrian Chadd <adrian@FreeBSD.org> 2008-06-18 10:47:08 +00:00			`SUBDIR += polygraph31`
add postal, a SMTP/POP benchmark tester 2001-04-02 06:23:50 +00:00			`SUBDIR += postal`
turn on postmark 1999-09-19 04:20:19 +00:00			`SUBDIR += postmark`
Add pybench 0.8, an extensible benchmark suite for Python. 2001-03-29 13:26:14 +00:00			`SUBDIR += pybench`
pjd's src/tools/tools/raidtest as a port. 2004-12-05 04:13:29 +00:00			`SUBDIR += raidtest`
Randomio is a multithreaded disk i/o microbenchmark. It requires O_DIRECT, pread/pwrite, and pthreads. WWW: http://www.arctic.org/~dean/randomio/ PR: ports/149838 Submitted by: Sergey Kandaurov <pluknet at gmail dot com> (maintainer) Approved by: beat (co-mentor) 2010-08-23 11:20:59 +00:00			`SUBDIR += randomio`
Add rubygem-railsbench 0.9.2, scripts designed for benchmarking of Rails applications. PR: ports/111134 Submitted by: Alexander Logvinov <ports at logvinov.com> 2007-04-03 01:56:08 +00:00			`SUBDIR += rubygem-railsbench`
New port: benchmarks/scimark2 - a Java benchmark. SciMark 2.0 is a Java benchmark for scientific and numerical computing. It measures several computational kernels and reports a composite score in approximate Mflops (Millions of floating point operations per second). Suggested by May Tho. PR: ports/50645 Submitted by: Thierry Thomas <thierry@pompo.net> 2003-08-29 03:50:28 +00:00			`SUBDIR += scimark2`
New port: benchmarks/scimark2c - an ANSI C version of the SciMark2 benchmark. This is an ANSI C version of the SciMark2 benchmark, translated from the original Java sources. The intent in making this benchmark available in C is mainly for performance comparisons. Suggested by May Tho. PR: ports/50646 Submitted by: Thierry Thomas <thierry@pompo.net> 2003-08-29 03:41:04 +00:00			`SUBDIR += scimark2c`
Add siege 2.00, a http regression testing and benchmarking utility. PR: 27831 Submitted by: Mark Pulford <mark@kyne.com.au> 2001-06-08 04:18:55 +00:00			`SUBDIR += siege`
- Move sipp to new category benchmarks. [1] - Update to 2.0.20071024. [2] PR: ports/117305 [1], ports/117463 [2] Submitted by: araujo [1], Artem Naluzhnyy <tut@nhamon.com.ua> (maintainer) [2] Approved by: stas (mentor, implicit) 2007-12-17 01:43:56 +00:00			`SUBDIR += sipp`
Slowloris both helps identify the timeout windows of a HTTP server or Proxy server, can bypass httpready protection and ultimately performs a fairly low bandwidth denial of service. It has the added benefit of allowing the server to come back at any time (once the program is killed), and not spamming the logs excessively. It also keeps the load nice and low on the target server, so other vital processes don't die unexpectedly, or cause alarm to anyone who is logged into the server for other reasons. The main audience using slowloris is of course a system administrators wanting to measure their webserver's performance and vulnerability. WWW: http://ha.ckers.org/slowloris/ PR: ports/136281 Submitted by: Alexey V. Degtyarev 2009-07-13 22:40:20 +00:00			`SUBDIR += slowloris`
Add stream-1.0, a synthetic benchmark program that measures sustainable memory bandwidth PR: 27272 Submitted by: Scott Flatman <sf@dsinw.com> 2001-11-06 20:17:17 +00:00			`SUBDIR += stream`
Add super-smack 1.3, a benchmarking, stress testing, and load generation tool for Databases. PR: ports/90209 Submitted by: Gea-Suan Lin <gslin@ccca.nctu.edu.tw> 2005-12-11 11:16:20 +00:00			`SUBDIR += super-smack`
Add sysbench 0.4.3, a modular, cross-platform and multi-threaded benchmark tool. PR: 90233 Submitted by: Gea-Suan Lin <gslin@ccca.nctu.edu.tw> 2005-12-11 13:56:12 +00:00			`SUBDIR += sysbench`
New Makefile with bonnie, iozone, lmbench and tcpblast. Welcome to your new home, babies! 1995-07-13 00:03:08 +00:00			`SUBDIR += tcpblast`
The program thrulay is used to measure the capacity, delay, and other performance metrics of a network by sending a bulk TCP or UDP stream over it. Special features of thrulay include: * For TCP, ability to measure round-trip delay along with throughput * For UDP, ability to measure - one-way delay, with quantiles - packet loss - packet duplication - reordering * For UDP, the ability to send precisely positioned true Poisson streams (microsecond errors in sending times) * Human- and machine-readable output (ready to be fed to gnuplot) WWW: http://www.internet2.edu/~shalunov/thrulay/ PR: ports/87683 Submitted by: Stanislav Shalunov <shalunov@internet2.edu> 2005-10-20 19:32:15 +00:00			`SUBDIR += thrulay`
[REPOCOPY WAITING] ports/net/nttcp and ports/net/ttcp appear miscategorized Julian Elischer suggested a new category "net/benchmarks" because he believes that too many ports are listed under net/. Checking into it, I noticed that these two ports are described as benchmarking programs. In the Porters' Handbook, the net category is described as "miscellaneous networking software". The benchmarks category seems more specific so I feel that it is preferable. PR: ports/39095 Submitted by: Trevor Johnson <trevor@jpj.net> 2004-01-16 01:38:55 +00:00			`SUBDIR += ttcp`
Activate ubench. 2000-06-06 13:38:50 +00:00			`SUBDIR += ubench`
Remove bytebench port, which has been repo-copied to unixbench since development seems to continue now and an upgrade has been published under this new name. Forgotten by: se 2005-01-09 10:51:11 +00:00			`SUBDIR += unixbench`
Add webbench 1.3, simple forking web benchmark. PR: ports/61307 Submitted by: Radim Kolar <hsn@netmag.cz> Approved by: nork (mentor/implicitly) 2004-01-13 22:37:34 +00:00			`SUBDIR += webbench`
- Repocopy sysutils/xdd -> benchmarks/xdd since it's a better category for this PR: ports/117407 Submitted by: obrien@ Repocopied by: marcus@ Approved by: maintainer 2007-12-21 15:31:18 +00:00			`SUBDIR += xdd`
enable new xengine port 1997-02-16 13:32:59 +00:00			`SUBDIR += xengine`
New Makefile with bonnie, iozone, lmbench and tcpblast. Welcome to your new home, babies! 1995-07-13 00:03:08 +00:00
			`.include <bsd.port.subdir.mk>`