fio.git
9 years agoGet rid of uninitialized_var()
Jens Axboe [Tue, 13 Nov 2012 15:31:24 +0000 (08:31 -0700)]
Get rid of uninitialized_var()

It causes complaints on other compilers (clang). One case
was actually not used at all, initialize the rest to 0.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFix wrong return type on td_error_type()
Jens Axboe [Tue, 13 Nov 2012 15:30:56 +0000 (08:30 -0700)]
Fix wrong return type on td_error_type()

It returns enum error_type_bit, not error_type.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoe4defrag: fix always true comparison
Jens Axboe [Tue, 13 Nov 2012 15:30:30 +0000 (08:30 -0700)]
e4defrag: fix always true comparison

len is unsigned so it is always >= 0.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agojson: fix off-by-one in memory alloc
Jens Axboe [Tue, 13 Nov 2012 12:55:38 +0000 (05:55 -0700)]
json: fix off-by-one in memory alloc

Tighten it a bit too, checking for empty string.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agogenzipf: use regular array + qsort() instead of rbtree
Jens Axboe [Tue, 13 Nov 2012 03:54:12 +0000 (20:54 -0700)]
genzipf: use regular array + qsort() instead of rbtree

Saves lots of allocations, and actually ends up being a bit faster.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoJSON: fix escape of '"' and '\' characters
Jens Axboe [Tue, 13 Nov 2012 03:52:10 +0000 (20:52 -0700)]
JSON: fix escape of '"' and '\' characters

Reported-by: Kepler Kramer <kkramer@fusionio.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agogenzipf: add size and percentage hit rates
Jens Axboe [Sun, 11 Nov 2012 23:04:48 +0000 (16:04 -0700)]
genzipf: add size and percentage hit rates

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agozipf: use 64-bit safe hash for zipf/pareto
Jens Axboe [Sun, 11 Nov 2012 07:27:24 +0000 (08:27 +0100)]
zipf: use 64-bit safe hash for zipf/pareto

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agogenzipf: more features
Jens Axboe [Fri, 9 Nov 2012 08:05:24 +0000 (09:05 +0100)]
genzipf: more features

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMakefile: 2nd go at making CC assignment/check actually work
Jens Axboe [Thu, 8 Nov 2012 20:56:05 +0000 (21:56 +0100)]
Makefile: 2nd go at making CC assignment/check actually work

This time tested!

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoUse more portable construct for setting/checking CC
Jens Axboe [Thu, 8 Nov 2012 20:46:03 +0000 (21:46 +0100)]
Use more portable construct for setting/checking CC

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoUse ETIMEDOUT instead of ETIME for exceeding max latency
Jens Axboe [Thu, 8 Nov 2012 20:38:35 +0000 (21:38 +0100)]
Use ETIMEDOUT instead of ETIME for exceeding max latency

ETIME isn't very portable...

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agozipf: kill debug "generating series" messages
Jens Axboe [Thu, 8 Nov 2012 12:43:21 +0000 (13:43 +0100)]
zipf: kill debug "generating series" messages

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agozipf: cap range calculation at 10M
Jens Axboe [Thu, 8 Nov 2012 11:45:58 +0000 (12:45 +0100)]
zipf: cap range calculation at 10M

It's fast enough to get rid of the fio.zipf.* file caching,
yet precise enough that we need not care more about it.
Even on a slower machines, generating a sequence of 10M takes
1-2s tops.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoZipf theta must be different than 1.0
Jens Axboe [Thu, 8 Nov 2012 07:36:00 +0000 (08:36 +0100)]
Zipf theta must be different than 1.0

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agozipf: seed zipf/pareto rand with filename hash and job id
Jens Axboe [Wed, 7 Nov 2012 18:47:47 +0000 (19:47 +0100)]
zipf: seed zipf/pareto rand with filename hash and job id

We don't want 4 jobs operating on the same file to use the
same hot spots.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agozipf: cleanup
Jens Axboe [Wed, 7 Nov 2012 15:12:43 +0000 (16:12 +0100)]
zipf: cleanup

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agozipf/pareto: ensure that 0 isn't always the hottest block
Jens Axboe [Wed, 7 Nov 2012 13:04:11 +0000 (14:04 +0100)]
zipf/pareto: ensure that 0 isn't always the hottest block

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd safe checks for valid pareto input value
Jens Axboe [Wed, 7 Nov 2012 12:47:22 +0000 (13:47 +0100)]
Add safe checks for valid pareto input value

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMakefile: typo
Jens Axboe [Wed, 7 Nov 2012 12:40:01 +0000 (13:40 +0100)]
Makefile: typo

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMerge branch 'master' of ssh://brick.kernel.dk/data/git/fio
Jens Axboe [Wed, 7 Nov 2012 12:39:18 +0000 (13:39 +0100)]
Merge branch 'master' of ssh://brick.kernel.dk/data/git/fio

9 years agogenzipf: fix off-by-one in output array calculation
Jens Axboe [Wed, 7 Nov 2012 12:35:41 +0000 (13:35 +0100)]
genzipf: fix off-by-one in output array calculation

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agogenzipf: improve accuracy
Jens Axboe [Wed, 7 Nov 2012 10:43:50 +0000 (11:43 +0100)]
genzipf: improve accuracy

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agorbtree: add rb_next()
Jens Axboe [Wed, 7 Nov 2012 10:40:03 +0000 (11:40 +0100)]
rbtree: add rb_next()

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agozipf/pareto: mix blocks with hashing
Jens Axboe [Wed, 7 Nov 2012 10:39:30 +0000 (11:39 +0100)]
zipf/pareto: mix blocks with hashing

We don't want to favor any end of the block spectrum.
Mix with a hash.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMake the zipf/pareto state per file
Jens Axboe [Wed, 7 Nov 2012 08:15:45 +0000 (09:15 +0100)]
Make the zipf/pareto state per file

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMove code around to satisfy t/stest linkage
Jens Axboe [Tue, 6 Nov 2012 21:10:43 +0000 (22:10 +0100)]
Move code around to satisfy t/stest linkage

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFix t/ieee754 link
Jens Axboe [Tue, 6 Nov 2012 20:54:30 +0000 (21:54 +0100)]
Fix t/ieee754 link

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agogenzip updates
Jens Axboe [Tue, 6 Nov 2012 18:02:53 +0000 (19:02 +0100)]
genzip updates

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agot/genzipf update
Jens Axboe [Tue, 6 Nov 2012 15:15:58 +0000 (16:15 +0100)]
t/genzipf update

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd t/genzipf to play with distribution settings
Jens Axboe [Tue, 6 Nov 2012 15:09:14 +0000 (16:09 +0100)]
Add t/genzipf to play with distribution settings

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agozipf: needs inttypes.h
Jens Axboe [Tue, 6 Nov 2012 15:05:50 +0000 (16:05 +0100)]
zipf: needs inttypes.h

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd pareto distribution randomizer
Jens Axboe [Tue, 6 Nov 2012 12:50:32 +0000 (13:50 +0100)]
Add pareto distribution randomizer

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd forgotten minmax.h include file
Jens Axboe [Tue, 6 Nov 2012 09:52:32 +0000 (10:52 +0100)]
Add forgotten minmax.h include file

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMerge branch 'master' of ssh://brick.kernel.dk/data/git/fio
Jens Axboe [Tue, 6 Nov 2012 09:52:06 +0000 (10:52 +0100)]
Merge branch 'master' of ssh://brick.kernel.dk/data/git/fio

9 years agoAdd sample zipf distribution randomizer
Jens Axboe [Tue, 6 Nov 2012 09:49:42 +0000 (10:49 +0100)]
Add sample zipf distribution randomizer

Instead of just doing purely random IO where each block is
touched exactly (or close to, depending on random map) once,
add a zipf distribution scheme where a selectable theta
defines the spread and frequency of blocks read/written.

Committing this so I don't lose it. Needs a few changes,
for instance we need to hash the zipf output so that
the spread doesn't always just favor the lower LBA range.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agosmalloc: move to size_t for allocations
Jens Axboe [Fri, 2 Nov 2012 15:47:03 +0000 (16:47 +0100)]
smalloc: move to size_t for allocations

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMerge branch 'master' of ssh://brick.kernel.dk/data/git/fio
Jens Axboe [Fri, 2 Nov 2012 15:36:16 +0000 (16:36 +0100)]
Merge branch 'master' of ssh://brick.kernel.dk/data/git/fio

9 years agosmalloc: fix int truncation issue
Jens Axboe [Fri, 2 Nov 2012 15:35:18 +0000 (16:35 +0100)]
smalloc: fix int truncation issue

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd max_latency option
Jens Axboe [Wed, 24 Oct 2012 14:37:45 +0000 (16:37 +0200)]
Add max_latency option

If set, fio will exit if it sees a total IO latency that exceeds
this value.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agordma: cleanup and fixes
Jens Axboe [Wed, 24 Oct 2012 12:16:45 +0000 (14:16 +0200)]
rdma: cleanup and fixes

Mostly style cleanups, but also a fix for checking and using
OS rand if set. rdma should just always use the internal rand
generator.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agordma: fixup compile issue
Jens Axboe [Wed, 24 Oct 2012 12:06:35 +0000 (14:06 +0200)]
rdma: fixup compile issue

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agordma: use private random state
Jens Axboe [Wed, 24 Oct 2012 07:14:24 +0000 (09:14 +0200)]
rdma: use private random state

We can't reuse td->__random_state as that will impact the sequence
of offsets we generate for random IO.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agordma ioengine improvement
Yufei Ren [Tue, 23 Oct 2012 01:29:38 +0000 (21:29 -0400)]
rdma ioengine improvement

1) Use fio shipped reentrant and thread-safe rand to replace buggy rand().
2) Add a pause time period before client start committing IOs.
In SEND/RECV test, it's a good practice to setup the iodepth of
of the RECV side deeper than that of the SEND side to
avoid RNR (receiver not ready) error. The
SEND side may send so many unsolicited message before
RECV side commits sufficient recv buffers into recv queue.
This may lead to RNR error. Here, SEND side pauses for a while
during which RECV side commits sufficient recv buffers.
3) Fix server thread hanging bug.
For RDMA WRITE/READ test, No IO bytes are accumulated in server side
during test. Server thread indicates its task completion by changing
its state into `done' as an alternitive. Add `td->done' checking in
do_io().
4) Some comments revision.
export EXTFLAGS and EXTLIBS with '+=".
explanation on exchanging steps of RDMA ioengine control messages.

All these changes are tested in 40Gbps RoCE and 56Gbps InfiniBand testbeds.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoReplace FIO_HAVE_RUSAGE_THREAD with RUSAGE_THREAD
Yufei Ren [Tue, 23 Oct 2012 01:29:37 +0000 (21:29 -0400)]
Replace FIO_HAVE_RUSAGE_THREAD with RUSAGE_THREAD

RUSAGE_THREAD is a more clear macro to enable getrusage() thread support.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd LICENSE file specyfing what I expect from people using fio
Jens Axboe [Tue, 23 Oct 2012 18:58:35 +0000 (20:58 +0200)]
Add LICENSE file specyfing what I expect from people using fio

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agobackend: only check bytes_done for engines without FIO_NOIO
Jens Axboe [Mon, 22 Oct 2012 18:36:26 +0000 (20:36 +0200)]
backend: only check bytes_done for engines without FIO_NOIO

This basically reverts the functional part of commit 2557f7e6.
Instead of having to fiddle with the io_u manually, have
the backend check whether we expect data to have been transerred
or not.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFine-grained job level numa control
Yufei Ren [Sat, 20 Oct 2012 03:11:52 +0000 (23:11 -0400)]
Fine-grained job level numa control

Two new options, numa_cpu_nodes and numa_mem_policy, are created
for a fine-grained job level numa control. Please refer HOWTO and
README for detailed description.
A example job, examples/numa, is added as well.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agothread cpu resource statistics bug fix
Yufei Ren [Sat, 20 Oct 2012 03:11:50 +0000 (23:11 -0400)]
thread cpu resource statistics bug fix

If `thread' option is enabled, resource usage should be thread
based instead of process based. For the following job,

fio --ioengine=cpuio --cpuload=50 --time_based --runtime=10 --name=j0 --numjobs=4 --thread

before patch, each thread CPU statistics:
...
  cpu          : usr=199.67%, sys=0.14%, ctx=1475, majf=0, minf=24
...

after patch:
...
  cpu          : usr=49.80%, sys=0.00%, ctx=79, majf=0, minf=18446744073709538943
...

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agocpuio engine cpuload bug fix
Yufei Ren [Sat, 20 Oct 2012 03:11:49 +0000 (23:11 -0400)]
cpuio engine cpuload bug fix

Current cpu ioengine always bruns out 100 percent cpu cycles
no matter what the cpuload value is. Since no data is transferred
with cpuio, bytes_done would be ZERO. Consequently, think_time
is omitted and loops keeps running.

A cpuio example is added as well.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoUpdate REPORTING-BUGS
Jens Axboe [Sat, 20 Oct 2012 17:55:50 +0000 (19:55 +0200)]
Update REPORTING-BUGS

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFio 2.0.10 fio-2.0.10
Jens Axboe [Wed, 10 Oct 2012 22:39:02 +0000 (16:39 -0600)]
Fio 2.0.10

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoWindows: handle SIGBREAK.
Bruce Cran [Wed, 10 Oct 2012 15:34:13 +0000 (16:34 +0100)]
Windows: handle SIGBREAK.

The only way to send a POSIX-style signal from another application on Windows
is to use GenerateConsoleCtrlEvent with either CTRL_C_EVENT or
CTRL_BREAK_EVENT. CTRL_BREAK_EVENT is the only one which gets through to
applications, so add a signal handler for it to allow fio to quit cleanly.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoWindows: avoid large writes during file layout.
Bruce Cran [Wed, 10 Oct 2012 15:24:16 +0000 (16:24 +0100)]
Windows: avoid large writes during file layout.

Avoid large buffered writes during file layout by flushing changes to disk by
calling _commit() after each write.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoHOWTO: indentation fix
Jens Axboe [Wed, 10 Oct 2012 15:09:59 +0000 (09:09 -0600)]
HOWTO: indentation fix

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agofio patch: Windows netio fixes
Bruce Cran [Wed, 10 Oct 2012 12:37:41 +0000 (13:37 +0100)]
fio patch: Windows netio fixes

Jens,

I've attached a patch to fix netio on Windows:

Add call to WSAStartup() to engines\net.c.
Fix NULL dereference in poll().
Add inet_aton().

--
Bruce Cran

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFix UDP acronym
Bruce Cran [Wed, 10 Oct 2012 14:17:44 +0000 (08:17 -0600)]
Fix UDP acronym

It's 'User', not 'Unreliable'.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd pending IO to the tail of the busy list
Bruce Cran [Wed, 10 Oct 2012 14:15:58 +0000 (08:15 -0600)]
Add pending IO to the tail of the busy list

We add at the head now. The windowsaio engine completes from
the head of the list, so lets ensure that we wait and complete
closer to the submit order.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agosolaris: fix compile error on ctime_r()
Saurabh De [Tue, 9 Oct 2012 20:46:24 +0000 (14:46 -0600)]
solaris: fix compile error on ctime_r()

On Solaris, it takes a 3rd length argument.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agooptions: cast page_size to unsigned long for sprintf()
Jens Axboe [Tue, 9 Oct 2012 16:30:48 +0000 (10:30 -0600)]
options: cast page_size to unsigned long for sprintf()

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFix confusion between terse and json output
Jens Axboe [Mon, 8 Oct 2012 19:34:31 +0000 (13:34 -0600)]
Fix confusion between terse and json output

It'd segfault trying to use json when it wasn't supposed to,
since we didn't have the parent set up appropriately.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoHOWTO: Fix description of grouping behavior with numjobs
Akash Verma [Thu, 4 Oct 2012 22:58:28 +0000 (15:58 -0700)]
HOWTO: Fix description of grouping behavior with numjobs

Signed-off-by: Akash Verma <akashv@google.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFix bad check for terse version format 4
Jens Axboe [Thu, 4 Oct 2012 15:06:49 +0000 (17:06 +0200)]
Fix bad check for terse version format 4

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoXP/2003 compatability fix
Bruce Cran [Wed, 3 Oct 2012 17:46:46 +0000 (19:46 +0200)]
XP/2003 compatability fix

The attached patch fixes the bug that on XP fio fails with:

"The procedure entry point vsprintf_s could not be located in the
dynamic link library msvcrt.dll".

Only Vista and newer have the 'secure' functions, so we need to use
vsprintf to maintain compatibility with XP.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFix segfault race on exit for platforms that don't have disk util support
Jens Axboe [Thu, 27 Sep 2012 09:31:50 +0000 (11:31 +0200)]
Fix segfault race on exit for platforms that don't have disk util support

We still need to quisce the disk util thread, as it also functions
as the runtime ETA status printer.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agonetbsd: fix gettid
Roger Pau Monne [Wed, 26 Sep 2012 10:42:35 +0000 (12:42 +0200)]
netbsd: fix gettid

Signed-off-by: Roger Pau Monne <roger.pau@citrix.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agobackend: fix data direction flow check
Dmitry Monakhov [Tue, 25 Sep 2012 10:12:36 +0000 (12:12 +0200)]
backend: fix data direction flow check

This patch fix regression caused SIGSEGV in case of writeonly
or readonly mode, caused by commit 59d8d0f5.

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoparser: fix overflowing integer type options
Jens Axboe [Mon, 24 Sep 2012 12:32:26 +0000 (14:32 +0200)]
parser: fix overflowing integer type options

If we use bs=4g, the parser will happily take it since it shares
the data type with unsigned long long options. Make sure that
FIO_OPT_INT types have a cap of UINT_MAX, if they haven't set
a lower limit.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agobackend: don't allocate memory buffers for non-data workloads
Jens Axboe [Mon, 24 Sep 2012 12:25:33 +0000 (14:25 +0200)]
backend: don't allocate memory buffers for non-data workloads

A trim workload doesn't transfer any actual data, so don't any
backing memory for the IO buffers.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoengine: fix error handling for e4defrag/falloc
Dmitry Monakhov [Sun, 23 Sep 2012 17:49:53 +0000 (21:49 +0400)]
engine: fix error handling for e4defrag/falloc

At the time I've wrote this code i don't quite understand difference
between td->error and io_u->error. It is appeared that engine should
not have to explicitly assign td->error. Just initialize io_u->error and
backed will do proper handling.

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agobackend: Add configurable non fatal error list
Dmitry Monakhov [Sun, 23 Sep 2012 11:46:09 +0000 (15:46 +0400)]
backend: Add configurable non fatal error list

Sometimes it is reasonable to perform test nearly system limits where
errors are possible and expected, in that case one may provide non
fatal error list which will be ignored during execution.
This patch add two options:
    ignore_error: List of non fatal error
    error_dump:   Whenever ignored list should be dumped to log.

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMerge branch 'master' of ssh://brick.kernel.dk/data/git/fio
Jens Axboe [Fri, 21 Sep 2012 13:06:23 +0000 (15:06 +0200)]
Merge branch 'master' of ssh://brick.kernel.dk/data/git/fio

9 years agoCheck for ENOSPC on shmget() failure
Jens Axboe [Fri, 21 Sep 2012 13:05:45 +0000 (15:05 +0200)]
Check for ENOSPC on shmget() failure

We scale down the number of jobs based on EINVAL and ENOMEM,
but ENOSPC is a valid 'segment too big' error as well.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMerge branch 'master' of ssh://brick.kernel.dk/data/git/fio
Jens Axboe [Fri, 21 Sep 2012 06:36:24 +0000 (08:36 +0200)]
Merge branch 'master' of ssh://brick.kernel.dk/data/git/fio

9 years agoCorrectly apply size percentage for file iosize
Shaohua Li [Fri, 21 Sep 2012 06:32:32 +0000 (08:32 +0200)]
Correctly apply size percentage for file iosize

The size percentage should be applied first when calculating file iosize,
otherwise it's a nop.

Signed-off-by: Shaohua Li <shli@fusionio.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoKill some newly added whitespace
Jens Axboe [Thu, 20 Sep 2012 17:23:02 +0000 (19:23 +0200)]
Kill some newly added whitespace

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agooptions: wire up e4defrag and falloc engines
Jens Axboe [Thu, 20 Sep 2012 11:46:34 +0000 (13:46 +0200)]
options: wire up e4defrag and falloc engines

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoparse: increase max option possible values to 24
Jens Axboe [Thu, 20 Sep 2012 11:46:15 +0000 (13:46 +0200)]
parse: increase max option possible values to 24

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoupdate documentation for falloc and e4defrag engines
Dmitry Monakhov [Thu, 20 Sep 2012 11:37:17 +0000 (15:37 +0400)]
update documentation for falloc and e4defrag engines

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agofalloc: fix return value from queue
Dmitry Monakhov [Thu, 20 Sep 2012 11:37:16 +0000 (15:37 +0400)]
falloc: fix return value from queue

Fix mistypo which causes internal assertation failure, this engine
will always return FIO_Q_COMPLETED

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoMakefile: break long line
Jens Axboe [Wed, 19 Sep 2012 19:36:18 +0000 (21:36 +0200)]
Makefile: break long line

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoengine: add e4defrag engine
Dmitry Monakhov [Wed, 19 Sep 2012 19:22:56 +0000 (23:22 +0400)]
engine: add e4defrag engine

IO engine that does regular EXT4_IOC_MOVE_EXT ioctls to simulate
defragment activity

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoioengine: Add fallocate ioengine
Dmitry Monakhov [Wed, 19 Sep 2012 19:22:55 +0000 (23:22 +0400)]
ioengine: Add fallocate ioengine

IO engine that does regular fallocate to simulate data transfer
as fio ioengine.
 DDIR_READ  does fallocate(,mode=FALLOC_FL_KEEP_SIZE,)
 DDIR_WRITE does fallocate(,mode=0) : fallocate with file extention
 DDIR_TRIM  does fallocate(FALLOC_FL_KEEP_SIZE | FALLOC_FL_PUNCH_HOLE)

This engine may be useful to perform various tests:
1) Generation highly fragmentated files
2) Various fs stress testing in parallel with others io activity

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoioengine: allow several external ioengines
Dmitry Monakhov [Wed, 19 Sep 2012 19:22:54 +0000 (23:22 +0400)]
ioengine: allow several external ioengines

Currently only one external ioengine can be exported because
it use hardcoded 'ioengine' symbol, but if we allow external
modules to have ops symbol similar to it's name then several
extrnal engines become possible.

NOTE: Old linking layout preserved

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoexport file_lookup_open
Dmitry Monakhov [Wed, 19 Sep 2012 19:22:53 +0000 (23:22 +0400)]
export file_lookup_open

generic_open_file is not always appropriate method, but other modules
may want to implement similar callback and use hash optimization.

Signed-off-by: Dmitry Monakhov <dmonakhov@openvz.org>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agofusion-aw-sync: fixup GPL disclaimer
Jens Axboe [Wed, 19 Sep 2012 06:35:17 +0000 (08:35 +0200)]
fusion-aw-sync: fixup GPL disclaimer

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoWire up fusion-aw-sync engine
Jens Axboe [Tue, 18 Sep 2012 21:55:43 +0000 (23:55 +0200)]
Wire up fusion-aw-sync engine

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd support for Fusion-io atomic write engine
Santhosh Koundinya [Tue, 18 Sep 2012 21:20:21 +0000 (23:20 +0200)]
Add support for Fusion-io atomic write engine

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd --output-format command line option
Jens Axboe [Mon, 17 Sep 2012 11:34:16 +0000 (13:34 +0200)]
Add --output-format command line option

Right now we have normal, terse, and json output. Lets add a parameter
that controls how to output results, instead of having options for
both terse and json outputs. If we are going to add a 4th output
type in the future, it's only going to get more messy.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd a simple json encoder and use it to print fio output in json format
Shaohua Li [Mon, 17 Sep 2012 07:12:18 +0000 (09:12 +0200)]
Add a simple json encoder and use it to print fio output in json format

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoDefault to terse version 3
Jens Axboe [Fri, 14 Sep 2012 21:35:08 +0000 (23:35 +0200)]
Default to terse version 3

4 will include the trim output, and we'll augment that with json output
as well. To avoid breaking anyone who's using the git pulls for their
testing, we'll default to version 3 for now.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd ddir_rw_sum()
Jens Axboe [Fri, 14 Sep 2012 06:59:20 +0000 (08:59 +0200)]
Add ddir_rw_sum()

We sum up the three data direction primitives a lot, this is
more readable.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoAdd support for trim as a workload type
Shaohua Li [Fri, 14 Sep 2012 06:49:43 +0000 (08:49 +0200)]
Add support for trim as a workload type

This only works on Linux so far, and it's always sync given what
the interface to the kernel looks like. Also restricted to pure
block devices.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agowindows: reduce block size used in posix_fallocate()
Bruce Cran [Thu, 6 Sep 2012 15:08:49 +0000 (09:08 -0600)]
windows: reduce block size used in posix_fallocate()

Reduce the buffer size in posix_fallocate() to avoid
compatability problems.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agolibaio: use INT_MAX to signal that we don't want the ring buffer
Jens Axboe [Thu, 6 Sep 2012 15:07:44 +0000 (09:07 -0600)]
libaio: use INT_MAX to signal that we don't want the ring buffer

We can't use 0 since the libaio library _also_ checks the
nr_events being passed in. So lets use INT_MAX instead.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agolibaio: pass in 0 for queue depth if we can
Jens Axboe [Tue, 4 Sep 2012 17:47:00 +0000 (11:47 -0600)]
libaio: pass in 0 for queue depth if we can

We don't need the user ring, unless the job file specified
that we need it. So tell the kernel. Fall back to passing
in the normal queue depth, if the kernel doesn't support
disabling the user ring.

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agofio:modify a deprecated parameter(change timeout to runtime)
liang xie [Fri, 31 Aug 2012 15:22:42 +0000 (08:22 -0700)]
fio:modify a deprecated parameter(change timeout to runtime)

since "timeout" had been deprecated long long ago, we should replace
to "runtime" both in code and docs

Signed-off-by: Liang Xie <xieliang@xiaomi.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoFixup README indentation
xieliang [Fri, 31 Aug 2012 15:11:26 +0000 (08:11 -0700)]
Fixup README indentation

Some tabs were missing.

Signed-off-by: xieliang <xieliang@xiaomi.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoREADME: update for newer client job file argument format
Jens Axboe [Sun, 26 Aug 2012 17:32:22 +0000 (19:32 +0200)]
README: update for newer client job file argument format

Signed-off-by: Jens Axboe <axboe@kernel.dk>
9 years agoclient: support per-client job files
Jens Axboe [Sun, 26 Aug 2012 15:30:45 +0000 (17:30 +0200)]
client: support per-client job files

Currently the fio network client sends all job files to all clients.
This isn't very flexible.

Add support for specifying a specific job file for each client. Example:

$ fio --client hostname1 jobfile1 --client hostname2 jobfile2

would before add jobfile1 and jobfile2 as job files for both clients.
With this change, only jobfile1 is sent to hostname1, and only
jobfile2 is sent to hostname2.

Signed-off-by: Jens Axboe <axboe@kernel.dk>