Jens Axboe [Mon, 2 Jun 2008 10:55:03 +0000 (12:55 +0200)]
Missed fls() -> __fls() conversion
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:52:56 +0000 (12:52 +0200)]
Fio 1.21-rc5
Getting close to 1.21, all three supported platforms (Linux, Solaris,
and FreeBSD) now compile and work fine.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:51:42 +0000 (12:51 +0200)]
FreeBSD Makefile update
Don't ask...
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:50:10 +0000 (12:50 +0200)]
mutex: only regard less-than-zero return as error
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:30:06 +0000 (12:30 +0200)]
net engine: missing includes
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:28:02 +0000 (12:28 +0200)]
posixaio: not all platforms have aio_fsync()
FreeBSD is (again) the odd man out...
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:25:12 +0000 (12:25 +0200)]
posixaio: need fcntl.h
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:23:40 +0000 (12:23 +0200)]
Guard posix_fallocate() behind OS define
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:22:30 +0000 (12:22 +0200)]
Rename fls() to __fls()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:19:50 +0000 (12:19 +0200)]
Not all platforms have ENODATA
So use EIO instead.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 10:19:19 +0000 (12:19 +0200)]
Rename list_* function and file to flist_ to avoid conflict with FreeBSD
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 09:59:30 +0000 (11:59 +0200)]
Add Solaris native aio engine
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 08:37:36 +0000 (10:37 +0200)]
Don't make posix_fallocate() set td->verror
It's supposed to be an error log, not stop the job.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 08:17:12 +0000 (10:17 +0200)]
Fio 1.21-rc4
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 08:15:48 +0000 (10:15 +0200)]
Do at least one block if randommap fails us
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 08:09:43 +0000 (10:09 +0200)]
Inc block in mark_random_map()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 07:59:32 +0000 (09:59 +0200)]
smalloc: use optimized ffz()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 07:57:41 +0000 (09:57 +0200)]
Be sure to use internal __ffs, not glibc variant
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 07:53:05 +0000 (09:53 +0200)]
Speedup mark_random_map()
Do each int at the time, not each bit.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 07:43:29 +0000 (09:43 +0200)]
x86-64: enable arch ffz again
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 07:41:51 +0000 (09:41 +0200)]
x86-64: ffz need only search the first 32-bits
So use bsfl, not bsfq.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 07:41:29 +0000 (09:41 +0200)]
Fix off-by-one in generic ffz
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 2 Jun 2008 07:19:37 +0000 (09:19 +0200)]
Add missing lib/ffz.h file
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Sun, 1 Jun 2008 17:45:10 +0000 (19:45 +0200)]
Readd the arch ffz functions
May as well use the single op version if we have them, it's
generally a lot faster than the generic_ffz()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 22:21:12 +0000 (00:21 +0200)]
ffz() takes ints, so change the file_map to being int based
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 22:04:45 +0000 (00:04 +0200)]
Add sparc and sparc64 support
Also get rid of the arch private ffz functions, the generic
one is just fine.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 21:18:00 +0000 (23:18 +0200)]
Seperate status timer setup from disk util timer
It's still the same timer and shared, but move it out of
diskutil so we get proper status reporting on non-Linux.
We also need to rearm the signal handlers on each signal.
Move this to sigaction() next.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:58:37 +0000 (22:58 +0200)]
Fixup posix_fallocate() usage
It returns the error directly, not through errno. Also make
it non-fatal, Solaris seems to complain about it.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:58:28 +0000 (22:58 +0200)]
errno is not negative
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:50:09 +0000 (22:50 +0200)]
strsep got lost in Makefile.solaris
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:33:47 +0000 (22:33 +0200)]
Cleanup lib/strsep.c
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:25:48 +0000 (22:25 +0200)]
Remove icc reference in Linux Makefile
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:25:32 +0000 (22:25 +0200)]
Fix build with FIO_INC_DEBUG not included
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:23:53 +0000 (22:23 +0200)]
More fixes to FreeBSD and Solaris Makefile
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:17:45 +0000 (22:17 +0200)]
Move the lib/ stuff around a bit
And actually remember to commit the lib/ files...
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:07:49 +0000 (22:07 +0200)]
Add dprint() to io_u requeue
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:07:12 +0000 (22:07 +0200)]
close_ioengine() clears ->data after calling engine cleanup
Then we can remove that bit from io engines.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 20:03:46 +0000 (22:03 +0200)]
vsync: Fix issue with double issue of io_u
We'd lseek to the same location twice, making sequential
IO lseek() and read/write to each location twice.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 13:02:38 +0000 (15:02 +0200)]
Make it work on opensolaris
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Gurudas Pai [Fri, 30 May 2008 11:35:00 +0000 (13:35 +0200)]
Fix bad references to 'sgio'
The engine name is 'sg', so change bad references to sgio.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 30 May 2008 11:29:03 +0000 (13:29 +0200)]
net engine: improve host/port parsing
It was too relaxed before.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 28 May 2008 08:56:58 +0000 (10:56 +0200)]
Fio 1.21-rc3
Quickly approaching 1.21 final, a few more critical fixes added.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 28 May 2008 08:54:01 +0000 (10:54 +0200)]
Fix bug in put_file() and __file_invalidate_cache()
- put_file() has bad logic in detecting fsync() error, only set
ret to f_ret if f_ret indicates failure.
- Check for open file in __file_invalidate_cache()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 28 May 2008 08:53:44 +0000 (10:53 +0200)]
Fix refill buffers overwriting verify data
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 28 May 2008 08:35:42 +0000 (10:35 +0200)]
Merge branch 'master' of ssh://router/data/git/fio
Jens Axboe [Wed, 28 May 2008 08:35:26 +0000 (10:35 +0200)]
Fixup distribution of reads and writes in a mixed workload
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 28 May 2008 08:33:32 +0000 (10:33 +0200)]
Fixup rwmixread/write options
They would always end up as 50/50.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 18:49:52 +0000 (20:49 +0200)]
Fio 1.21-rc2
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 18:49:29 +0000 (20:49 +0200)]
smalloc: final cleanups
Passes all regressions and tests, must be Bug Free.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 18:35:18 +0000 (20:35 +0200)]
smalloc: fix map overflow
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 12:44:23 +0000 (14:44 +0200)]
smalloc: fix off-by-one in ptr_valid()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 12:13:26 +0000 (14:13 +0200)]
smalloc: kill another debug printf()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 12:12:45 +0000 (14:12 +0200)]
smalloc: fix compile error
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 12:11:56 +0000 (14:11 +0200)]
smalloc: cleanup and remove debug printf()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 09:57:58 +0000 (11:57 +0200)]
Fio 1.21-rc1
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 09:40:37 +0000 (11:40 +0200)]
smalloc: turn on the thread safe flag
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 27 May 2008 09:39:39 +0000 (11:39 +0200)]
smalloc: change to a bitmap allocator
It's a lot cleaner and easier to understand than the previous one,
even if it does waste some more memory.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 26 May 2008 14:38:28 +0000 (16:38 +0200)]
Fix out-of-band deref of (potentially) gone threads structure
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 26 May 2008 12:53:24 +0000 (14:53 +0200)]
Remove early directory check
It wont work on FIO_DISKLESSIO engines and the engine isn't loaded
at this point so we cannot check. For now just disable the check.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 26 May 2008 07:37:21 +0000 (09:37 +0200)]
smalloc: add pre and post redzone checks to pointers
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 23 May 2008 11:38:41 +0000 (13:38 +0200)]
Non-linux Makefile updates
Need to find a build host, seems there are other issues that need
to be fixed as well.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 23 May 2008 11:28:59 +0000 (13:28 +0200)]
Silence warning on older gcc (bogus)
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 23 May 2008 10:37:23 +0000 (12:37 +0200)]
Work-around too large block count
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 23 May 2008 09:55:53 +0000 (11:55 +0200)]
Add job number specific dumping and fix atexit() error
The threads/process jobs should use _exit() so they don't run
the main atexit() function.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 23 May 2008 08:11:27 +0000 (10:11 +0200)]
smalloc: debug
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 23 May 2008 08:10:54 +0000 (10:10 +0200)]
smalloc: increase alloc size
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 22 May 2008 11:08:23 +0000 (13:08 +0200)]
Add logging for queue submit and complet counts
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 22 May 2008 07:17:33 +0000 (09:17 +0200)]
If verify is enabled, automatically enable refill_buffers
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 21 May 2008 17:52:35 +0000 (19:52 +0200)]
Add option for refilling IO buffers on each submit
If the device looks at whether the data changed, then this can
make a difference.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 16 May 2008 10:31:36 +0000 (12:31 +0200)]
Silence put_file() complaint
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 15 May 2008 08:19:46 +0000 (10:19 +0200)]
Fix bad interaction with file open/close and queuing
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 15 May 2008 07:49:09 +0000 (09:49 +0200)]
Improve iodepth logging
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 15 May 2008 07:20:08 +0000 (09:20 +0200)]
Fix off-by-one in last_block()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 15 May 2008 07:17:42 +0000 (09:17 +0200)]
Fix crash with iolog
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 14 May 2008 19:09:03 +0000 (21:09 +0200)]
Merge branch 'master' of ssh://git.kernel.dk/data/git/fio
Jens Axboe [Wed, 14 May 2008 19:08:37 +0000 (21:08 +0200)]
Allow marking of queue depth for more than 1 io_u at the time
Same code as before, just prepared for it.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 7 May 2008 12:28:22 +0000 (14:28 +0200)]
Put the logs in the current directory
It's nice to prefix the log with the proper job name, but that
meant that it would store them in weird places if you used /dev/sda
for the input device, for instance.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 25 Apr 2008 12:35:50 +0000 (14:35 +0200)]
Fio 1.20
Lots of changes since 1.19, the major feature being proper
sharing of files between jobs, file locking, and so on.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 24 Apr 2008 10:44:42 +0000 (12:44 +0200)]
Kill unused parameters
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 17 Apr 2008 07:26:27 +0000 (09:26 +0200)]
smalloc: remove pool resize support
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 16 Apr 2008 17:51:46 +0000 (19:51 +0200)]
smalloc: cleanups and allow sfree(NULL)
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 16 Apr 2008 17:47:21 +0000 (19:47 +0200)]
smalloc: remember to account for sizeof block header
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 16 Apr 2008 17:43:17 +0000 (19:43 +0200)]
smalloc: when adding a new pool, make it big enough to hold the failing alloc
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Tue, 15 Apr 2008 07:20:46 +0000 (09:20 +0200)]
Update 'overwrite' option documentation
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 11 Apr 2008 07:17:41 +0000 (09:17 +0200)]
Fio 1.20-rc4
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 11 Apr 2008 07:16:59 +0000 (09:16 +0200)]
README: add hint on missing libaio-devel package
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Thu, 10 Apr 2008 18:52:40 +0000 (20:52 +0200)]
libaio: Add hint on libaio engine init failing
If io_queue_init() fails, it's likely due to a lack of
aio request resources.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 7 Apr 2008 07:26:02 +0000 (09:26 +0200)]
Mark rwmixcycle option as deprecated in the option parser
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 7 Apr 2008 07:25:47 +0000 (09:25 +0200)]
Remove rwmixcycle HOWTO entry
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 7 Apr 2008 07:19:46 +0000 (09:19 +0200)]
Base the rwmix switch algorithm on io issues
The time based switch can be unfair sometimes, so just simplify it a bit
and use issues only.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Mon, 7 Apr 2008 07:00:54 +0000 (09:00 +0200)]
Need to prefix directory= setting before checking dir part of filename=
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Sun, 6 Apr 2008 10:19:05 +0000 (12:19 +0200)]
Improve eta calculation and display for complex jobs
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 4 Apr 2008 21:15:19 +0000 (23:15 +0200)]
Improve naming in fio gnuplot graphs
Use job name and strip the known postfix of files out of the title.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Fri, 4 Apr 2008 11:47:20 +0000 (13:47 +0200)]
Merge branch 'master' of ssh://git.kernel.dk/data/git/fio
Jens Axboe [Fri, 4 Apr 2008 09:10:30 +0000 (11:10 +0200)]
If a file is extended, drop extended length in cache
Similar to how the cache state would be the next time the job is run,
good for consistency.
Reported and suggested by "Zhang, Yanmin" <yanmin_zhang@linux.intel.com>.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 26 Mar 2008 09:32:57 +0000 (10:32 +0100)]
Add softrandommap and --alloc-size options
The softrandommap job option allows fio to continue if it cannot
allocate from the smalloc backing for the random map. Or the user
can specify --alloc-size with a size larger than the default of 1024k
to increase the size of the shared allocation pool.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 26 Mar 2008 09:11:10 +0000 (10:11 +0100)]
Allow randommap allocation to fail
It's not that critical, so just print a warning and continue
without randommap.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 26 Mar 2008 09:05:43 +0000 (10:05 +0100)]
smalloc: increase initial pool size from 64k to 1m
We allocate randommaps from that pool as well and they can grow
quite large.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 26 Mar 2008 08:57:18 +0000 (09:57 +0100)]
Fix badly merged dprint()
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
Jens Axboe [Wed, 26 Mar 2008 08:23:04 +0000 (09:23 +0100)]
Merge branch 'master' of ssh://router/data/git/fio