Jens Axboe [Tue, 4 Oct 2011 13:11:44 +0000 (15:11 +0200)]
Update TODO
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 13:07:43 +0000 (15:07 +0200)]
server: cast sockaddr_in for accept()
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 13:06:42 +0000 (15:06 +0200)]
server: log where connection is coming from
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 13:00:30 +0000 (15:00 +0200)]
server: fix sk typo and add endian type to probe
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 12:50:21 +0000 (14:50 +0200)]
Need signal.h for sigaction()
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 12:45:20 +0000 (14:45 +0200)]
More endianness for platforms
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 12:30:33 +0000 (14:30 +0200)]
Wider endianness support
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:56:06 +0000 (13:56 +0200)]
HPUX endianness
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:54:12 +0000 (13:54 +0200)]
log: needs stdarg include for va_list
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:53:35 +0000 (13:53 +0200)]
Move endianness check to OS parts
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:46:08 +0000 (13:46 +0200)]
server: more debug dumping
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:45:50 +0000 (13:45 +0200)]
Fix bad indexing of options
It's optind - 1, not optind.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:30:11 +0000 (13:30 +0200)]
server: add a few more debug logging statements
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:27:34 +0000 (13:27 +0200)]
client: improve handling of non-newline text strings
Only prepend hostname if this is a new line.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:21:54 +0000 (13:21 +0200)]
server: improve exit handling
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:14:32 +0000 (13:14 +0200)]
client: improve poll() loop
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 11:14:13 +0000 (13:14 +0200)]
server: send return quit when asked to leave
The return quit will exit the client
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 10:42:06 +0000 (12:42 +0200)]
server: initial support for command line passing
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 08:34:03 +0000 (10:34 +0200)]
Style fixup
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 08:31:53 +0000 (10:31 +0200)]
server: fix for non zero appended strings
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 08:31:10 +0000 (10:31 +0200)]
parser: use logging infrastructure
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 07:18:30 +0000 (09:18 +0200)]
server: idle loop support
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 07:00:40 +0000 (09:00 +0200)]
client: probe command support
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 06:57:39 +0000 (08:57 +0200)]
server: error handling and probe command
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 4 Oct 2011 06:31:40 +0000 (08:31 +0200)]
client: handle connection failure
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 19:47:27 +0000 (21:47 +0200)]
server: silence mem debug warning
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 19:10:17 +0000 (21:10 +0200)]
server: remove some debug statements
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 19:09:14 +0000 (21:09 +0200)]
poll: break on EINTR without complaining
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 19:08:48 +0000 (21:08 +0200)]
server: fix typos in conversion
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 18:53:32 +0000 (20:53 +0200)]
server: attempt to handle client ctrl-c
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 17:44:41 +0000 (19:44 +0200)]
server: send network copy of run_str[]
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 14:48:30 +0000 (16:48 +0200)]
server: add ETA as a specific command
No more text passing for ETA.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 14:03:43 +0000 (16:03 +0200)]
Abstract out calculation of ETA from display of ETA
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 13:25:49 +0000 (15:25 +0200)]
Add TODO list
Not complete
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 13:03:08 +0000 (15:03 +0200)]
server: package defrag fix
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 12:45:27 +0000 (14:45 +0200)]
Add type checking to 16/32/64 endianness converters
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 12:24:03 +0000 (14:24 +0200)]
client: fixup quit
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 12:20:01 +0000 (14:20 +0200)]
server: transmit status as structures, not text
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 10:21:25 +0000 (12:21 +0200)]
Allocate thread_stat name arrays statically
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 10:14:19 +0000 (12:14 +0200)]
Move getrusage() out of thread_stat
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 10:12:03 +0000 (12:12 +0200)]
Move stat_io_bytes/time to thread_data
Anything that isn't needed to sum/show thread stats should not be
in struct thread_stat.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 10:01:42 +0000 (12:01 +0200)]
server: unify shm setup
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 09:48:39 +0000 (11:48 +0200)]
server: endianness bug and exit command
- flags should be converted to network native format
- add separate EXIT command for server, regular job completion should
not quit it
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 09:48:17 +0000 (11:48 +0200)]
client: don't setup shared mem area for just the frontend
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 08:06:44 +0000 (10:06 +0200)]
server: start conversion of data structures to network friendly types
Not done yet, but do the basic conversion.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 3 Oct 2011 07:11:02 +0000 (09:11 +0200)]
server: initial support for daemonizing
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sun, 2 Oct 2011 07:06:14 +0000 (03:06 -0400)]
server: make struct group_run_stats network transfer friendly
Use explicitly sized types.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sun, 2 Oct 2011 07:02:03 +0000 (03:02 -0400)]
Style fixup
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 20:26:42 +0000 (16:26 -0400)]
server: malloc/free fix
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 19:01:08 +0000 (15:01 -0400)]
Fixup some bad file naming
log.c does not match log.h. Rename the iolog stuff to iolog.c
and infolog.c to log.c (so it matches the include).
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 18:50:51 +0000 (12:50 -0600)]
server/client: add FD_NET debug clues
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 18:42:00 +0000 (12:42 -0600)]
Add FD_NET debugging value
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 18:40:32 +0000 (12:40 -0600)]
client: re-setup poll fd array in case a client disappears
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 18:36:32 +0000 (12:36 -0600)]
server: exit gracefully on ctrl-c
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 18:24:21 +0000 (12:24 -0600)]
client: continue support for multiple connections
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 17:11:35 +0000 (11:11 -0600)]
client: initial support for multiple connections
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 14:48:50 +0000 (08:48 -0600)]
server: ensure payload larger than max is broken into pieces
For debug purposes, set the max payload size to 64 to catch any
further issues while developing this.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 14:31:30 +0000 (08:31 -0600)]
server: quit client when job run is complete
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 06:08:39 +0000 (00:08 -0600)]
client: fix error in logging output
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 04:58:13 +0000 (22:58 -0600)]
server: serial is a 64-bit field
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 04:50:39 +0000 (22:50 -0600)]
server: switch to 16-bit crc
Good enough and we can kill the command padding
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 04:50:16 +0000 (22:50 -0600)]
Reinstate double logging if f_err != stderr
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 04:49:30 +0000 (22:49 -0600)]
crc16: use void * as the argument
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 04:29:08 +0000 (22:29 -0600)]
server: debug fixes
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 04:24:17 +0000 (22:24 -0600)]
Pass more arguments to fio_init_net_cmd()
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Sat, 1 Oct 2011 04:20:37 +0000 (22:20 -0600)]
Use length guarded sprintf functions
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 30 Sep 2011 23:35:45 +0000 (17:35 -0600)]
Server logging cleanup/functionality
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 30 Sep 2011 23:00:42 +0000 (17:00 -0600)]
Start of functional client
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 30 Sep 2011 21:01:32 +0000 (15:01 -0600)]
Add start of client, start of real protocol
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 30 Sep 2011 00:38:08 +0000 (18:38 -0600)]
Properly log errors in server
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 30 Sep 2011 00:28:46 +0000 (18:28 -0600)]
Close listen socket when done
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 30 Sep 2011 00:27:02 +0000 (18:27 -0600)]
Use poll() for connect loop
So we can exit nicely when asked to.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 30 Sep 2011 00:00:35 +0000 (18:00 -0600)]
Hide things not appropriate behind is_backend
Also add explicit command to exit the server, FIO_QUIT.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Thu, 29 Sep 2011 23:45:28 +0000 (17:45 -0600)]
Start of client/server
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Thu, 29 Sep 2011 15:21:49 +0000 (09:21 -0600)]
Include http:// git url location
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 27 Sep 2011 20:27:48 +0000 (14:27 -0600)]
Scramble corruption fix
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Wed, 21 Sep 2011 07:38:01 +0000 (09:38 +0200)]
Fix aiocb compile warnings on HPUX
Unlike other platforms, it seems to require aiocb64 explicitly
for long offsets. Add an os independent typedef for this.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Wed, 21 Sep 2011 07:27:24 +0000 (09:27 +0200)]
Silence build warning on HPUX
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 19 Sep 2011 09:33:30 +0000 (11:33 +0200)]
Scramble fix
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Mon, 19 Sep 2011 07:24:44 +0000 (09:24 +0200)]
Add option for controlling buffer scrambling
scramble_buffers bool option, defaults to on.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 16 Sep 2011 20:45:27 +0000 (22:45 +0200)]
Scramble on a 512b boundary
Instead of just scrambling the full block at the beginning at the
end, make it a bit more clever by:
- Doing it at 512b intervals to ensure full 512b de-dupe attemts, and
- Do it at a "random" offset into that block.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 16 Sep 2011 20:11:23 +0000 (22:11 +0200)]
Scramble default write buffer contents slightly
If we are worried about de-dupe making the output data too easy
to compress, but don't want the full incompressible guarantee
provided by refill_buffers=1 (since it's too costly), then lets
make their life a little harder by filling the offset of the IO
into the beginning of the buffer and the start time at the end
of the buffer. This will effectively default simple de-dupe
or compression attempts, while not doing the costly full buffer
refill.
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Fri, 16 Sep 2011 06:44:10 +0000 (08:44 +0200)]
Fio 1.58
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Zheng Liu [Fri, 16 Sep 2011 06:20:12 +0000 (08:20 +0200)]
Fix sum_stat() bug in group_reporting
Write samples in io_stat does not be counted with rw=randread, vice versa.
Then, in sum_stat() function, it will cause 0/0 in calculating mean and S,
and 'nan' is printed. So it should return immediately when src->samples is
equal to 0.
the error result is as follows:
write: io=8328.0KB, bw=1582.7KB/s, iops=395 , runt= 5262msec
clat (usec): min=58 , max=293353 , avg= -nan, stdev= -nan
lat (usec): min=59 , max=293353 , avg= -nan, stdev= -nan
bw (KB/s) : min= 92, max= 804, per=-nan%, avg= -nan, stdev= -nan
the configuration file used:
[global]
direct=1
ioengine=psync
bs=4k
filename=/dev/sdb1
runtime=5
group_reporting
loops=50
[read]
rw=randread
numjobs=8
[write]
rw=randwrite
numjobs=8
CC: Jens Axboe <jaxboe@fusionio.com>
CC: Yu-ju Hong <yjhong@google.com>
Signed-off-by: Zheng Liu <wenqing.lz@taobao.com>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Steven Noonan [Wed, 14 Sep 2011 07:21:33 +0000 (09:21 +0200)]
Fix inconsistencies in with man page <param>=<value>
Signed-off-by: Jens Axboe <axboe@kernel.dk>
Jens Axboe [Tue, 13 Sep 2011 08:12:12 +0000 (10:12 +0200)]
Improve wording on terse Total IO (KB) field
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Mon, 12 Sep 2011 09:30:01 +0000 (11:30 +0200)]
Merge branch 'master' of ssh://router/data/git/fio
Jens Axboe [Fri, 9 Sep 2011 19:01:37 +0000 (21:01 +0200)]
Add terse version output format command line parameter
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Thu, 8 Sep 2011 12:30:24 +0000 (14:30 +0200)]
Fix disk utilization for delayed jobs
We initialized it all before starting the jobs, so we would
easily see disk stats that were too low for jobs that ended
up being started later.
Fix this by moving the disk util init right before the jobs
are spawned.
Reported-by: Shrirang Phansalkar <sphansalkar@stec-inc.com>
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Thu, 8 Sep 2011 11:08:05 +0000 (13:08 +0200)]
Style fixup
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Wed, 7 Sep 2011 20:11:00 +0000 (22:11 +0200)]
Better parser fix
The previous one broke all postfixes for ranges, that wasn't
very nice. This one allows the proper postfix and +/- as well,
as long as the latter is seen before a digit.
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Wed, 7 Sep 2011 20:10:11 +0000 (22:10 +0200)]
Revert "Fix parser bug with ranges"
This reverts commit
f20485ad77872d6c5084dead547420386a6ecd5e.
Jens Axboe [Wed, 7 Sep 2011 19:21:07 +0000 (21:21 +0200)]
Fix parser bug with ranges
The change to allow -/+ for values broke ranges.
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Thu, 1 Sep 2011 15:58:11 +0000 (09:58 -0600)]
Use r/R/w/W instead of m/M for mixed workloads with 100% reads or writes
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Wed, 31 Aug 2011 22:45:03 +0000 (16:45 -0600)]
Only clear string pointer in parser for sub-value options
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Wed, 31 Aug 2011 21:20:15 +0000 (15:20 -0600)]
Ensure that buffer contents are random across jobs as well
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Wed, 31 Aug 2011 20:29:22 +0000 (14:29 -0600)]
Fix parser using uninitialized memory
Introduced by
e2979754b554d6a48cffa98f41fb59bc045922ac.
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Wed, 31 Aug 2011 19:14:12 +0000 (13:14 -0600)]
Add support for backwards holes
If you did:
bs=4k
rw=read:-8k
you would essentially rewind by 8k after reading 4k, causing
the read to be sequentially backwards.
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Wed, 31 Aug 2011 18:55:27 +0000 (12:55 -0600)]
Remove duplicate code in parser
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>
Jens Axboe [Wed, 31 Aug 2011 18:49:49 +0000 (12:49 -0600)]
Fix FIO_OPT_STR_STORE without posval
Signed-off-by: Jens Axboe <jaxboe@fusionio.com>