Jens Axboe [Mon, 10 Oct 2005 11:28:13 +0000 (13:28 +0200)]
[PATCH] blkparse: fix memory leaks
Jens Axboe [Mon, 10 Oct 2005 10:54:54 +0000 (12:54 +0200)]
[PATCH] blkparse: suff[] should not be static
Jens Axboe [Mon, 10 Oct 2005 10:52:39 +0000 (12:52 +0200)]
[PATCH] blkparse: remember to bail out if conversion gets too large
Jens Axboe [Mon, 10 Oct 2005 10:47:47 +0000 (12:47 +0200)]
[PATCH] blkparse: pretty up stats print by converting to correct K/M/G
Jens Axboe [Mon, 10 Oct 2005 10:20:29 +0000 (12:20 +0200)]
[PATCH] blkparse: kill debug statement in rate calculation
Jens Axboe [Mon, 10 Oct 2005 10:11:16 +0000 (12:11 +0200)]
[PATCH] blkparse: fix bad comment in recent checkin
Jens Axboe [Mon, 10 Oct 2005 10:10:04 +0000 (12:10 +0200)]
[PATCH] blkparse: include rate dump for stats
Jens Axboe [Mon, 10 Oct 2005 10:09:20 +0000 (12:09 +0200)]
[PATCH] blkparse: maintain map of online CPUs instead of open files
The ->nopenfiles fix is not enough, since it doesn't tell us if
the right CPUs are online or not.
Jens Axboe [Sun, 9 Oct 2005 14:07:14 +0000 (16:07 +0200)]
[PATCH] Add large file support for 32-bit platforms
Jens Axboe [Sun, 9 Oct 2005 10:35:49 +0000 (12:35 +0200)]
[PATCH[ verify_blkparse: dump number of events scanned
Jens Axboe [Sun, 9 Oct 2005 10:31:30 +0000 (12:31 +0200)]
[PATCH] stopwatch usage may misorder first event
If the stopwatch_start happens to trigger when we only have
events from _some_ of the available cpus in the rb_sort tree,
the first event may be misreported. Check for that.
Jens Axboe [Sun, 9 Oct 2005 09:21:56 +0000 (11:21 +0200)]
[PATCH] verify_blkparse: check for correct number of arguments
Jens Axboe [Sun, 9 Oct 2005 09:14:47 +0000 (11:14 +0200)]
[PATCH] Making the pdf requires tetex and latex
Jens Axboe [Fri, 7 Oct 2005 14:06:00 +0000 (16:06 +0200)]
[PATCH] doc: blktrace.pdf: blktrace.tex dependency
Jens Axboe [Fri, 7 Oct 2005 12:05:18 +0000 (14:05 +0200)]
[PATCH] Switch hash option -h, update btrace for all new options
Jens Axboe [Fri, 7 Oct 2005 11:21:41 +0000 (13:21 +0200)]
[PATCH] blkparse: fix stat printing
Forgot to increment pci->nelems.
Jens Axboe [Fri, 7 Oct 2005 10:49:17 +0000 (12:49 +0200)]
[PATCH] Add -v for being more verbose on non-fatal errors
Move version to -V instead.
Jens Axboe [Fri, 7 Oct 2005 09:18:13 +0000 (11:18 +0200)]
Merge branch 'master' of ssh://axboe@router.home.kernel.dk/data/git/blktrace
Jens Axboe [Fri, 7 Oct 2005 09:12:58 +0000 (11:12 +0200)]
[PATCH] blkparse_fmt: use memcmp() it is (usually) faster
At least it has better worst case performance.
Jens Axboe [Fri, 7 Oct 2005 08:59:32 +0000 (10:59 +0200)]
[PATCH] doc: simplify the git checkout command
Jens Axboe [Fri, 7 Oct 2005 08:58:16 +0000 (10:58 +0200)]
[PATCH] doc: add example of PC command tracing
Jens Axboe [Fri, 7 Oct 2005 08:50:56 +0000 (10:50 +0200)]
[PATCH] blkparse_fmt: Check for repeated zeroes in pdu
We can stop dumping the pdu (typically the cdb) if the rest is just
zeroes, append a .. to show that is the case. Saves screen space.
Jens Axboe [Fri, 7 Oct 2005 08:23:35 +0000 (10:23 +0200)]
[PATCH] blkparse: dump stdin entries on every iteration
Jens Axboe [Fri, 7 Oct 2005 08:22:41 +0000 (10:22 +0200)]
[PATCH] blktrace: fix error on stopping live trace and allow trace on CDROM
We need O_NONBLOCK to trace on an empty CDROM device
Jens Axboe [Fri, 7 Oct 2005 07:35:38 +0000 (09:35 +0200)]
[PATCH] Update README
Jens Axboe [Thu, 6 Oct 2005 15:29:31 +0000 (17:29 +0200)]
[PATCH] blktrace: gcc-4 signed vs unsigned warning
Jens Axboe [Thu, 6 Oct 2005 12:25:52 +0000 (14:25 +0200)]
[PATCH] blkparse: fix remap sectors dump, it was in kb
Add t_kb(t) and t_sec(t) macros to help with this.
Jens Axboe [Thu, 6 Oct 2005 09:03:20 +0000 (11:03 +0200)]
[PATCH] Add support for remap actions
Jens Axboe [Wed, 5 Oct 2005 15:54:17 +0000 (17:54 +0200)]
[PATCH] blktrace.tex: add description of each possible action
Jens Axboe [Wed, 5 Oct 2005 15:28:41 +0000 (17:28 +0200)]
Merge branch 'master' of ssh://axboe@brick.kernel.dk/data/git/blktrace
Jens Axboe [Wed, 5 Oct 2005 15:28:33 +0000 (17:28 +0200)]
[PATCH] blktrace.tex: add fs/pc request explanation
Kill the 1.1 ideas/questions section, everything in there has been
covered by now.
Jens Axboe [Wed, 5 Oct 2005 15:22:51 +0000 (17:22 +0200)]
[PATCH] Typo: __BIT_ENDIAN -> __BIG_ENDIAN
Jens Axboe [Wed, 5 Oct 2005 13:16:19 +0000 (15:16 +0200)]
[PATCH] Better endianness check
Jens Axboe [Wed, 5 Oct 2005 13:16:02 +0000 (15:16 +0200)]
[PATCH] Makefile: only include .c files in deps
Jens Axboe [Wed, 5 Oct 2005 11:05:00 +0000 (13:05 +0200)]
[PATCH] blktrace: sanity check the buf_size argument, cap at 16MiB.
Jens Axboe [Wed, 5 Oct 2005 09:48:14 +0000 (11:48 +0200)]
[PATCH] Makefile: dep fixup
Jens Axboe [Wed, 5 Oct 2005 09:47:25 +0000 (11:47 +0200)]
[PATCH] Makefile: add dependencies
Jens Axboe [Wed, 5 Oct 2005 09:44:50 +0000 (11:44 +0200)]
[PATCH] Forgot to kill root blktrace.tex
Jens Axboe [Wed, 5 Oct 2005 09:38:23 +0000 (11:38 +0200)]
[PATCH] Move docs to doc/
Alan D. Brunelle [Wed, 5 Oct 2005 09:07:49 +0000 (11:07 +0200)]
[PATCH] Add blktrace users guide
Jens Axboe [Wed, 5 Oct 2005 08:23:36 +0000 (10:23 +0200)]
[PATCH] blkparse: old patch broke the sequence check again
Jens Axboe [Wed, 5 Oct 2005 07:54:55 +0000 (09:54 +0200)]
[PATCH] blkparse: we have to allow one skip to prevent sequence screwups
If one CPU file is completed in the first run, check_sequence()
would allow it to skip too early causing unordered events.
Jens Axboe [Wed, 5 Oct 2005 07:53:31 +0000 (09:53 +0200)]
[PATCH] verify_blkparse: correct sscanf return
Jens Axboe [Wed, 5 Oct 2005 07:32:53 +0000 (09:32 +0200)]
[PATCH] Makefile: kill -W again
Jens Axboe [Wed, 5 Oct 2005 07:28:20 +0000 (09:28 +0200)]
[PATCH] Fix long options
Partly from Alan.
Jens Axboe [Wed, 5 Oct 2005 07:24:49 +0000 (09:24 +0200)]
Merge refs/heads/master from origin
Jens Axboe [Wed, 5 Oct 2005 07:24:44 +0000 (09:24 +0200)]
[PATCH] Remember to terminate options structure
If not an unknown option will segfault, woops.
Jens Axboe [Wed, 5 Oct 2005 07:13:29 +0000 (09:13 +0200)]
[PATCH] blktrace: fix a few -W warnings
And leave -W on in the Makefile
Alan D. Brunelle [Wed, 5 Oct 2005 07:12:17 +0000 (09:12 +0200)]
[PATCH] blkparse: Add -a/-A options to blkparse as well
This moves the mask stuff into a seperate file, act_mask.c
Jens Axboe [Tue, 4 Oct 2005 18:05:53 +0000 (20:05 +0200)]
[PATCH] Add -D output/input directory option to blkparse and blktrace
Jens Axboe [Tue, 4 Oct 2005 17:54:09 +0000 (19:54 +0200)]
[PATCH] blktrace: note that the -b option is in KiB
Jens Axboe [Tue, 4 Oct 2005 09:13:58 +0000 (11:13 +0200)]
[PATCH] blktrace: optimize the get_event() normal case
We usually only see partial traces in very few numbers (like
a few in a million), so optimize the normal case by getting
a full trace instead of splitting it into a 4-byte and remainder
read.
Jens Axboe [Mon, 3 Oct 2005 12:27:05 +0000 (14:27 +0200)]
[PATCH] blkparse: only break out of last loop if not dumping to stdout
Otherwise sending a ctrl-c when running btrace will quit, leaving
entries never dumped.
Jens Axboe [Mon, 3 Oct 2005 12:06:33 +0000 (14:06 +0200)]
[PATCH] blkparse: stdin sequence and aliases fixes
Jens Axboe [Mon, 3 Oct 2005 12:06:07 +0000 (14:06 +0200)]
[PATCH] blktrace: allow for unaligned events
Unfortunately it looks like we have to support this for now,
as it appears relayfs will still miss events on buffer wraps
for the read cases.
Jens Axboe [Mon, 3 Oct 2005 12:05:12 +0000 (14:05 +0200)]
[PATCH verify_blkparse: dump number of sequence aliases as well
Jens Axboe [Mon, 3 Oct 2005 12:04:48 +0000 (14:04 +0200)]
[PATCH] btrace: need large rb batch count for stdin sorting
Jens Axboe [Mon, 3 Oct 2005 09:33:59 +0000 (11:33 +0200)]
[PATCH] blktrace: various fixes
- Better exit_trace() backoff
- Don't assume that write() always writes the full chunk
- kill mmap(), we will never use it for packet driven workloads
- Bug in get_data_read/read_data() for incremental reads
- Optimize tid_fd_lock() holding, drop before freeing memory
Jens Axboe [Mon, 3 Oct 2005 08:06:01 +0000 (10:06 +0200)]
[PATCH] blkparse: kill old force debug print
Jens Axboe [Mon, 3 Oct 2005 07:05:01 +0000 (09:05 +0200)]
[PATCH] kernel: update patch to 2.6.14-rc3
Jens Axboe [Sun, 2 Oct 2005 19:34:10 +0000 (21:34 +0200)]
[PATCH] blkparse: Add option to print missing entries
And default to off, it can be fairly verbose.
Jens Axboe [Sun, 2 Oct 2005 13:39:14 +0000 (15:39 +0200)]
[PATCH] blkparse: check smallest sequence read
This allows check_sequence() to know when a skip happened and
when it is ok to proceed. Should be the final fix, now we now
when a sequence is missing and we nicely limit the memory
consumed in presence of large traces and missing entries.
This change brings down memory consumption of a skippy 1.3
million trace here down from 130MiB to 15MiB.
Jens Axboe [Fri, 30 Sep 2005 10:34:19 +0000 (12:34 +0200)]
[PATCH] blkparse: invert alloc checks, more intuitive
Jens Axboe [Fri, 30 Sep 2005 09:52:24 +0000 (11:52 +0200)]
[PATCH] blkparse: reduce memory consumption
- Better skip detection
- Limit maximum number of t/bit allocation cache entries
Nathan Scott [Fri, 30 Sep 2005 05:33:30 +0000 (07:33 +0200)]
[PATCH] blkparse: fix ->sector printing warnings
Jens Axboe [Thu, 29 Sep 2005 11:08:50 +0000 (13:08 +0200)]
[PATCH] README: add reference to gitweb on brick
Jens Axboe [Thu, 29 Sep 2005 10:01:37 +0000 (12:01 +0200)]
[PATCH] Assorted compiler warnings
Jens Axboe [Wed, 28 Sep 2005 15:57:03 +0000 (17:57 +0200)]
[PATCH] verify_blkparse: print events not ordered
And fix exit code.
Jens Axboe [Wed, 28 Sep 2005 15:50:56 +0000 (17:50 +0200)]
[PATCH] Add verify_blkparse description to README
Jens Axboe [Wed, 28 Sep 2005 15:45:51 +0000 (17:45 +0200)]
[PATCH] verify_blkparse: implement in C instead
The C version checks a 92MB file in 2 seconds where the php
version takes 23 seconds.
Jens Axboe [Wed, 28 Sep 2005 14:27:52 +0000 (16:27 +0200)]
[PATCH] verify_blkparse: missing line break
Thomas Kenne [Wed, 28 Sep 2005 13:51:16 +0000 (15:51 +0200)]
[PATCH] verify_blkparse: fix parsing
Current version would break, if the device number didn't have
a leading space.
Jens Axboe [Wed, 28 Sep 2005 13:41:22 +0000 (15:41 +0200)]
[PATCH] blkparse: prune old found entries in rb_last
Jens Axboe [Wed, 28 Sep 2005 13:40:16 +0000 (15:40 +0200)]
[PATCH] verify_blkparse: make sure file is readable
Jens Axboe [Wed, 28 Sep 2005 12:52:06 +0000 (14:52 +0200)]
[PATCH] verify_blkparse: proper check of file given
Jens Axboe [Wed, 28 Sep 2005 12:17:39 +0000 (14:17 +0200)]
[PATCH] blkparse: don't check time in last rb lookup
Thomas Kenne [Wed, 28 Sep 2005 12:12:55 +0000 (14:12 +0200)]
[PATCH] Add script to verify correctness of blkparse output
Only checks the time.
Jens Axboe [Wed, 28 Sep 2005 09:34:29 +0000 (11:34 +0200)]
[PATCH] blkparse: make the rb track root per-device
Jens Axboe [Wed, 28 Sep 2005 08:56:59 +0000 (10:56 +0200)]
[PATCH] blkparse: misc assorted fixes
- Move the trace verification earlier, so that traces on
trace_list are always known valid
- Start with -1 sequence so when using the stopwatch the
skip count is correct (first entry might not be 1)
- stdin get_cpu_info() fix
Jens Axboe [Wed, 28 Sep 2005 06:55:52 +0000 (08:55 +0200)]
[PATCH] kernel: move the plug/unplug logging around a little
Jens Axboe [Tue, 27 Sep 2005 22:03:59 +0000 (00:03 +0200)]
[PATCH] blkparse: sequence fixes
This should finally fix all the remaining sequence bugs. We
keep a backlog of already processed entries so we can lookup
any out-of-sequence events there. That takes care of one
direction of sequence and time mismatches. The other direction
is handled by fixing the trace_rb_find() lookup to work well
enough without having a precise time (which is the primary
key for the rb sort).
Jens Axboe [Tue, 27 Sep 2005 16:18:04 +0000 (18:18 +0200)]
[PATCH] blkparse: improve skip detection
Jens Axboe [Tue, 27 Sep 2005 13:38:08 +0000 (15:38 +0200)]
Forgot to kill old patch
Jens Axboe [Tue, 27 Sep 2005 10:18:14 +0000 (12:18 +0200)]
[PATCH] kernel: improve serialization and unplug logging
Jens Axboe [Tue, 27 Sep 2005 09:04:43 +0000 (11:04 +0200)]
Forgot to include the change for the last stopwatch fix...
Jens Axboe [Tue, 27 Sep 2005 08:22:33 +0000 (10:22 +0200)]
[PATCH] blkparse: another stab at stopwatch_end fixing
This should work reliably, the check is moved after we
have definitely called find_genesis().
Jens Axboe [Tue, 27 Sep 2005 08:15:24 +0000 (10:15 +0200)]
Revert "[PATCH] blkparse: final stopwatch check"
This reverts
a795e5fae97e14d77c3c3c7d0f6543e6c5f8c850 commit.
Jens Axboe [Tue, 27 Sep 2005 08:15:17 +0000 (10:15 +0200)]
[PATCH] blktrace: fix sparse warning
Jens Axboe [Mon, 26 Sep 2005 17:05:40 +0000 (19:05 +0200)]
[PATCH] blkparse: add %N format for bytes
We need this for PC requests, they are not multiples of 512
like the FS requests. At the same time change the default for
PC requests to dump in bytes.
Jens Axboe [Mon, 26 Sep 2005 13:42:05 +0000 (15:42 +0200)]
[PATCH] blkparse: final stopwatch check
Delayed quit when all files have been read and there are no
further entries beyond that point, then it is safe to quit
out early there as well.
Jens Axboe [Mon, 26 Sep 2005 13:36:19 +0000 (15:36 +0200)]
[PATCH] blkparse: more stopwatch cleanups
Jens Axboe [Mon, 26 Sep 2005 13:34:37 +0000 (15:34 +0200)]
[PATCH] blkparse: improve stopwatch
Move the checks much earlier, no point in doing a lot of
work for stuff we will toss out anyways.
Jens Axboe [Mon, 26 Sep 2005 12:38:23 +0000 (14:38 +0200)]
[PATCH] blkparse: hash-by-name fixes
- Be more precise in dumping (name, ...) in the stats, only do it
when there really was more than one.
- The -n option needs to clear the hash-by-pid variable.
Jens Axboe [Mon, 26 Sep 2005 12:32:59 +0000 (14:32 +0200)]
[PATCH] blkparse: oops, missed removing a hash debug statement
Jens Axboe [Mon, 26 Sep 2005 12:30:12 +0000 (14:30 +0200)]
[PATCH] TODO: add entry about fixing show_entries_rb() OOO logic
Jens Axboe [Mon, 26 Sep 2005 12:26:24 +0000 (14:26 +0200)]
[PATCH] blkparse: Add option to hash process by name
For some traces, you really don't want to see thousands of cc1
processes in the stats, you want to collect the stats by name
instead. This adds the -n option to blkparse, enabling that.
Switched to Jenkins hash at the same time, as it allows for
easy hash-by-u32 or hash-by-name as we see fit.
Jens Axboe [Mon, 26 Sep 2005 11:12:33 +0000 (13:12 +0200)]
[PATCH] blkparse: more sequence fixes
Jens Axboe [Mon, 26 Sep 2005 10:26:29 +0000 (12:26 +0200)]
[PATCH] blkparse: improve skipping and genesis_time lookup
Jens Axboe [Mon, 26 Sep 2005 09:51:58 +0000 (11:51 +0200)]
[PATCH] blkparse: hardcode the default formats instead of parsing them
It takes a lot of time to manually parse each individual trace,
and there's really no point in doing that work if the user did
not specificy a custom format. We now only parse the given custom
formats.
Without any custom formats (eg the default), parsing a trace of
1.3 million entries now takes 4.3 seconds where it took 11.25 before.
Jens Axboe [Mon, 26 Sep 2005 08:50:04 +0000 (10:50 +0200)]
[PATCH] blkparse: force dump of remaining rb entries on reading done
Otherwise we may not display a significant chunk of entries.