projects / linux-block.git / search
? search:
summary | shortlog | log | commit | commitdiff | tree
first ⋅ prev ⋅ next
io_uring: optimise deferred tw execution
2023-01-29 Pavel Begunkovio_uring: optimise deferred tw execution
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: add io_req_local_work_add wake fast path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: waitqueue-less cq waiting
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: wake up optimisations
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: add lazy poll_wq activation
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: separate wq for ring polling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: move io_run_local_work_locked
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: mark io_run_local_work static
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: don't set TASK_RUNNING in local tw runner
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: refactor io_wake_function
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: move submitter_task out of cold cacheline
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: keep timeout in io_wait_queue
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: optimise non-timeout waiting
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: set TASK_RUNNING right after schedule
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: simplify io_has_work
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: mimimise io_cqring_wait_schedule
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: parse check_cq out of wq waiting
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: move defer tw task checks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: kill io_run_task_work_ctx
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: don't iterate cq wait fast path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: rearrange defer list checks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-20 Pavel Begunkovio_uring/msg_ring: fix remote queue to disabled ring
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-20 Pavel Begunkovio_uring/msg_ring: fix flagging remote execution
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-17 Pavel Begunkovblock: fix hctx checks for batch allocation
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-13 Pavel Begunkovio_uring: lock overflowing for IOPOLL
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-05 Pavel Begunkovio_uring: fix CQ waiting timeout handling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-04 Pavel Begunkovio_uring: lockdep annotate CQ locking
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-04 Pavel Begunkovio_uring: pin context while queueing deferred tw
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-19 Pavel Begunkovio_uring/net: fix cleanup after recycle
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-15 Pavel Begunkovio_uring: fix overflow handling regression
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-14 Pavel Begunkovio_uring: ease timeout flush locking requirements
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-14 Pavel Begunkovio_uring: revise completion_lock locking
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-14 Pavel Begunkovio_uring: protect cq_timeouts with timeout_lock
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: skip spinlocking for ->task_complete
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: do msg_ring in target task via tw
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: extract a io_msg_install_complete helper
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: get rid of double locking
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: never run tw and fallback in parallel
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: use tw for putting rsrc
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: force multishot CQEs into task context
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: complete all requests in task context
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: don't check overflow flush failures
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: skip overflow CQE posting for dying ring
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: improve io_double_lock_ctx fail handling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: dont remove file from msg_ring reqs
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: reshuffle issue_flags
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: don't reinstall quiesce node for each tw
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: improve rsrc quiesce refs checks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: don't raw spin unlock to match cq_lock
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: combine poll tw handlers
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: improve poll warning handling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: remove ctx variable in io_poll_check_events
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: carve io_poll_check_events fast path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: kill io_poll_issue's PF_EXITING check
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-25 Pavel Begunkovio_uring: make poll refs more robust
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-25 Pavel Begunkovio_uring: cmpxchg for poll arm refs release
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-25 Pavel Begunkovio_uring: keep unlock_post inlined in hot path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-25 Pavel Begunkovio_uring: don't use complete_post in kbuf
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: remove iopoll spinlock
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: iopoll protect complete_post
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: inline __io_req_complete_put()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: remove io_req_tw_post_queue
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: use io_req_task_complete() in timeout
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: hold locks for io_req_complete_failed
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: add completion locking for iopoll
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring: inline __io_req_complete_post()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring: split tw fallback into a function
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring: inline io_req_task_work_add()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring/net: move mm accounting to a slower path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring: move zc reporting from the hot path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring/net: inline io_notif_flush()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring/net: rename io_uring_tx_zerocopy_callback
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring/net: preset notif tw handler
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring/net: remove extra notif rsrc setup
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-21 Pavel Begunkovio_uring: move kbuf put out of generic tw complete
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-18 Pavel Begunkovio_uring: disallow self-propelled ring polling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-17 Pavel Begunkovio_uring: fix multishot recv request leaks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-17 Pavel Begunkovio_uring: fix multishot accept request leaks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-17 Pavel Begunkovio_uring: fix tw losing poll events
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-17 Pavel Begunkovio_uring: update res mask in io_poll_check_events
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-16 Pavel Begunkovio_uring/rw: enable bio caches for IRQ rw
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-16 Pavel Begunkovbio: shrink max number of pcpu cached bios
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-16 Pavel Begunkovbio: add pcpu caching for non-polling bio_put
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-16 Pavel Begunkovbio: split pcpu cache part of bio_put into a helper
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-16 Pavel Begunkovbio: don't rob starving biosets of bios
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-16 Pavel Begunkovmempool: introduce mempool_is_saturated
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-11 Pavel Begunkovio_uring/poll: lockdep annote io_poll_req_insert_locked
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-11 Pavel Begunkovio_uring/poll: fix double poll req->flags races
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-02 Pavel Begunkovselftests/net: don't tests batched TCP io_uring zc
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-29 Pavel Begunkovnet/ulp: remove SOCK_SUPPORT_ZC from tls sockets
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-29 Pavel Begunkovnet: remove SOCK_SUPPORT_ZC from sockmap
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-29 Pavel Begunkovudp: advertise ipv6 udp support for msghdr::ubuf_info
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-22 Pavel Begunkovio_uring/net: fail zc sendmsg when unsupported by socket
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-22 Pavel Begunkovio_uring/net: fail zc send when unsupported by socket
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-22 Pavel Begunkovnet: flag sockets supporting msghdr originated zerocopy
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-20 Pavel Begunkovbio: safeguard REQ_ALLOC_CACHE bio put
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-16 Pavel Begunkovio_uring: don't iopoll from io_ring_ctx_wait_and_kill()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-16 Pavel Begunkovio_uring: reuse io_alloc_req()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-16 Pavel Begunkovio_uring: kill hot path fixed file bitmap debug checks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-10-16 Pavel Begunkovio_uring: remove FFS_SCM
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
next
Linux 6.x block layer and io_uring tree(s)