projects / linux-block.git / search
? search:
summary | shortlog | log | commit | commitdiff | tree
first ⋅ prev ⋅ next
io_uring: refactor io_cqring_wake()
2023-04-06 Pavel Begunkovio_uring: refactor io_cqring_wake()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-06 Pavel Begunkovio_uring: optimize local tw add ctx pinning
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-06 Pavel Begunkovio_uring: move pinning out of io_req_local_work_add
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: add custom limit for node caching
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: optimise io_rsrc_data refcounting
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: add lockdep sanity checks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: cache struct io_rsrc_node
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: don't offload node free
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: optimise io_rsrc_put allocation
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: rename rsrc_list
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: kill rsrc_ref_lock
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: protect node refs with uring_lock
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring: io_free_req() via tw
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring: don't put nodes under spinlocks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: keep cached refs per node
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-04 Pavel Begunkovio_uring/rsrc: use non-pcpu refcounts for nodes
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-03 Pavel Begunkovio_uring: encapsulate task_work state
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-03 Pavel Begunkovio_uring: remove extra tw trylocks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-04-03 Pavel Begunkovio_uring: kill unused notif declarations
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-03-30 Pavel Begunkovio_uring: fix poll/netmsg alloc caches
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-03-29 Pavel Begunkovio_uring/rsrc: fix rogue rsrc node grabbing
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-03-16 Pavel Begunkovio_uring/rsrc: fix folio accounting
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-03-16 Pavel Begunkovio_uring/msg_ring: let target know allocated index
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-02-22 Pavel Begunkovio_uring/rsrc: optimise registered huge pages
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-02-22 Pavel Begunkovio_uring/rsrc: optimise single entry advance
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-02-22 Pavel Begunkovio_uring/rsrc: disallow multi-source reg buffers
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-02-22 Pavel Begunkovio_uring: remove unused wq_list_merge
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-02-22 Pavel Begunkovio_uring/rsrc: fix a comment in io_import_fixed()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: return normal tw run linking optimisation
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: refactor tctx_task_work
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: refactor io_put_task helpers
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: refactor req allocation
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: improve io_get_sqe
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: kill outdated comment about overflow flush
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: use user visible tail in io_uring_poll()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: refactor __io_req_complete_post
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: optimise ctx flags layout
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: simplify fallback execution
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: don't export io_put_task()
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: return back links tw run optimisation
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: optimise deferred tw execution
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: add io_req_local_work_add wake fast path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: waitqueue-less cq waiting
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: wake up optimisations
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: add lazy poll_wq activation
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: separate wq for ring polling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: move io_run_local_work_locked
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: mark io_run_local_work static
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: don't set TASK_RUNNING in local tw runner
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: refactor io_wake_function
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: move submitter_task out of cold cacheline
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: keep timeout in io_wait_queue
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: optimise non-timeout waiting
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: set TASK_RUNNING right after schedule
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: simplify io_has_work
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: mimimise io_cqring_wait_schedule
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: parse check_cq out of wq waiting
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: move defer tw task checks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: kill io_run_task_work_ctx
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: don't iterate cq wait fast path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-29 Pavel Begunkovio_uring: rearrange defer list checks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-20 Pavel Begunkovio_uring/msg_ring: fix remote queue to disabled ring
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-20 Pavel Begunkovio_uring/msg_ring: fix flagging remote execution
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-17 Pavel Begunkovblock: fix hctx checks for batch allocation
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-13 Pavel Begunkovio_uring: lock overflowing for IOPOLL
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-05 Pavel Begunkovio_uring: fix CQ waiting timeout handling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-04 Pavel Begunkovio_uring: lockdep annotate CQ locking
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2023-01-04 Pavel Begunkovio_uring: pin context while queueing deferred tw
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-19 Pavel Begunkovio_uring/net: fix cleanup after recycle
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-15 Pavel Begunkovio_uring: fix overflow handling regression
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-14 Pavel Begunkovio_uring: ease timeout flush locking requirements
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-14 Pavel Begunkovio_uring: revise completion_lock locking
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-14 Pavel Begunkovio_uring: protect cq_timeouts with timeout_lock
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: skip spinlocking for ->task_complete
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: do msg_ring in target task via tw
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: extract a io_msg_install_complete helper
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: get rid of double locking
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: never run tw and fallback in parallel
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: use tw for putting rsrc
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: force multishot CQEs into task context
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: complete all requests in task context
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: don't check overflow flush failures
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: skip overflow CQE posting for dying ring
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: improve io_double_lock_ctx fail handling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-12-07 Pavel Begunkovio_uring: dont remove file from msg_ring reqs
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: reshuffle issue_flags
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: don't reinstall quiesce node for each tw
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: improve rsrc quiesce refs checks
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: don't raw spin unlock to match cq_lock
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: combine poll tw handlers
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: improve poll warning handling
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: remove ctx variable in io_poll_check_events
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: carve io_poll_check_events fast path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-30 Pavel Begunkovio_uring: kill io_poll_issue's PF_EXITING check
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-25 Pavel Begunkovio_uring: make poll refs more robust
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-25 Pavel Begunkovio_uring: cmpxchg for poll arm refs release
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-25 Pavel Begunkovio_uring: keep unlock_post inlined in hot path
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-25 Pavel Begunkovio_uring: don't use complete_post in kbuf
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: remove iopoll spinlock
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
2022-11-23 Pavel Begunkovio_uring: iopoll protect complete_post
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
 commit | commitdiff | tree
next
Linux 6.x block layer and io_uring tree(s)