projects
/
linux-block.git
/ commitdiff
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
| commitdiff |
tree
raw
|
patch
| inline |
side by side
(parent:
8501fe7
)
io_uring: inline llist_add()
author
Pavel Begunkov
<asml.silence@gmail.com>
Thu, 6 Apr 2023 13:20:11 +0000
(14:20 +0100)
committer
Jens Axboe
<axboe@kernel.dk>
Thu, 6 Apr 2023 22:23:28 +0000
(16:23 -0600)
We'll need to grab some information from the previous request in the tw
list, inline llist_add(), it'll be used in the following patch.
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Link:
https://lore.kernel.org/r/f0165493af7b379943c792114b972f331e7d7d10.1680782017.git.asml.silence@gmail.com
Signed-off-by: Jens Axboe <axboe@kernel.dk>
io_uring/io_uring.c
patch
|
blob
|
blame
|
history
diff --git
a/io_uring/io_uring.c
b/io_uring/io_uring.c
index 6f175fe682e42692f911bf8bcb4f04e277040396..786ecfa01c5465ab03aa7d3bf492e6eeceed07bb 100644
(file)
--- a/
io_uring/io_uring.c
+++ b/
io_uring/io_uring.c
@@
-1303,8
+1303,15
@@
static __cold void io_fallback_tw(struct io_uring_task *tctx)
static void io_req_local_work_add(struct io_kiocb *req)
{
struct io_ring_ctx *ctx = req->ctx;
+ struct llist_node *first;
- if (!llist_add(&req->io_task_work.node, &ctx->work_llist))
+ first = READ_ONCE(ctx->work_llist.first);
+ do {
+ req->io_task_work.node.next = first;
+ } while (!try_cmpxchg(&ctx->work_llist.first, &first,
+ &req->io_task_work.node));
+
+ if (first)
return;
/* needed for the following wake up */