io_uring: waitqueue-less cq waiting
authorPavel Begunkov <asml.silence@gmail.com>
Mon, 9 Jan 2023 14:46:11 +0000 (14:46 +0000)
committerJens Axboe <axboe@kernel.dk>
Sun, 29 Jan 2023 22:17:40 +0000 (15:17 -0700)
commit130bd686d9be918e4cc8c03abf5794ba2d860502
tree7db8b4728da7507c82b246711843384ba3b3b0b9
parent3181e22fb79910c7071e84a43af93ac89e8a7106
io_uring: waitqueue-less cq waiting

With DEFER_TASKRUN only ctx->submitter_task might be waiting for CQEs,
we can use this to optimise io_cqring_wait(). Replace ->cq_wait
waitqueue with waking the task directly.

It works but misses an important optimisation covered by the following
patch, so this patch without follow ups might hurt performance.

Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Link: https://lore.kernel.org/r/103d174d35d919d4cb0922d8a9c93a8f0c35f74a.1673274244.git.asml.silence@gmail.com
Signed-off-by: Jens Axboe <axboe@kernel.dk>
io_uring/io_uring.c