Merge branch 'for-uring-ubufops' into HEAD
authorJakub Kicinski <kuba@kernel.org>
Mon, 22 Apr 2024 23:33:10 +0000 (16:33 -0700)
committerJakub Kicinski <kuba@kernel.org>
Tue, 23 Apr 2024 00:15:39 +0000 (17:15 -0700)
commitaf046fd169d43ef0d5f8006954fa4b2fc90974af
treed4fcb4f6735b77eb6d80991252e22b3248ac4e14
parent65f1df1140aab935c1db68abdc151dddf6fea85a
parent65bada80dec1f2108a751644773b2120bd789934
Merge branch 'for-uring-ubufops' into HEAD

Pavel Begunkov says:

====================
implement io_uring notification (ubuf_info) stacking (net part)

To have per request buffer notifications each zerocopy io_uring send
request allocates a new ubuf_info. However, as an skb can carry only
one uarg, it may force the stack to create many small skbs hurting
performance in many ways.

The patchset implements notification, i.e. an io_uring's ubuf_info
extension, stacking. It attempts to link ubuf_info's into a list,
allowing to have multiple of them per skb.

liburing/examples/send-zerocopy shows up 6 times performance improvement
for TCP with 4KB bytes per send, and levels it with MSG_ZEROCOPY. Without
the patchset it requires much larger sends to utilise all potential.

bytes  | before | after (Kqps)
1200   | 195    | 1023
4000   | 193    | 1386
8000   | 154    | 1058
====================

Link: https://lore.kernel.org/all/cover.1713369317.git.asml.silence@gmail.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
drivers/net/tun.c
drivers/net/xen-netback/netback.c
include/linux/skbuff.h
net/core/skbuff.c