net: devmem: Implement TX path
authorMina Almasry <almasrymina@google.com>
Thu, 8 May 2025 00:48:24 +0000 (00:48 +0000)
committerPaolo Abeni <pabeni@redhat.com>
Tue, 13 May 2025 09:12:48 +0000 (11:12 +0200)
commitbd61848900bff597764238f3a8ec67c815cd316e
tree6584a3c3ff9ec399113067c630be49d91f51a32d
parent8802087d20c0e1c26c4b4fe30e22264bf8285e51
net: devmem: Implement TX path

Augment dmabuf binding to be able to handle TX. Additional to all the RX
binding, we also create tx_vec needed for the TX path.

Provide API for sendmsg to be able to send dmabufs bound to this device:

- Provide a new dmabuf_tx_cmsg which includes the dmabuf to send from.
- MSG_ZEROCOPY with SCM_DEVMEM_DMABUF cmsg indicates send from dma-buf.

Devmem is uncopyable, so piggyback off the existing MSG_ZEROCOPY
implementation, while disabling instances where MSG_ZEROCOPY falls back
to copying.

We additionally pipe the binding down to the new
zerocopy_fill_skb_from_devmem which fills a TX skb with net_iov netmems
instead of the traditional page netmems.

We also special case skb_frag_dma_map to return the dma-address of these
dmabuf net_iovs instead of attempting to map pages.

The TX path may release the dmabuf in a context where we cannot wait.
This happens when the user unbinds a TX dmabuf while there are still
references to its netmems in the TX path. In that case, the netmems will
be put_netmem'd from a context where we can't unmap the dmabuf, Resolve
this by making __net_devmem_dmabuf_binding_free schedule_work'd.

Based on work by Stanislav Fomichev <sdf@fomichev.me>. A lot of the meat
of the implementation came from devmem TCP RFC v1[1], which included the
TX path, but Stan did all the rebasing on top of netmem/net_iov.

Cc: Stanislav Fomichev <sdf@fomichev.me>
Signed-off-by: Kaiyuan Zhang <kaiyuanz@google.com>
Signed-off-by: Mina Almasry <almasrymina@google.com>
Acked-by: Stanislav Fomichev <sdf@fomichev.me>
Link: https://patch.msgid.link/20250508004830.4100853-5-almasrymina@google.com
Signed-off-by: Paolo Abeni <pabeni@redhat.com>
13 files changed:
include/linux/skbuff.h
include/net/sock.h
io_uring/zcrx.c
net/core/datagram.c
net/core/devmem.c
net/core/devmem.h
net/core/netdev-genl.c
net/core/skbuff.c
net/core/sock.c
net/ipv4/ip_output.c
net/ipv4/tcp.c
net/ipv6/ip6_output.c
net/vmw_vsock/virtio_transport_common.c