gro: add combined call_gro_receive() + INDIRECT_CALL_INET() helper
authorAlexander Lobakin <alobakin@pm.me>
Thu, 18 Mar 2021 18:42:30 +0000 (18:42 +0000)
committerDavid S. Miller <davem@davemloft.net>
Fri, 19 Mar 2021 02:51:12 +0000 (19:51 -0700)
call_gro_receive() is used to limit GRO recursion, but it works only
with callback pointers.
There's a combined version of call_gro_receive() + INDIRECT_CALL_2()
in <net/inet_common.h>, but it doesn't check for IPv6 modularity.
Add a similar new helper to cover both of these. It can and will be
used to avoid retpoline overhead when IP header lies behind another
offloaded proto.

Signed-off-by: Alexander Lobakin <alobakin@pm.me>
Signed-off-by: David S. Miller <davem@davemloft.net>
include/net/gro.h

index 27c38b36df16049283c6bba92cb27de6aa34d922..01edaf3fdda05940a0d6d165373c2eadbb2843f5 100644 (file)
@@ -14,4 +14,12 @@ INDIRECT_CALLABLE_DECLARE(int ipv6_gro_complete(struct sk_buff *, int));
 INDIRECT_CALLABLE_DECLARE(struct sk_buff *inet_gro_receive(struct list_head *,
                                                           struct sk_buff *));
 INDIRECT_CALLABLE_DECLARE(int inet_gro_complete(struct sk_buff *, int));
+
+#define indirect_call_gro_receive_inet(cb, f2, f1, head, skb)  \
+({                                                             \
+       unlikely(gro_recursion_inc_test(skb)) ?                 \
+               NAPI_GRO_CB(skb)->flush |= 1, NULL :            \
+               INDIRECT_CALL_INET(cb, f2, f1, head, skb);      \
+})
+
 #endif /* _NET_IPV6_GRO_H */