rcu/nocb: Use separate flag to indicate offloaded ->cblist
authorPaul E. McKenney <paulmck@linux.ibm.com>
Fri, 12 Apr 2019 22:58:34 +0000 (15:58 -0700)
committerPaul E. McKenney <paulmck@linux.ibm.com>
Tue, 13 Aug 2019 21:35:49 +0000 (14:35 -0700)
commitce5215c1342c6c89b3c3c45fea82cddf0b013787
tree06943157837341c47eadb469cd225f5966f4c9ed
parent1bb5f9b95afe5d9d6b586389ce5e8f461a5b671c
rcu/nocb: Use separate flag to indicate offloaded ->cblist

RCU callback processing currently uses rcu_is_nocb_cpu() to determine
whether or not the current CPU's callbacks are to be offloaded.
This works, but it is not so good for cache locality.  Plus use of
->cblist for offloaded callbacks will greatly increase the frequency
of these checks.  This commit therefore adds a ->offloaded flag to the
rcu_segcblist structure to provide a more flexible and cache-friendly
means of checking for callback offloading.

Signed-off-by: Paul E. McKenney <paulmck@linux.ibm.com>
include/linux/rcu_segcblist.h
kernel/rcu/rcu_segcblist.c
kernel/rcu/rcu_segcblist.h
kernel/rcu/tree.c
kernel/rcu/tree_plugin.h