rcu: Exclude outgoing CPU when it is the last to leave
authorPaul E. McKenney <paulmck@kernel.org>
Wed, 24 Aug 2022 21:46:56 +0000 (14:46 -0700)
committerPaul E. McKenney <paulmck@kernel.org>
Wed, 31 Aug 2022 12:06:03 +0000 (05:06 -0700)
The rcu_boost_kthread_setaffinity() function removes the outgoing CPU
from the set_cpus_allowed() mask for the corresponding leaf rcu_node
structure's rcub priority-boosting kthread.  Except that if the outgoing
CPU will leave that structure without any online CPUs, the mask is set
to the housekeeping CPU mask from housekeeping_cpumask().  Which is fine
unless the outgoing CPU happens to be a housekeeping CPU.

This commit therefore removes the outgoing CPU from the housekeeping mask.
This would of course be problematic if the outgoing CPU was the last
online housekeeping CPU, but in that case you are in a world of hurt
anyway.  If someone comes up with a valid use case for a system needing
all the housekeeping CPUs to be offline, further adjustments can be made.

Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
kernel/rcu/tree_plugin.h

index 207617f69aa56e0bffb7676ab9e541b2a68e173d..32b424b571bd93c37d42f4a595fcb0eec60398fe 100644 (file)
@@ -1243,8 +1243,11 @@ static void rcu_boost_kthread_setaffinity(struct rcu_node *rnp, int outgoingcpu)
                    cpu != outgoingcpu)
                        cpumask_set_cpu(cpu, cm);
        cpumask_and(cm, cm, housekeeping_cpumask(HK_TYPE_RCU));
-       if (cpumask_empty(cm))
+       if (cpumask_empty(cm)) {
                cpumask_copy(cm, housekeeping_cpumask(HK_TYPE_RCU));
+               if (outgoingcpu >= 0)
+                       cpumask_clear_cpu(outgoingcpu, cm);
+       }
        set_cpus_allowed_ptr(t, cm);
        mutex_unlock(&rnp->boost_kthread_mutex);
        free_cpumask_var(cm);