sched/uclamp: Fix iowait boost escaping uclamp restriction
authorQais Yousef <qais.yousef@arm.com>
Thu, 16 Dec 2021 22:53:20 +0000 (22:53 +0000)
committerPeter Zijlstra <peterz@infradead.org>
Thu, 27 Jan 2022 11:57:19 +0000 (12:57 +0100)
iowait_boost signal is applied independently of util and doesn't take
into account uclamp settings of the rq. An io heavy task that is capped
by uclamp_max could still request higher frequency because
sugov_iowait_apply() doesn't clamp the boost via uclamp_rq_util_with()
like effective_cpu_util() does.

Make sure that iowait_boost honours uclamp requests by calling
uclamp_rq_util_with() when applying the boost.

Fixes: 982d9cdc22c9 ("sched/cpufreq, sched/uclamp: Add clamps for FAIR and RT tasks")
Signed-off-by: Qais Yousef <qais.yousef@arm.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Acked-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
Link: https://lore.kernel.org/r/20211216225320.2957053-3-qais.yousef@arm.com
kernel/sched/cpufreq_schedutil.c

index 62d98b09aaa5d4e4306c8e7f709c80ab7b78d57e..6d65ab6e484e2e7bee09bf71fa509785962d17d3 100644 (file)
@@ -289,6 +289,7 @@ static void sugov_iowait_apply(struct sugov_cpu *sg_cpu, u64 time)
         * into the same scale so we can compare.
         */
        boost = (sg_cpu->iowait_boost * sg_cpu->max) >> SCHED_CAPACITY_SHIFT;
+       boost = uclamp_rq_util_with(cpu_rq(sg_cpu->cpu), boost, NULL);
        if (sg_cpu->util < boost)
                sg_cpu->util = boost;
 }