mm/percpu.c: don't acquire pcpu_lock for pcpu_chunk_addr_search()
authorHou Tao <houtao1@huawei.com>
Fri, 20 Oct 2023 13:31:56 +0000 (21:31 +0800)
committerAlexei Starovoitov <ast@kernel.org>
Fri, 20 Oct 2023 17:12:54 +0000 (10:12 -0700)
There is no need to acquire pcpu_lock for pcpu_chunk_addr_search():
1) both pcpu_first_chunk & pcpu_reserved_chunk must have been
   initialized before the invocation of free_percpu().
2) The dynamically-created chunk must be valid before the per-cpu
   pointers allocated from it are freed.

So acquire pcpu_lock() after the invocation of pcpu_chunk_addr_search().

Acked-by: Dennis Zhou <dennis@kernel.org>
Signed-off-by: Hou Tao <houtao1@huawei.com>
Link: https://lore.kernel.org/r/20231020133202.4043247-2-houtao@huaweicloud.com
Signed-off-by: Alexei Starovoitov <ast@kernel.org>
mm/percpu.c

index a7665de8485fd9594c523c68ad579b1303e1c4ba..ea607078368df047411b79d95e8b63b80ceac23e 100644 (file)
@@ -2267,12 +2267,10 @@ void free_percpu(void __percpu *ptr)
        kmemleak_free_percpu(ptr);
 
        addr = __pcpu_ptr_to_addr(ptr);
-
-       spin_lock_irqsave(&pcpu_lock, flags);
-
        chunk = pcpu_chunk_addr_search(addr);
        off = addr - chunk->base_addr;
 
+       spin_lock_irqsave(&pcpu_lock, flags);
        size = pcpu_free_area(chunk, off);
 
        pcpu_memcg_free_hook(chunk, off, size);