percpu: pcpu_embed_first_chunk() should free unused parts after all allocs are complete
authorTejun Heo <tj@kernel.org>
Fri, 27 Apr 2012 15:42:53 +0000 (08:42 -0700)
committerBen Hutchings <ben@decadent.org.uk>
Sun, 20 May 2012 21:56:31 +0000 (22:56 +0100)
commit8a2f7257ae6a7d1e1c87dd1ef146bd3e9c04e903
tree29de010fcf4edfdfb0662793da6b0cf0eeb77808
parent1eafe98560a3bf53d3b2e92fbbdfd6ac09166c11
percpu: pcpu_embed_first_chunk() should free unused parts after all allocs are complete

commit 42b64281453249dac52861f9b97d18552a7ec62b upstream.

pcpu_embed_first_chunk() allocates memory for each node, copies percpu
data and frees unused portions of it before proceeding to the next
group.  This assumes that allocations for different nodes doesn't
overlap; however, depending on memory topology, the bootmem allocator
may end up allocating memory from a different node than the requested
one which may overlap with the portion freed from one of the previous
percpu areas.  This leads to percpu groups for different nodes
overlapping which is a serious bug.

This patch separates out copy & partial free from the allocation loop
such that all allocations are complete before partial frees happen.

This also fixes overlapping frees which could happen on allocation
failure path - out_free_areas path frees whole groups but the groups
could have portions freed at that point.

Signed-off-by: Tejun Heo <tj@kernel.org>
Reported-by: "Pavel V. Panteleev" <pp_84@mail.ru>
Tested-by: "Pavel V. Panteleev" <pp_84@mail.ru>
LKML-Reference: <E1SNhwY-0007ui-V7.pp_84-mail-ru@f220.mail.ru>
Signed-off-by: Ben Hutchings <ben@decadent.org.uk>
mm/percpu.c