ARM: pm: sa1100: no need to re-enable clock switching