ASoC: fsl-ssi: remove unnecessary spinlock