[ALSA] Handle the error correctly in SNDCTL_DSP_SETFMT ioctl