imx: serial: handle initialisation failure correctly