atmel_serial: fix internal port num