serial: move the flags into the tty_port field