serial: Make uart_port's ioport "unsigned long".