usb: qcserial avoid pointing to freed memory