usb: xhci: fix wild pointers in xhci_mem_cleanup