usb: gadget: gr_udc: remove some unneeded error handling