usb: gadget: fsl_udc_core: Remove unneeded condition