vxge: fix crash of VF when unloading PF