IB/ipoib: Make the carrier_on_task race aware