IB/qib: Fix port in pkey change event