RDMA/core: Initialize port_num in qp_attr