svc: Make deferral processing xprt independent