xfrm: Fix crash observed during device unregistration and decryption