IB/srp: Fix residual handling