Just cancel the direct debit at the bank surely? Takes seconds
The only issue would be if the bank didnt do that, Sunderland send the trigger for the payment. Unlike standing orders which are under your control. Cancel with both parties just to make sure