I've had my debit card replaced and forgot to update Apple's payment details

The phone might as well be bricked, updates fail and constantly pop up the payment screen, can't install new apps.

It's like having a virus on your phone.