Can I delete a saved payment method?

Of course!
Go to the Profile section of your app, or on the website, to 'My Payment Methods,' where you can delete or add a credit card.