The single most reliable defense against impersonation is this. You break the connection the scammer set up and rebuild it through a channel you control. The number on the back of your credit card, the number on the company’s official website, the number on your last paper statement. Not the number the caller gave you. Not the link in the email.
A real bank will never object to you calling back. A scammer cannot follow you to the real bank’s switchboard. That is the whole trick.