When I get such a call I always ask who they are before confirming my name, and if any doubt exists I hang up.
Many years ago, long before scams like this were common, my Bank 'phoned me, something they no longer do of course, for security reasons, but even then I thought it was silly. The conversation went like this :
" Is that Mr Phizzy"
" Whose calling?"
"It's ******* Bank here, could you confirm your date of birth? ( I had not confirmed who I was at this point)
"No, you tell me my date of birth"
"Well would you give me two letters from your Password ?"
"No, you give me two letters from my Password"
"I can put you on to my Supervisor if you prefer"
" No, that could be a fellow scammer standing next to you, Goodbye" I hung up.
I rang the bank and found out the call was genuine, I blasted them and said they needed to tighten up on security and train their operatives properly.
No wonder so many scams worked easily in those days, the Banks were stupid, and yet did not want to help if you were scammed, BASTARDS.