I then finished the conversation asking him to respect our decision and I wasn't going to discuss it any further.
Well said and played, if people don't respect you, then don't replicate by respecting them back, that's my position on JW family members.
Some of that can come from real sincerity though, in that the WTS mentally imposes the suggestion that everything outside of "their" organization is evil controlled by Satan's evil forces etc. so is it really surprising how and why JWS think and act when they hear someone who was once involved leave ?
The provocation of fear is large part of the WTS indoctrination process that intentionally lures people into the organization as well intentionally keeps them there for the WTS own means, purpose and sustainability.