Our family and friends blame us for the fact that they shun us.
Imagine an abusive husband who threatened his wife that if she leaves him he will hunt her down and kill her. Eventually she finds the courage to leave and he carries out his threat. In court his lawyer argues that the wife knew the consequences of leaving and so it was not his client's fault but the victim's.
This is the twisted ethics of the cult mind.
Don't play along.