I tell everyone and am very open. It's a fascinating story and people are genuinely interested. When you're open and vulnerable people respect that. The occasional person is overwhelmed by the sadness of shunning and kind of shuts down and tries to change the subject so just let them and move on, but most people will respect you for standing up even with such dire consequences.
My wife and I have way more friends now than we ever did in the cult where everyone refers to others as "the friends".