It is possible to leave and not be shunned, many of us have done it.
It takes a sloooooow fade and guarded speech in the company of dubs.
In the U K the elders are so non caring that they leave you alone and r and f members only shun if they hear an announcement .