You don't need to disassociate yourself for them to leave you alone. Just tell them to eff off and they don't harass you. I resigned as an elder, stopped going to meetings two weeks later and accepted 2 sheperding visits before saying enough was enough and that if I wanted help I'd call them.
No need to hide or turn it into a circus.