What if the Elders tracked you down and show up at your House to inform you of Wrong doing and the action they will take.
The only authority an elder has is the authority that you allow him to have. If one shows up and wants to accuse of 'wrongdoing' and you don't want to discuss it with him all you have to do is order him off your property, tell him to stay off and close the door. Any further appearances and you can have him charged with trespassing.
Your average elder isn't going to just show up to accuse you of wrong doing. That's when they call and ask to meet. Even then you can say, 'not interested, leave me alone'.
The downside to that is that if you're trying to fade, this blows that all to hell. They'll DF you in absentia if they really want to. Whether they do or not depends on the assholiness of the particular elders you're dealing with.
What if the Elders destroyed your Family and now they Stand Before you smiling with the Bible in their hand.
Again, order him to leave, warn about trespassing and in this case tell him no more attempts at contacting you or there'll be a restraining order taken out against him. You can get the last word and let them know exactly what you think of them and that any further attempts to contact you will result in the authorities being involved.
But outbursts of anger or violence, whether real or threatened will only increase their persecution complex. They're trained to expect being treated badly by opposers and apostates. By giving in to the anger or threatening actions you confirm to them that you're the trouble maker. Keep cool, keep it simple and let the law handle trespassers or stalking.