here is my life experience: first time i left, no-one cared, no-one bothered me or came after me. BUT i was never that active.
10 years after inactivity i rejoined, My second entry i went all out, progressed, was regular, became an MS, gave public talks, the whole bit.
almost an elder, then just quit. I am being hounded and followed which has made me paranoid.
I think i fixed that after a sit down with two elders sunday though. I just let them have it verbally. probly gonna get DF'd now
Depends on your level of activity and visibility is how I see it.