The doors to the kingdom hall allow you to exit just as easy as to enter.
The only thing keeping you there are the chains of your mind.
The elders, and--by extension--anyone in the organization for that matter, only have the authority that you allow them to have.