It would be an interesting situation if you were ejected but had caused no disturbance apart from your presence.
The K.H is a religious building getting relief from taxes because it is open to the public. You are a member of the public, the views you hold are of no relevance, and anyway probably mirror the views of any other member of the public.
Unless they could prove a disruptive act they would be in a dodgy position to throw you out.