We gave it up about 10 years ago. Only a few people (mostly family) have ever said anything. Our standard responses are:
- "Do you know my name and what congregation I'm from?" (Yes) Then what's the issue?
- "Does me not wearing one prevent you from asking my name and where I'm from?" (No) In fact it might encourage someone to ask.
- "Are you not allowed in if you're not wearing one?" (No)
- "My clothes are too expensive to be damaged by a cheap 5 cent badge holder" (They then usually cite an occasion when the pin damages their outfit.)
By not wearing a badge at all it also circumvents the issue of me taking it off the moment I leave the convention and head to dinner. ("Oh no, Br./Sr. Self Righteous, I didn't take mine off, I just didn't have one on in the first place." If questioned further, use bullet points above.)