Like James_Woods said, I agree most people are amazed at the silly outfits the Dubs go to the doors in. They look stupid getting all dressed up in formal looking suits when it's blistering hot, then claiming casually,"My companion and I just happened to be in your neighborhood today, chatting with the neighbors about world conditions..."
Then, in the winter, I'm sure people shake their heads about the foolish "Sister uniform" where the sisters go around shivering in dresses with frozen legs, just "in the neighborhood today" that's knee deep in snow and slush. I'm sure the apparent lack of common sense turns people off, as well as the suits, which scare some in poor neighborhoods into hiding, thinking it's immigration or welfare at the door in those suits.
If they weren't a cult, they'd be allowed to use their common sense and reasoning faculties, to dress appropriately and to not be required to appear in uniform, despite what the weather conditions or situation called for.