Whether I stayed in a congregation or not would depend on how well the congregations Paul addressed responded to his admonition.
Paul wished some men who were giving the congregations special trouble would get their 'nads cut off. [Gal. 5:12]
Clearly, Paul wasn't the type to tell anyone to "wait on Jehovah" when it came to problems. He regularly incited faithful congregation members against those who insisted on practicing un-Christian behavior.
He didn't hide what they did, but publicly advertised it (in the congregation he was writing to and to all those congregations his letters were sent to) and left it to the congregation to as a whole to address the issues. [And in Revelation, Jesus addressed the congregations, not a group of men at the top of a hierarchical pyramid, not the elders at the top of the congregation, as being responsible for the conditions in it. He went so far as to deal with specific individuals.]
So staying with a congregation would depend on how Christ-like it was in dealing with problems, not whether it had problems or not.
And, as bethel put it so well, all this presumes they haven't forsaken the basic Christian faith or displayed the "rotten fruits" Jesus described.