I think the bigger impact is admitting that he was cheating on his wife, repeatedly over a period of at least 3-4 years. I would guess that most people feel that he was being as self-serving as he could, and the actual numbers are much, much worse. That he was using prostitutes to do it just makes it that much worse, and his admission (both previously and in his video) that he lacks self-control and felt that his wife could not keep him satisfied makes it worse still.
This is not about a guy who visited a call girl a couple of times. This is about a husband who betrayed his wife, willfully and cynically, for a very long time. And who seems more upset that people are judging him, than he is that he did this to his own family. You could understand someone staying a Patron over a couple of trips to a brothel. His actions are on a whole different level, and most people cannot make excuses for it in good conscience.
I would not be surprised if his subscriber numbers keep sliding until the only ones left are the absolute die-hards and people who aren't aware of what is happening and/or aren't keeping tabs on their $1/month contribution.