I would not get upset at their attacks of you or ban them, this may look to others as weakness and give the attackers credibility. I would instead have proof ready to go when you post something on your site, so when they attack you can just put up the proof. This will give you more credibility and accomplish what exactly what you set out to do.