It is very simple.
Treat others like you want to be treated. No more, no less.
Witnesses wishing others to be hurt in some way is wrong, just as for us to want others hurt just for believing in something different than for ourselves is wrong.
Personally, I do not wish witnesses sorrow, but do feel sad for them in my heart, as they are so mislead. Big difference between that and wishing them evil.