There were always people I didn't like so much because they were more self righteous or judgmental, but mostly I loved the witnesses I knew, and still love them. I know being in elders meetings with them they take on different personalities, but in real life they are just hard working people trying to do their best, and they are being fleeced by the org and told they are never good enough.
I tended to avoid uber witnesses and not get close to them, but there were plenty other nice almost normal people. Some of them I love so dearly that it hurts to know they think I have gone down the wrong path and think ill of me. But ultimately you have to live your own life, no one else can live it for you. You have to suck it up and not think about what other people are thinking, but do what is best for your own sanity and your soul and your children.