I too experienced this. It turned me into a freakish loner at school. But instead of being bitter now, I'm excited to introduce my kids to a life full of activity and excitement.
My son is 5 and is a gymnastics class. We are getting him started in Hockey for the next season. My wife, while a JW, disagrees with them saying that children shouldn't have extra activities because of "bad association" or "using time that could be used for spiritual things".
The whole "making more time for spiritual things" was a real joke. When did I EVER come home from school to study or read the bible? Never. Instead of have friends I played video games and watched TV. I think that has, in one degree or another, affected my life now. I'm happy to be alone and not have friends. I love being with people, hanging out, drinking beer, whatever. But my childhood really socially retarded me.
I refuse to let that happen to my kids!