This is interesting. It almost seems like perspectives that lie at the farthest point from what we personally believe... are "extreme" to us. We all think our own views are balanced... right down the middle probably. Otherwise we would believe something else.
To be honest, 5 years ago I would've considered atheism to be an extreme, too. Now, while I'm not a true atheist (I toy with deism), I do consider it to be closer to neutral when I consider that we are not born with faith in Jesus or Allah. Also, if you're politically neutral as a JW, you don't align yourself with any particular political party. Since an atheist doesn't align himself with any particular god, he seems to be neutral in that respect, IMO.