I left because I started questioning the existence of a god, then everything else took its course. You will find that there are some atheist than do get defensive/anger and that is also understanble because there are christians that behave the same way.
I've read the Bible just like the WTS told me to do. It actually did me a favor, reading the entire bible is what got me thinking about the god I was worshipping. It also helped that I really like the works of other philosophers, and of course my fascination with astronomy.
I still think the bible is a wonderful book. It was a good read, but so are many other books.
And about throwing it away, reminds me of the great words of Carl Sagan:
I would love to believe that when I die I will live again, that some thinking, feeling, remembering part of me will continue. But much as I want to believe that, and despite the ancient and worldwide cultural traditions that assert an afterlife, I know of nothing to suggest that it is more than wishful thinking. The world is so exquisite with so much love and moral depth, that there is no reason to deceive ourselves with pretty stories for which there's little good evidence. Far better it seems to me, in our vulnerability, is to look death in the eye and to be grateful every day for the brief but magnificent opportunity that life provides.