Nathan Natas nailed it for you. If you are wise, you will listen.
The fact that your boyfriend got uncomfortable and tried to change the subject when you brought up religious issues with him, speaks volumes. He is not truly comfortable with totally open-minded communication. That is a more likely predictor of doom for the relationship than being a JW, imo.
He may not be 100% committed to the religion on an intellectual or doctrinal level, but if he is 100% committed to his family and the obligation and guilt he feels, then he is 100% committed to the religion regardless of the reasons for the committal. At any rate, he cannot be 100% committed to you if his family and other social obligations influence him more than you do.
You describe a slightly nerdy, 23 year old virgin. I'm guessing the thought of having sex with you will probably get him to agree to anything at this point. However, years down the road, when the novelty of sex and your relationship has worn off, and a couple of kids in house trigger all his own childhood conditioning to come to the fore (which often happens when couples have children), the differences might become an impassable gulf.
You said a small part of him is OK with maybe giving you flowers on Valentines or letting you have a Christmas tree? That means a BIG part of him isn't OK with it. That is the part you should be paying attention to. Just the fact that he thinks he will "let you" tells you much about the mindset of the JW male. He has been trained from childhood to believe he will be the head of the house, the head of you, and you should be submissive. If he changes his mind and no longer decided to "let you", you will be expected to submit to your husbandly head. This will be constantly reinforced in his head if he ever goes back to the meetings. You may also end up in a heartbreaking battle for your children's minds, if he changes his.
This is not a once a week on Sunday religion. It encompasses every single aspect of its members lives and by default their spouses lives. Nothing will be sacred including your sex life. He may yet decide to confess every single intimate detail of your oral sex to a committee of old men in a fit of misguided guilt.
Sure, he might see your points and get out if he can mature and learn to think for himself. Right now, from what you've described, he is not in that place. It's only wishful thinking on your part. Do you want to gamble your future happiness on it?
You don't have to break up with him if you don't want to, but do not move in with him, marry him or have a child with him, until you see for sure which path he ends up taking. Make sure it is his mind that has changed not just his behaviour. Many, many, many JW's walk on the wild side until they find a mate in the world, and then they want to return to the fold and make themselves right with Jehovah, now that they are happy and content with their life. (leaving the unbelieving mate to say, WTF happened?