Being on the other side of the situation I wouldn't be worried.
I am ex jw, just married a never jw.
I haven't even thought of setting foot in a kh since I left.
But, if I were going to in the first year of our relationship idk if I would have said anything to her either.
It could be embarrsment, he's awake and doesn't want to be there and doesn't want you to think less of him for going. I know I broke in or slowly brought my gf/wife into discussions of the religion and it took longer than a year.
Ask him if he'd like you to come?
hope this helps.