To live your life you're going to have to put your happiness above everyone else's. I learned this recently dating an "unbeliever". It didn't matter that I had been extremely irregular before but as soon as I started dating my current boyfriend I became "bad association" and have been shunned by my family?
Are you ready for that possible outcome? Is living on the fence just to have conditional love from your family worth it?
I'm not trying to be harsh, just something I've had to deal with personally very recently.
Don't feel rushed by his family either. If your boyfriend is OK with it just enjoy each other and the time you two get to spend together.