You are better off without him, and my advice, stay as far away from Jehovah's Witnesses, Moonies, Mormons, Fundamentalists, etc, as possible. They have a warped view of the world.
Think of it this way, it hurts because it did not work out. It really hurts. I can sympathize with that. Now imagine if it did work out, you two get married, he gets reinstated and becomes gung-ho on his religion. There goes birthdays for your kids, if your kids want to participate in holiday activities at their school, your husband will feel ultra compelled to prevent that. Your husband will feel ultra compelled to take the kids to all the meetings, leaving you at home alone. Of course, you could go along but you will feel like you are selling yourself short, doing things for others and not doing what makes you happy. You will here a constant barrage about how people in the world are second class people, only they are good people.
Sure, you and your husband may work out something and he may promise not to try to indoctrinate them. However, he will feel compelled to indoctrinate them to hate all holidays and view people of the world with disdain. If not him, then someone else in the cong will. I had a JW babysitter scare my daughter into not wanting to watch Super Why. Fundamentalist wackos are like that as I recall how wacky some of the people at the IFB churches I use to attend were about Captian Planet and the Smurfs. Thank God my daughter got over that fear of Super Why (she watches it now).
I don't have to go into the whole blood thing do I? He will feel compelled to refuse blood transfusions for the kids and for YOU, even at the cost of life itself.
Count your blessing, leave this board, and do not look back. Stay away from these fundamentalist wackos and live your life.