Something I wished my non-JW father had said to my mother when it was time to go to meeting:
"Oh no honey, you're not taking the kids to meeting this time. Tonight is 'family night' (or "family day" if on a Sunday) and we're going to spend some quality time doing something we can ALL do -- together." And then take us all somewhere (movies/zoo/picnic at the beach, etc.) where we could bond together as a family. I think it would have made all the difference in my childhood.
All that time spent in the Kingdom Hall/field service took away time we could have spent together, as a family, doing family stuff.
I know for many it ain't easy being the "unbeliever". It wasn't easy for my dad, which is why he took the route of least resistance when it came to letting his wife take us to the Kingdom Hall.
I love my daddy with all my heart, and I understand now why he let her do it. Sometimes though, I just wish to god that he hadn't.
Best of luck to you, whatever you decide.
Take it easy.