Yes, family is the primary reason. Also it prevents a disfellowshipping for apostasy...if you go slow, they are less likely to suspect something.
So it all depends on you and your circumstances, torn in two. I remember you were a convert and wanted to take it slow for your daughter's sake. She seems to have mostly come out of it, and your husband has eased up, tho he is still a believer. So the only thing you have now may be some witness friends you occasionally see.
What is the worst that can happen, if they do Df or DA you? If you are tired of fading and ready to face the possible consequences, just stop. If the elders in your area don't give a lot of attention to people like you, you may be safe anyway.