Hi breakingfree, welcome to JWD. It's good to see another Aussie thinking clearly!! Great that your husband feels the same way - that will make your life a lot easier.
I'm in a similar boat to you - I faded but still have family in. They are important to me, so I make sure I don't obviously do things that will cause them to shun me.
I started fading in the late 1980s but it's only about 6 years ago that I stopped going to meetings altogether. I had offers of a CO's visit several times and was usually able to evade the issue (ie I had "other commitments" whenever they wanted to drop in). One time an elder asked me if I would like a visit from the CO and I said straight out "no". I think the elder was stunned - he didn't know what to say and I had no repercussions from that.
The last time I had a "shepherding" visit (from two of the locals), I told them I had lost my faith. They asked me if I would like someone to study with me but I said no, I could study by myself. I've never received a visit or a phone call since. That was about 8 years ago - I went to the occasional meeting for another couple of years after that without being bothered by anyone.