Just beat them at their game and take back the control. If you have conceded to the couple inviting themselves to your home "socially", then you need to own the evening.
Insist that they come for dinner. I then would invite another family (non elder with kids) over. Pizza (or whatever sounds good) and board game or a movie. Keep it casual, fun, and kid centric. Be as gracious as ever and act oblivious to the reason they asked to come over. The key to this working is DO NOT tell the original couple you invited the other family or they may bail and try to reschedule.
As nice as they seem, they are pulling a power play on you. Many JWs employ this tactic on bible students, return visits, and inactives and are clueless how to extremely rude this is. If the tables were turned and you invited your family to THEIR house on YOUR timetable, I guarantee they would be taken aback. If they really just missed your company and wanted to "socialize", they would invite you to their home or to go out to eat.
They want the upper hand in the uncomfortable "encouragement" they are going to offer you. They probably have a vision of you and your wife having a heart to heart with them, breaking down in tears, and expressing your extreme appreciation for their care. Then in this touching moment, you pledge your allegiance to the Org and they pledge to continue helping (pestering) you.
Don't offer any excuse/reason for your absence in JW stuff. The best is if you act like you don't even notice you are inactive. Keep it super light hearted and fun--and don't let the kids go off into another room--keeps things chaotic and not too deep. You will derail their plans.
Remember--it's YOUR home. Don't give over your power. Just keep telling yourself everything is AWESOME!