I feel bad for my kids that their father puts the congregation above them. It's so sad. He's so busy with all this congregation stuff that they have just about no relationship.
Go ahead, go out in service, then go to your meeting and then god knows what else on your day off. The kids are so used to it so I'm sure they won't even ask for you anyways.