This just happened to me this past week because of the CO visit. I only showed up for part of the Tuesday night meeting (took off half way through because I was starting to feel ill, who wouldn't?) and then I showed for the whole Sunday meeting. The CO himself actually came up to me and said "We didn't see you much at all this week, but I'm glad you could make it today."
I really wanted to say "Yeah, sure you did. You're just sorry the seats are getting emptier and you may eventually lose this tour of glory."
But I didn't and instead gave the sorta true reply that the job I'm at has changing shifts and it just so happened that this week had me working for most of the evenings. I even lied that I had to get the Sunday traded off just to make it.
Not a word from any of the two elders standing beside him though.