Sure its easy.... the CO has limited time to squeeze visits in. He does it really as filler so he dosent have to do a lot of door to door crap
Agreed. This is what you have to do. Remember, he is only around for 1 week, and he has a busy schedule. You are overthinking this. Chance are, even though he said that to you, it's already in the back of this mind.
Plan:
Next meeting, arrive as late as possible. Leave right away.
if somehow he is able to corner you, be ready with a nice excuse about your availability. Perhaps even say "I think i can do it on X day and X time, but i have to check, because blablablabla. So let me get back to you on that before we set anything up. Then, don't follow up.
Spend little time at home during key hours this week, especially the hours preceding dinner, and weekends. It's not unreasonable to think he will try to squeeze a "pop-in" during field circus.
As a last resort, if the meeting happens, then just agree, that you will try do better, and will do better. Thank him for his interest, then give him the finger as he walks away. Go back to your default mode.