It's a catch-22. You want to fade away and to not be bothered. But you expect to be bothered, and then it doesn't happen. So are you glad that you were able to sneak away or are you upset that no one missed you?
Personally, I'm glad, that for the most part, I wasn't missed or bugged about what was my problem.