The process is this:
1. One year you just don't go.
2. The sky does not fall.
3. You lose the fear.
My last one was '03. We happily skipped it in '04, although my wife and I held our own "mini-memorial." The next year, we went to a local Episcopal church and took communion. That was way more inspirational and the music's a lot better, too. We reached the conclusion that religion is really a personal expression of your own unique faith, despite what the dubs teach.