Go with your gut- you can always miss next year if it's too soon.
It takes time to be comfortable with realizing you're decision is a huge disappointment to your family and be totally ok with it. It certainly took me a while to realize I had the right to choose my own life/religion and their disappointment was theirs to work out-not mine.
I never went to a memorial once I faded, but i made that decision because I didn't want to give them any false hope. I thought that would be more hurtful (in the long run) than just not going and ripping the band-aid off.