I think I understand the feeling. Question, are you replacing any of those things you're fond of with something? Walking away without having something to fill the void (don't like that expression but can't find a better one) may not help the fading process.
Part of fading is building a life with fulfilling activities, and looking for better, healthier, self-loving ways of meeting your needs, not just disappearing from the congregation.