If theSituation isn't going to change, why delay dealing with it? You can continue to force yourself to go to the meetings, but as you have already seen, you will pay a price for it. I also did not want to deal with my difficult husband and mother, but when I finally did, it was not as bad as I thought it would be, and the relief was fantastic, I wished I had done it years before.
I mean what are going to do to you, take away your birthday? They already did that, lol. Just make sure you are ready, have your mind made up, and are prepared for any repercussions. In the end, no one can force you to be in a religion, it is your right to live your live your life as you see fit.