Hello Mate, I was once where you are.. elder, WT O/seer ,Secretary etc...with a committed wife.
In my view you have to come off and the sooner the better you know you shouldn't be there. I had to take time to prepare the way ,and it was hell.
Try and get them to remove you. Perhaps your wife will swing around to your side ... as a " victim" .Mine did and our married life has been much better ever since. Once out you can give her more time and relax a bit.
I still attend some meetings .That is no fun but ... hell, I have done it most of my life , no big deal.
I wish you well.