Just to add my two cents worth to all the very interesting comments here. I am in a similar situation to CC. I am thinking of stepping down, but the COBE is sort of ignoring the hints I have given him so far. I have told him that my wife has serious physical and emotional issues, on medication etc., which is true. Now he is scared to talk to her. Others have confided to us in the past that if the bros in the cong think you have any mental issues, they become wary as they don't know how to deal with it. In fact, he is giving me more things to do. He doesn't get it at all. Some in the cong, in a well-meaning way, have put down any mental strain and inability to cope as not relying on Jehovah enough and if my wife was busier in the ministry that she would feel better!
I have always felt uneasy in the elder's role as I never really thought I should be telling others what to do. Now, having read COC and In Search of Christian Freedom by Fred Franz, and still scratching my head about the new FDS and generation teachings, you can imagine things have changed a bit.