Good luck, man. Been there done that. This is bringing back very bad memmories.
I was in a similar situation and don't count on the HS to bail you out.
About six months after I decided I no longer wanted to be a witness an elder called me and said in a very excited voice, "the elders are going to recommend you as an elder!"
In that six month period prior to the phone call I was only turning in an average of 5 hours a month, but that did not matter. I was going to be an elder.
Due to family circumstances I accepted the assignment and remained an elder for three long years. Fortunataly, there were many elders in the congregation so I did not have too much to do. But it was still very very painful.