This is why their are hardly any brothers stepping up and reaching out to be elders. There are too many horror stories that long time elders or just in general that have been passed around to ward off many reaching out.
The duties as an elder are to help the congregation, but first and foremost as a qualification you have to take care of your family. If that means no phone calls after a certain time at night and in an emergency, then I wouldn't fault an elder for that.
When members have a need for guidance and they are ignored or treated badly by the Elders does this affect these people possibly being DF'd in the future because of underlying grievences against them, i.e. being labeled as "pests"?
Quite possibly, but the society will just say that they were weak and lacking faith in Jehovah God and not waiting on him to take care of things in his own time. In other words, good riddance, thanks for your donations, but see ya.