From studying in 1987 to baptism in 1988 up until making elder, I accepted that they were virtually always right and accepted their "imperfect men" with "the light getting brighter" excuse. In other words, I assumed there were minor errors being ironed out as the end got closer. I suppose I leaned more the way you saw it than your husband, that they were 100% right.
Once they changed the "generation" doctrine, I realized they had major shortcomings and still accepted it, but it led to me eventually being able to see them as just humans without guidance.
I think expecting near perfection from them allows one to get disillusioned sooner than allowing for mistakes.
By the way, I now realize that "spirit-directed" really should mean the same thing as "inspired." If one is "inspired," the spirit is directing them. If a spirit-directed one makes a mistake in spiritual understanding, the spirit is not doing a good job.