A JW reading this would say: "see, this is why you left the Truth, you didn't wanted to do God's work!"
Yep, hated it too. My reason was very clear to me: I didn't like bothering people! If I happened to find someone who seemed genuinely interrested I loved going to him/her, talking about just how bad this world is, how good God is, etc. etc. But knocking on an unknown's door, and in 99% getting the houseowner pissed off was just not right.
I knew I didn't like it when that happened to me. When I'm home most of the time I am busy with something, either some housework, or watching TV, etc. In all cases a distraction is not welcome. If it's a distraction I don't even want, then it's an annoyance. And I knew I was the person who delivered that annoyance to others.