If he was in fact given his own opinion, it wouldn't be as bad. However, when he spoke of women, his judgemental attitude towards gays, fornicators, etc that's when it irritates me. When he gives those opinions, it is never said that those are his own opinions in those instances and not Gods. So, in the case where he represents God I have to wonder why those things were allowed in an "inspired" bible.
Yes, some of his views are rather "pharisical" and at times his jewish unbring seems to get the better of him, but he was only human
But, if the bible is inspired of God then unless otherwise stated, wouldn't we have to take that his words as the word of God?