Even if you do not beleive the Bible to be the wholly infallible word of Almighty God, it contains good advice, history, object lessons, etc....
And it's fun showing fundies who claim a monopoly on the Bible how their teachings refute, twist, contradict, add to, take away from what
is actually written. One of my favorites is in James: "If any man knows what is right and does not do it, it is a sin for him."
In other words, be TRUE TO YOURSELF. By defending the Bibles's POV you are doing just that.