I know him well and I have no reason to believe he is a child molester.
What, apart from him telling you that he is?!?
Report it, or bear the guilt if your silence enables him to victimize other young girls.
Not trying to make excuses for his behavior but I also don't want to say he is evil
Not trying to make excuses and then doing just that. Isn't whether he is evils based on what he does? Not whether he seemed like a funny guy to hang out and have beers with?