Nope, you weren't harsh; he does sound like an ass. LOL Maybe Mr. Sex will come up with a new topic of conversation next time he is so fortunate as to go out with a girl again. Maybe that's his problem, he goes out with the guys all the time and sex is all they talk about.
Hope you find somebody more interesting for your next date.