This mystery guy realizes that once you have been with him you will not want him again.
He knows he is not a gladiator in bed and his experience is that women do not want to meet him again after they have found out how poor his performance is, hence his reticence to arrange a re-match.
The gladiator - prepared to bravely go where no man has been before.