he said "more people have stuck with me than have stopped being patrons" or some dumb shit like that
Yet another example of his oversized ego and lack of thinking ability.
Defamation is meaningless without damages - i.e. some demonstrably material impact on your income. This was a key factor in the Depp / Heard trial (for Lloyd's benefit, a "trial" is a real thing that happens in a real court, when there is a real case ...)
It's hard to claim you suffered damage when you are also claiming that the impact has been minor (and I don't think begging classes as earning anyway).
Another reason it's good to keep copies of everything he says - they can be used to discredit any later, contradictory, claims he may make in court, making him a thoroughly unreliable witness and his testimony count for nothing.
Not that there will ever be a case, but even if we were on Lloyds fantasy island, it still all falls apart.