There are obscure "rules" like that ~
eg A Public Speaker could count the time spent delivering the talk as it was a Public talk ~
You can always tell them that they are welcome to chat to you but that your don't think they should count the time - the visit will be brief after that .