I've had doctors like that. It is not businesslike. I don't mind waiting if there's an emergency, but it shouldn't be routine to wait for hours when you have gone to the trouble to arrive on time.
Fortunately, the office I go to now keeps things moving. I've seldom had to wait more than a few minutes, occasionally as much as a half hour if there is an emergency.