What you're calling caveats are derived from the GR, specifically from asking oneself "Would I like it if this were done to me?". If it fails that test, then whatever action you're taking is not the Golden Rule.
What I am calling caveats are actual, literal caveats. They also aren't from the golden rule. The golden rule, at best, allows for asking that, but it doesn't say to do that. You are adding on to the golden rule to make it work and no amount of pretending the golden rule says something it doesn't will change that.
The Golden Rule is a maxim, it does not attempt to spell out concrete actions. It provides a means of testing potential actions by placing yourself in the other persons shoes and asking "Would I like to be treated this way?"
Do, no does not. It literally does the opposite, saying to do to people what you would want done to you. Any concern for the other person's wishes is outside of the golden rule. You are pretending the golden rule says something it does not.
The Golden Rule does not attempt to place you over the other; it is specifically designed to counter that by asking you to place yourself in the shoes of the other person. ("Would I want this done to me?").
Again, the golden rule doesn't say that at all. It literally says to do the opposite of that.