This is the way all elders should be responded to if they continue with their power trip. Who are they to tell you who you choose as friends? Good Job.
I especially hated elders who tought their children were above everyone else and associating with them was a privilege. When in most cases it wasn't the case. I would've loved to see that elders expression when you told him that!