You need to write down the scriptures Darth gave to you, and hand them to him. You can call it "something to THINK about".
Guys like this are trying to get a reaction. They can't believe you aren't responding to them as an authority figure. The BEST way to ruffle their feathers, is to not allow them to ruffle yours. In other words, you don't need to tell them JACK SQUAT! Your statement to him about how you have been thinking about things, is only CONFIRMING to him that he is on a righteous path (being chosen by holy spirit and all).
I have occasionally seen elders from my hall and when they do the questioning thing....how are you...we've missed you....etc..., I literally just say I'm doing great how are you doing? Or I've missed you too, you should come by for a beer sometime. It completely defuses them.
So he thinks he has been noticing something, just assure him he has noticed wrong and that if you need him he'll be asked for. Just the aloofness in giving him the information he wants so badly, is where the real control lies. if you react negatively, or even give him the small nugget of info you did, it reinforces their feeling of position and strength. Best thing you can do is ignore them with a smile, and treat their requests with happy contempt.
I had a similar style elder tell me he wanted to talk to me in the back room. I told him no, but what was on his mind, did he need help with something? He said he wanted to speak to me in private. I invited him to the parking lot. He said he wanted to be in the back room. I told him I wouldn't be doing that, but he could talk to me if he wanted to walk with me to my car. I win. He walks to my car. He waves another elder over. When he came over I said, I'm sorry "Jim", "Bob" wanted to speak to me privately. Jim wanted to speak to me too apparently so it wasn't as private as previously indicated. (Its getting fun at this point). So I waved at a buddy and said hi. Hey Jason whats up? Jason comes over. Now its the 4 of us. My wife soon walks over. Hey Bob so what was it you wanted to mention to me? Well that was private. Well no it wasn't because Jim came over and that was fine. Whats up?
See now all of the power they think they have, all of the procedure, all of the heady ways of "handling" the sheep, disappear. Now they are the ones frustrated, probably irritated, and feeling awkward. Thy excused themseves and I wished them well.