From my own experience I'd try not to meet with him if possible but if you do, say as little as possible so you don't incriminate yourself.
I got a lot of advice from everyone on this forum when I left. When the elders came after me, I basically thanked them for their concern and told them I was fine but had some issues I was dealing with and I'd call them if I needed their help and then I avoided them.
We also had a gestapo elder. The kind that got brothers to confide in them and then used that info to get them removed as ministerial servants or whatever. The kind that when you let him into the house his eyes are darting everywhere looking for something to get you on.
You just have to keep a low profile, your mouth shut as much as possible and when you do speak, as DOC says above - do not say anything negative.