This is a classic case of control. You cant leave even silently. Because they'll just hold a JC with you not even there, DF you and announce you from the platform.
From what i remember from the elders guidebook, an inactive one turning up to a JC is taken as "respecting the authority of that body"... of course the poor inactive person isnt told that. He could be turning up to be polite.
After 6 years i'd say your safe. I know people who've faded less than a year and are left alone.