Every situation is different, but once you've gotten past a certain point in your being inactive, they'll forget about you.
Going inactive is not grounds for DFing, so unless you put up holiday decorations or sit out in the yard and smoke or spread apostate messages, they can't go after you in a judicial way.
They can, and probably will, drop by for sheparding visits as you start to slip in meeting attendance and service time. But if you just nod your head and say 'thanks for your help' and go on about your business after they leave, they'll get tired of bugging you. Let's face it, most elders are too busy with their own lives, families and congregation duties to continue to harrass you about being inactive, not forgetting that some are just too damn lazy.
There are JWs in my neighborhood...I work with dubs...I have JW family. I've faded and it hasn't been a real problem. Oh, maybe once a year or so, an elder that I was friends with might drop by on a Saturday morning, but aside from that I've been pretty much forgotten.