Letting go...
Depends on what "letting go" means. Being a JW at one time has shaped us to some degree to who and what we are now. There's no changing that. We can continue to grow but those experiences will always be there.
At the same time though, we can "let go" the influence the religion still has on us. If we don't allow it to control our thinking, our beliefs, etc. then yes we can let go and move on.
I've seen some people that walked away from the experience without so much as looking back. It's like they walked out on a bad movie. They bitched about it, lost some time and moved on to something else.
Others of us may have "let go" personally yet still have family that are involved with it which impacts us whether we like it or not. That's the case I'm in.
I have all kinds of family actively involved. I'm lucky that I haven't been too ostracized by them, but their JWism does affect me to some degree. I like to stay on top of what's happening with the bOrg and the doctrines and practices. It's like the old adage, "keep your friends close, your enemies closer". If I stay on top of what's going on and know it before they do, I can use it to defend myself or drop hints or raise doubts.