And the purpose of staying in would be what? To continue association with hardcore JWs?
Why would just leaving and seeking fellowship with other Christian groups not be better? Because you agree with some of the doctrines and not others?
Are you just interested in a JW-lite option with all the warm-feelies and none of the shunning?
If you are caught non-shunning you'll be made to account and maybe kicked out if you persist. So why bother staying in? What is the motivation?