My mother said the exact same thing a few years ago, once she realized was no longer truly interested in the truth. To be honest, that kind of hurt me. But seeing as someone else's mom said the same thing, it's just a stigma.
And yes, you ignited this by posting the CC book. OnTheWayOut has great advice to this situation if you truly want to fade. But like someone else had posted, this is basically on your 'permanent record' and they will always judge you after this. Good luck.