There's no reason for shame. Think about all the illusions other people hold on to. I think every single person alive has some kind of illusion they accept and never confront. Many are afraid of looking truths in the eyes, truths about themselves, or their circumstances or their spouse or something else. It's human nature. Sure, we were in a cult, but that doesn't mean we were weak minded. Staying in the cult despite what we've come to know would mean we are weak minded.
It's a whole other story for born ins. We were molded to accept it all from childhood on. We saw some good things and concluded it's all good, it's all true. Being conditioned doesn't mean one is weak minded. We didn't know anything else and the truth appeals to feelings of superiority, we thought we knew it all while all those poor worldly people had no clue. We thought we knew the all the secrets.
A challenge for me is figuring out who I really am. I have no clue right now, also don't know who I can be and want to become. What's also hard is getting rid of that "never going to die" idea and living a responsible life.