In primitive societies shunning meant death because people couldn't physically survive on their own. I wonder if there is residual hardwiring in our brains that literally makes us frightened we may die if our 'tribe' shuns us.
Although it's completely illogical in our modern world being raised in the closed world of a cult doesn't help. I think leaving and knowing we'll probably be shunned triggers fear for our own survival.