No I wouldn't ban them.
I would want to look at whether elders and MSs could be forced to hold enhanced DBS certificates. Even though they can argue they don't specifically work with u18s they do work with elderly and vulnerable adults.
I would also want to remove their charitable status on the basis that their child welfare policies and procedures are not fit for purpose.