I'm glad you were able to make it out of the cult and make some changes in your life for the better.
Its unbelievable that they are talking about suing you. It would look really bad for them when you explained that your carer was taking advantage of his position and harassing you. I doubt the courts would look favourably upon him.