You're only in trouble if they have power over you and that is something you choose to give or not.
They don't want what's best for you, they want what's best for them.
All hard choices are risk assessments; what could be gained vs lost and of what value will the outcome be vis a vis, what do I want in my life?