My advice would be to break free of it and just not go.
But that's a call you have to make based on your relationship with your family.
Are things going to get worse with them if you decide not to go?
They already know you've stopped being a JW, right?