We always made an excuse to go to another state.....and then just not go to the assembly. We would just go have fun.
The thing I always noticed is that people wouldn't talk about specific content for very long after the assembly, a week or two at most. So if you just are on vacation or go AWOL for awhile the chat dies down and no one knows you didn't go.
Checking on websites like this will give you just enough hint on what went on to have an answer if you really get cornered when you get back.
Perhaps if you tempt your wife with a real vacation she might just take you up on it.