There were a few years when I went along for the family, but could not bear the ignorant, bigotted information. I started arriving later and later, until I would miss the entire public talk and just get there in time for the watchtower study. If I got there in time for the public talk I would go out half way through to a cafe up the road and have a coffee. Yet it took years before the elders ever asked me how I was going spiritually - which inevitably got me disfellowshipped as I let them know.
One of my now apostate friends used to say he used to look down on me for my lack of enthusiasm in the meetings and could not understand how I could behave in such a manner when I knew Armageddon is coming.
I don't think you will get in trouble, but you will get a bad reputation if you do it regularly.