The error was to buy something religious as his gift to you. However he should be more grateful for the effort you put in to your anniversary and the fact that you were happy to buy your own gift not putting any pressure on him. If he expressed no appreciation and had done nothing for you then he has no right to complain about ANYTHING. Next anniversary go out for a slap up meal with a girlfriend and leave him at home, or book yourself into a spa for the weekend and let him fend for himself. He is unappreciative and petty his mistake was not to treat you with the respect, love and kindness you deserve.
JWs are notoriously tight especially if the are allowed to get away with it.