Everybody has already said it some form. I would add that you could say "I only want serve God and that has nothing to do with attending a meeting that you want to have." Then IGNORE IGNORE them.
Unless of course you want their good graces and want to plead innocence about something? I doubt that. You can be nice while not giving them your personal power.