Here is what worked for me: "I appreciate your concern, but no thank you." or " Thank you so much for your call. Things are really busy for me right now, and i have a lot going on. I'll let you know." Click.
I would not say anything about what you think, or say anything like "I refuse" because that just raises a red flag even more than flat out declining.
They didn't bother me again. Now, I was a single woman, with no previous "status" i.e. regular pioneer, auxillary, a husband they wanted to use.... so it worked for me because they don't really care about people like me in the first place.
Let us know how it goes.
bafh