The school overseer always used to call to make sure the students scheduled had their talks ready or HE would have to handle them or farm them out to the usual lot who are willing to do last minute talks. I used to be one of those. I had a friend whose husband was the school overseer and it was always the Dawn and Linda show every week because the friends were LAZY.
You could be slightly honest with the guy. Tell him you cant do the talk because you are in the process of moving and to please remove your name from the school until further notice. Its none of his damn business why and last time I checked the SCHOOL was still on a voluntary basis. Even when I was not going for MONTHS the damn school overseer continued to schedule me for talks. Hellloooooo....they use it as a means for reining your ass back into the hall.
Be VERY wary about any elders that call you. If you are not changing your cell, which I suggest you do, remember that often elders will have three way calls going so anything you say that may be incriminating will be heard by TWO WITNESSES and used against you. So if they call...let it go to voice mail and call them back if you are so moved to do so, on your own time. That way they cant set up the three way and trap you.