My hand wasn't moving it.
Your hand was on it, right? Your subconscious combined with expectation was moving your hand. That's the ideomotor effect. Dousing/divining rods operate using the same principle.
If you and I put our hands on a pencil or pen, will it move?
If it was a circumstance where people were at some level expecting it to move, then yes, most likely. The actual object makes no difference. You blindfold people, sit them in front of a ouija board, tell them to put their hand on the planchette (which might be a big Oreo cookie in our little test), and it will move just as if it were a "real" planchette.
There is nothing supernatural going on.