If nothing else, they'd always be able to pull the ol', "Buying out time for the more important things" line. That's a lovely catch-all to chase you away from things that aren't "wrong" in any remotely scriptural sense, but that they still don't want you doing.
Dave