Common sense dictates that they wouldn't since they didn't have to grow in a womb but the rest of humans because they were conceived in a womb they would need an umbilical cord and thus would have a belly button.
I guess that's true...if you believe that Adam and Eve were created directly from God. For those who believe in the evolution theory, I would say that they did. Monkeys have belly buttons.