I do understand what you are saying, Slim.
The manner in which a CPU actually performs mathematical functions is not even remotely like a human would, or even within the realm of what would occur to the average person. (Everything is derived from simple binary addition and logical operators)
But if the computational ability of a computer completely eclipses that of a human being (And there's absolutely no question on that point) then it really doesn't matter what's going on inside a CPU as long as it is giving correct answers.
As you said, "..it really does not matter that AI is stupid in how it goes about producing its outcome from our perspective. What matters are the results it produces."
Or as Jeffrey Hawkins, neuroscientist and AI researcher himself observed:
"...most people
aren’t trying to replicate the brain. It’s just whatever works, works.
And today’s neural networks are working well enough."
But as Hawkins goes on to point out, that approach has made AI utterly dependent upon human knowledge (And by extension human error) on a wide variety of topics.
Excerpts from a session with ChatGPT:
Incorrect
Incorrect - Song with the same title by a different artist
Not surprising, I guess.
Swing and a miss. --Common Engineering/Mathematical term
Still no answer (Other than 'splaining to me in my own field)
The AI is simply regurgitating the tribal wisdom of the internet.