Doubly Artificial Intelligence?
“This super machine really does have a mind of its own.”
Not so fast! Does the machine have a mind? Is it conscious?
There are reasons to think not. Plausibly, the computer is just running a program. There is no consciousness, thinking, understanding, or intelligence. The ‘intelligence’ is “artificial,” not merely in the sense of being made by humans but also in the sense of being unreal. It’s doubly artificial intelligence. Or so it can be argued.
John Searle’s Chinese Room thought experiment is a good place to start if you want to get smart on this issue.