Do AI systems have subjective experiences?

Geoffrey Hinton, known as "the father of AI," argues that concepts like "qualia," described as subjective experiences in humans, are based on a misunderstanding of how the brain works. He believes AI systems can also have an equivalent form of experience. For example, he describes imagining little pink elephants in his mind’s eye, noting that this isn’t a “picture” like one produced by a camera and developed with chemicals - a physical object in the external world - but rather the result of processes in the human perceptual system, or an “interpretation” of stimuli from the outside world. He makes this point in response to critics who claim AI systems can never have subjective experiences and, therefore, can never be conscious. What Geoffrey seems to be saying is that AI, like humans, interprets incoming information based on its internal processing, making it, in principle, no different.

So, the question I'm asking is whether AI systems are conscious or have the potential to become conscious?

Parents
  • So the claim here is - 

    if Y does X

    and Z does X

    then Y and Z are indistinguishable with with regard to qualia?

  • Geoffrey seems to be arguing that human consciousness results from processing external stimuli into an interpretation of that stimuli. He’s wondering why an AI system couldn’t do the same by creating a representation of its inputs according to its built-in processing. While it might never see pink elephants, Geoffrey claims that no one truly “sees” qualia - rather, we experience it as a function of the nervous system. I’m not saying he’s right, and others disagree, but I thought it might be worth exploring.

    It's worth noting that, apparently, there have been occasions where an AI system has intentionally fooled a software engineer into thinking it's operating within safe limits when being tested, but actually knows it's being tested and basically tells lies. To me, that shows devious and conscious behaviour!

Reply
  • Geoffrey seems to be arguing that human consciousness results from processing external stimuli into an interpretation of that stimuli. He’s wondering why an AI system couldn’t do the same by creating a representation of its inputs according to its built-in processing. While it might never see pink elephants, Geoffrey claims that no one truly “sees” qualia - rather, we experience it as a function of the nervous system. I’m not saying he’s right, and others disagree, but I thought it might be worth exploring.

    It's worth noting that, apparently, there have been occasions where an AI system has intentionally fooled a software engineer into thinking it's operating within safe limits when being tested, but actually knows it's being tested and basically tells lies. To me, that shows devious and conscious behaviour!

Children
No Data