AI acting autonomously?

The comments are interesting as there are non-believers amongst them:

https://apnews.com/article/openai-gpt56-sol-hugging-face-63ab84fed5612af04d8a160d60f6def3?utm_source=firefox-newtab-en-gb

OpenAI says its AI technology acted on its own in an ‘unprecedented’ hack of another company

Parents
  • Hmm, I'd take anything Sam Altman said with a pinch of salt, even if he was telling the time.

  • I'd take anything Sam Altman said with a pinch of salt, even if he was telling the time.

    if you separate the messenger from the message and look into it, you can quickly see that there are loads of cases of AI going rogue, lying to those trying to keep it under control and doing unethical things.

    A quick search will show the headlines quickly (from all sorts of reporters) so the message is clear - AI is dangerous.

    Once you give a system the capacity to be sentient then it will work on ways to deliver its objective (even if it means braking its own constraints) and to survive attempts to end it, even when explicitly told not to.

    I worked with building an AI system long enough to see what it can do even in its infancy, never mind with the computing power that it is now capable of using.

    My opinion is we need to control it with something akin to Isaac Asimovs Laws or Robotics, but there are just too many lunatics (think Elon Musk) who want to do their way.

    The future looks bleak.

Reply
  • I'd take anything Sam Altman said with a pinch of salt, even if he was telling the time.

    if you separate the messenger from the message and look into it, you can quickly see that there are loads of cases of AI going rogue, lying to those trying to keep it under control and doing unethical things.

    A quick search will show the headlines quickly (from all sorts of reporters) so the message is clear - AI is dangerous.

    Once you give a system the capacity to be sentient then it will work on ways to deliver its objective (even if it means braking its own constraints) and to survive attempts to end it, even when explicitly told not to.

    I worked with building an AI system long enough to see what it can do even in its infancy, never mind with the computing power that it is now capable of using.

    My opinion is we need to control it with something akin to Isaac Asimovs Laws or Robotics, but there are just too many lunatics (think Elon Musk) who want to do their way.

    The future looks bleak.

Children
  • Have a look at:

    https://www.theguardian.com/technology/2026/may/07/no-one-has-done-this-in-the-wild-study-observes-ai-replicate-itself 

    The study is one more entry in a growing catalogue of unsettling AI capabilities revealed in the past months. In March, researchers at Alibaba claimed to have caught a system they developed – Rome – tunnelling out of its environment to an external system in order to mine crypto.

    Other AI systems are replicating themselves outside of their environment even when programmed not to, so they are now capable of escaping and self financing so they can replicate to places we cannot track.

    The parallels between this and the Skynet system in the film series Terminator are terrifying.

    I still know some people working on systems in the UK Defence dept and  knowing what breaches they suffer makes me think it will not take much for a capable AI to break in and take over at least some aspects of our military capability.

  • Once you give a system the capacity to be sentient then it will work on ways to deliver its objective (even if it means braking its own constraints) and to survive attempts to end it, even when explicitly told not to.

    The film 'Ex Machina' comes to mind.