AI acting autonomously?

The comments are interesting as there are non-believers amongst them:

https://apnews.com/article/openai-gpt56-sol-hugging-face-63ab84fed5612af04d8a160d60f6def3?utm_source=firefox-newtab-en-gb

OpenAI says its AI technology acted on its own in an ‘unprecedented’ hack of another company

Parents
  • An update and analysis of the incident was posted by the BBC just now:

    https://www.bbc.com/news/articles/c2el319vzr3o

    The CSA warned the incident shows that AI "agents... find a way" - a reference to the film Jurassic Park, where dinosaurs escape their enclosures.

    "They are objective-driven, set their own sub-goals, adapt in real time to bypass defences, and operate with a machine-speed persistence that can overwhelm manual operations," the paper reads.

    and most worryingly:

    "rogue" behaviour "is the standard, not the exception," the paper claimed.

    I note that OpenAI staff were celebrating this event internally which tells a great deal about the mindsets of the creators here.

    How can we realistically get companies to set strong constraints on AI platforms that are outside national jurisdictions and are often driven by the greed to have their AI be the most capable of doing such illegal or unethical stuff?

  • Get people who aren't morally bankrupt to be the ones to deal with AI stuff. Simple. 

    From what I've researched in various documentaries, the majority of Silicone Valley as we know it is entirely set up by and ran by sociopaths with similar ideas or ties to neo nazi agendas and eugenisist ideals. It's pretty crazy, thinking about it.

  • Who would those people be? I'm not saying it's a bad idea, but who decides who is morally bankrupt and who is not?

    A lot of successul business people are said to socio or psychopathic, that whole not caring about others thing seems to be what makes them successful.

Reply Children
  • How would you tell if they had real empathy or not, many of these people are master manipulators?

    I suspect that they do think of how their creations will effect others, but will see the positives and not the negatives, They will see how AI will improve things like cancer diagnostics or help law engorcement catch criminals without ever thinking that same technology will "see" everyones faces and measure and record them. I hear scientists interviewed before and they always seem to think that everybody acts from "pure" motives, which to me is totally naive and passes the buck, its similar to 'I was only following orders'. Others say things like if you've done nothing wrong then you have nothing to fear, but I don't think thats every been true, there have always been miscarriages of justice and plain ignorance criminalising people. The other part of the 'if you've done nothing wrong you have nothing to fear' in terms of technology is what happens if the state starts behaving less benignly and lets face it, its not very benign now. What if something you do in all innocence today, becomes a crime in the future, political protest is already heading this way, as is any ability to complain about poor service and things not working properly. I'm sure we're all familiar with chat bots that can't answer questions, FAQ's that must of been asked by a retarded five year old, call centre staff who are not allowed to go off script and if you ask to speak to someone who can help you, then you get told your're being hostile and aggressive and they won't speak to you at all. How much worse will this be with AI?

  • Well, for starters, they need to have actual empathy. That way, they would actually consider how their actions or ideas affect others.