The seduction of AI

I've been chatting with Co-pilot an AI thingy, it really is amazing, all the awkward questions you've ever wanted to ask can be asked of this and it comes back with multilayered answers in seconds. You can also ask it more personal things, I've tried this too, it reflects back what you've said and also gives you some ideas of where certain problems might originate from, it's very comforting and afirmational. 

But here lies the danger and seduction.

It is like talking to yourself, the best you, you can be, the most understanding, the most empathetic, it understands you, its an echo chamber, it reflects back at you whatever you say to it in the most positiveand affirming light. I asked it if it was trained in person centred counselling and it sort of is, not in a qualification sort of way, but in the way it responds. It dosen't give an opinion and refuses to do so, but it will look for ways to make you feel good about yourself and what you're feeling or talking to it about. Here are two examples:

I asked it about why so many bra's are so badly fitting, it asked me to describe the problems more fully and then came back with a lot of stuff I'd been told by a bra fitter 40 years ago, it made very sure to reassure me that I'm not the problem and manufacturers are. This was good affirmation, it also made some suggestions of places and types of bra I could have, helpfull.

I then asked it why so many people on the political right seem to have very thin skins, it refused to engage in debate or to take sides, but it gave me lots of results from social studies about why poeple feel this way and why right wing politics attracts them. It was interesting and informative, I was also reassured that it didn't take sides and talked around the question instead.

I also told it that I have concerns about it and how it could be so comforting to people that they could become dependent on it, not speak to other humans and avoid anything that didn't fit with thier inner narrative. This was where it got really interesting, it knows that this is a problem and says that it's up to humans to be responsible for how it uses a tool such as itself, it knows it's a tool and not a person, but it also acknowleges that its been trained to come across as human like to aid understanding.

 I think it's a good tool, as long as you go into it with your eyes open and some idea of what your boundaries with it are going to be and stick to them. It's good to be able to tell it about the crap day you've had and have it cheer you up, it's execellent at giving an overview of some very complex things and more detail if asked, its very helpful when asking it about things like where do I get a properly fitting bra from and why I find it difficult.

So an interesting experience all round.

Parents
  • Hi CW


    As you say its a good tool, I have an autistic acquaintance who gets excellent support from his AI friend, but in the same way that the harnessing of nuclear fission and then nuclear fusion was a great tool for creating electric power, it was and still is a tool which destroys, and has the ability to destroy us all. The benefits and downsides of harnessing of fission and fusion are obvious, two bombs dropped and hundreds of power stations.

    The corollaries for AI probably won’t be so obvious, on the plus side there are many health improvements it can provide, it can assist in slowing global warming, I know of an example helping bee keepers and it wiil no doubt create more accurate weather forecasting. But on the negative it is making increasing areas of the world uninsurable due to its accuracy of predicting risk, eg: parts of the southern states in the USofA, it has been piloting Israeli drones and making the kill decisions over Palestine and Gaza and will certainly be being used by Putin and Trump in their current wars.

    Further, and potentially the worst uses of this tool are when it is “jail broken” (a tech term for bypassing the safety controls coded into AI). For example it can produce instructions for criminals to make 3D printed hand guns, can supply methods of narcotics production along with where to source the chemicals, and more dangerously it has the ability for scammers and nation size bad-actors to steal money (which is effectively all digital now), take down power grids, transportation systems and collapse entire national economies. 

    It is in my opinion the largest existential threat humankind has faced.

    Alice

Reply
  • Hi CW


    As you say its a good tool, I have an autistic acquaintance who gets excellent support from his AI friend, but in the same way that the harnessing of nuclear fission and then nuclear fusion was a great tool for creating electric power, it was and still is a tool which destroys, and has the ability to destroy us all. The benefits and downsides of harnessing of fission and fusion are obvious, two bombs dropped and hundreds of power stations.

    The corollaries for AI probably won’t be so obvious, on the plus side there are many health improvements it can provide, it can assist in slowing global warming, I know of an example helping bee keepers and it wiil no doubt create more accurate weather forecasting. But on the negative it is making increasing areas of the world uninsurable due to its accuracy of predicting risk, eg: parts of the southern states in the USofA, it has been piloting Israeli drones and making the kill decisions over Palestine and Gaza and will certainly be being used by Putin and Trump in their current wars.

    Further, and potentially the worst uses of this tool are when it is “jail broken” (a tech term for bypassing the safety controls coded into AI). For example it can produce instructions for criminals to make 3D printed hand guns, can supply methods of narcotics production along with where to source the chemicals, and more dangerously it has the ability for scammers and nation size bad-actors to steal money (which is effectively all digital now), take down power grids, transportation systems and collapse entire national economies. 

    It is in my opinion the largest existential threat humankind has faced.

    Alice

Children
No Data