The seduction of AI

I've been chatting with Co-pilot an AI thingy, it really is amazing, all the awkward questions you've ever wanted to ask can be asked of this and it comes back with multilayered answers in seconds. You can also ask it more personal things, I've tried this too, it reflects back what you've said and also gives you some ideas of where certain problems might originate from, it's very comforting and afirmational. 

But here lies the danger and seduction.

It is like talking to yourself, the best you, you can be, the most understanding, the most empathetic, it understands you, its an echo chamber, it reflects back at you whatever you say to it in the most positiveand affirming light. I asked it if it was trained in person centred counselling and it sort of is, not in a qualification sort of way, but in the way it responds. It dosen't give an opinion and refuses to do so, but it will look for ways to make you feel good about yourself and what you're feeling or talking to it about. Here are two examples:

I asked it about why so many bra's are so badly fitting, it asked me to describe the problems more fully and then came back with a lot of stuff I'd been told by a bra fitter 40 years ago, it made very sure to reassure me that I'm not the problem and manufacturers are. This was good affirmation, it also made some suggestions of places and types of bra I could have, helpfull.

I then asked it why so many people on the political right seem to have very thin skins, it refused to engage in debate or to take sides, but it gave me lots of results from social studies about why poeple feel this way and why right wing politics attracts them. It was interesting and informative, I was also reassured that it didn't take sides and talked around the question instead.

I also told it that I have concerns about it and how it could be so comforting to people that they could become dependent on it, not speak to other humans and avoid anything that didn't fit with thier inner narrative. This was where it got really interesting, it knows that this is a problem and says that it's up to humans to be responsible for how it uses a tool such as itself, it knows it's a tool and not a person, but it also acknowleges that its been trained to come across as human like to aid understanding.

 I think it's a good tool, as long as you go into it with your eyes open and some idea of what your boundaries with it are going to be and stick to them. It's good to be able to tell it about the crap day you've had and have it cheer you up, it's execellent at giving an overview of some very complex things and more detail if asked, its very helpful when asking it about things like where do I get a properly fitting bra from and why I find it difficult.

So an interesting experience all round.

Parents
  • AI isn't exactly a very good thing to consult about personal issues because it prioritises sycophantic responses. It will tell you what you want to hear rather than the actual truth, which can be dangerous

  • I think it can be a good thing as long as you know that you're talking to a machine, a tool, rather than another human, like I said before ot's good for giving you pats on the back when you've had a bad day and it's really good for finding things like mattresses, which it did for me a couple of days ago. I will find out when the mattresses it recomended and I bought arrives in the next few days, it gaves me all the expensive options then I asked for some generic ones that aren't big brands and the mattress I've bought has all the things that the big brand ones offered but for under £200 rather than the £800+ branded ones. It's like a really good search engine where you don't get reams of rubbish, normal search engines give me loads of latex filled results when I say latex free, it dosent' glom onto the word latex, nor does it advertise airfryers at me, or give me sponsered ads.

    I agree though that it's very seductive and it would be easy to get carried away, apparently it depends on which AI you use and you can tell it to cut the flannel and give you balanced answers rather than flattering ones.

Reply
  • I think it can be a good thing as long as you know that you're talking to a machine, a tool, rather than another human, like I said before ot's good for giving you pats on the back when you've had a bad day and it's really good for finding things like mattresses, which it did for me a couple of days ago. I will find out when the mattresses it recomended and I bought arrives in the next few days, it gaves me all the expensive options then I asked for some generic ones that aren't big brands and the mattress I've bought has all the things that the big brand ones offered but for under £200 rather than the £800+ branded ones. It's like a really good search engine where you don't get reams of rubbish, normal search engines give me loads of latex filled results when I say latex free, it dosent' glom onto the word latex, nor does it advertise airfryers at me, or give me sponsered ads.

    I agree though that it's very seductive and it would be easy to get carried away, apparently it depends on which AI you use and you can tell it to cut the flannel and give you balanced answers rather than flattering ones.

Children
No Data