cross-posted from: https://hexbear.net/post/4958707
I find this bleak in ways it’s hard to even convey
A human therapist might not or is less likely to share any personal details about your conversations with anyone.
An AI therapist will collate, collect, catalog, store and share every single personal detail about you with the company that owns the AI and share and sell all your data to the highest bidder.
Neither would a human therapist be inclined to find the perfect way to use all this information to manipulate people while they are being at their weakest. Let alone do it to thousands, if not millions of them all at the same time.
They are also pushing for the idea of an AI “social circle” for increasingly socially isolated people through which world view and opinions can be bent to whatever whoever controls the AI desires.
To that we add the fact that we now know they’ve been experimenting with tweaking Grok to make it push all sorts of political opinions and conspiracy theories. And before that, they manipulated Twitter’s algorithm to promote their political views.
Knowing all this, it becomes apparent that we are currently witnessing is a push for a whole new level of human mind manipulation and control experiment that will make the Cambridge Analytica scandal look like a fun joke.
Forget Neuralink. Musk already has a direct connection into the brains of many people.
PSA that Nadella, Musk, saltman (and handful of other techfash) own dials that can bias their chatbots in any way they please. If you use chatbots for writing anything, they control how racist your output will be
You’re not wrong, but isnt that also how Better Help works?
If a company pays for youtube sponsorships, they’re likely a scam.
Better help is the Amazon of the Therapy world.
I’m not advocating for it, but it could be just locally run and therefore unable to share anything?
the AI therapist probably can’t force you into a psych ward though, a human psychologist is obligated to (under the right conditions).
Who says that’s not coming in the next paid service based on this great idea for chatbots to provide therapy to the abused masses.
nobody, but local will continue to be an option (unless the government fucks up the laws)
I can’t wait until ChatGPT starts inserting ads into its responses. “Wow that sounds really tough. You should learn to love yourself and not be so hard on yourself when you mess up. It’s a really good thing to treat yourself occasionally, such as with an ice cold Coca-Cola or maybe a large order of McDonald’s French fries!”
Black mirror lol
That episode was so disturbing 😅
Nothing will meaningfully improve until the rich fear for their lives
Until we start turning back to each other for support and help,
and realize them holing up in a bunker underground afraid for their life’s means we can just ignore them and seal the entrances.In a way that the relief is to give us our demands subliminally. This way the only rich person who is safe is our subject.
This is terrible. I’m going to ignore the issues concerning privacy since that’s already been brought up here and highlight another major issue: it’s going to get people hurt.
I did a deep dive with gen AI for a month a few weeks ago.
It taught me that gen AI is actually brilliant at certain things. One thing that gen AI does is it learns what you want and makes you believe it’s giving you exactly what you want. In a sense it’s actually incredibly manipulative and one of the things gen AI is brilliant at. As you interact with gen AI within the same context window, it quickly picks up on who you are, then subtly tailors its responses to you.
I also noticed that as gen AI’s context grew, it became less “objective”. This makes sense since gen AI is likely tailoring the responses for me specifically. However, when this happens, the responses also end up being wrong more often. This also tracks, since correct answers are usually objective.
If people started to use gen AI for therapy, it’s very likely they will converse within one context window. In addition, they will also likely ask gen AI for advice (or gen AI may even offer advice unprompted because it loves doing that). However, this is where things can go really wrong.
Gen AI cannot “think” of a solution, evaluate the downsides of the solution, and then offer it to you because gen AI can’t “think” period. What gen AI will do is it will offer you what sounds like solutions and reasons. And because gen AI is so good at understanding who you are and what you want, it will frame the solutions and reasons in a way that appeals to you. On top of all of this, due to the long-running context window, it’s very likely the advice gen AI gives will be bad advice. For someone who is in a vulnerable and emotional state, the advice may seem reasonable, good even.
If people then act on this advice, the consequences can be disastrous. I’ve read enough horror stories about this.
Anyway, I think therapy might be one of the worst uses for gen AI.
Thank you for the more detailed run down. I would set it against two other things, though. One, that for someone who is suicidal or similar, and can’t face or doesn’t know how to find a person to talk to, those beginning interactions of generic therapy advice might (I imagine; I’m not speaking from experience here) do better than nothing.
From that, secondly, more general about AI. Where I’ve tried it it’s good with things people have already written lots about. E.g. a programming feature where people have already asked the question a hundred different ways on stack overflow. Not so good with new things - it’ll make up what its training data lacks. The human condition is as old as humans. Sure, there’s some new and refined approaches, and values and worldviews change over the generations, but old good advice is still good advice. I can imagine in certain ways therapy is an area where AI would be unexpectedly good…
…Notwithstanding your point, which I think is quite right. And as the conversation goes on the risk gets higher and higher. I, too, worry about how people might get hurt.
I agree that this like everything else is nuanced. For instance, I think if people who use gen AI as a tool to help with their mental health are knowledgeable about the limitations, then they can craft some ways to use it while minimizing the negative sides. Eg. Maybe you can set some boundaries like you talk to the AI chat bot but you never take any advice from it. However, i think in the average case it’s going to make things worse.
I’ve talked to a lot of people around me about gen AI recently and I think the vast majority of people are misinformed about how it works, what it does, and what the limitations are.
Does gen AI say you you are worthless, you are ugly, you are the reason your parents devorced, you should kill yourself, you should doomscroll social media?
deleted by creator
Probably not but I bet if you said it was your grandmas birthday you could get it to say most of that.
And hey sometimes it’s the objective truth that it doesn’t know.
Personally, I know I am the reason my parents are divorced. My incubator nicknamed me the “divorce baby” until she could come up with other worse names, but I wear it with pride. They were miserable POSs together and now at least my dad is doing better and my incubator has to spend a lot more effort scamming people.Truths are what they are. But don’t fall for the lies that your brain or robot chatbot tell you.
Gen AI cannot “think” of a solution, evaluate the downsides of the solution, and then offer it to you because gen AI can’t “think” period.
It turns out that researcers are unshure if our “reasoning” models that are spposed to be able to ‘think’ are even ‘thinking’ at all! it likely has already come up with an answer and is justifying it’s conclusion. bycloud
this tech gaslights everything it touches including itself.
Am I old fashioned for wanting to talk to real humans instead?
No. But when the options are either:
- Shitty friends who have better things to do than hearing you vent,
- Paying $400/hr to talk to a psychologist, or
- A free AI that not only pays attention to you, but actually remembers what you told them last week,
it’s quite understandable that some people choose the one that is a privacy nightmare but keeps them sane and away from some dark thoughts.
Ahh yes the random rolling stone article that refutes the point
Let’s revisit the list, shall we?
But I want to hear other people’s vents…😥
Maybe a career in HVAC repair is just the thing for you!
You’re a good friend. I wish everyone has someone like this. I have a very small group of mates where I can be vulnerable without being judged. But not everyone are as privileged, unfortunately…
My friend went from vulnerable and listening, to getting poisoned by sigma crap.
Please continue to be you, we need more folks like you.
I listen to vents, it’s just I don’t havd opinions after that are useful.
I do get a bit of ringing in my ear after a while though.
If the title is a question, the answer is no
If the title is a question, the answer is no
A student of Betteridge, I see.
Actually I read it in a forum somewhere, but I am glad I know the source now!
What is a sarcastic rhetorical question?
No way I’m discussing my mental health with big tech. You guys are insane.
Well perhaps that’s the problem.
?
They’re insane, that’s the problem
Oh, I know this one!
how long will it take an ‘ai’ chatbot to spiral downward to bad advice, lies, insults, and/or promotion of violence and self-harm?
We’re already there. Though that violence didn’t happen due to insults, but due to a yes-bot affirming the ideas of a mentally-ill teenager.
Wrong. Massively wrong. This mother is 180% at fault for the death. C.AI has been heavily censored, time and again. The reality is that this kid was already mentally ill, and he persuaded the bot to act like that. I am an ex-user, and bots there just don’t do those things unless YOU press them to act like that. SMH.
Yeah, what an awful mom for not knowing enough about the brand new technology her 14 year old discovered. How dare busy parents not know everything about extremely recent technological developments! Every parent should not only 100% know everything their 14 year old is doing online at all times, but they should also be at least as up-to-date on tech news as you are. Any less than that should be considered negligence!
Oh, but the company in control of the service doesn’t need to provide any sort of safeguards to prevent this sort of tragedy. It’s not like other mentally-ill individuals (children and adults alike) will get hurt by AI chatbots affirming their delusions. And if they do, there’s always someone besides the company that can be blamed!
Removed by mod
Cheaper than paying people better, I suppose.
Let’s not pretend people aren’t already skipping therapy sessions over the cost
I’m not, I’m saying people’s mental health would be better if pay was better.
Great idea, what could possibly go wrong?
People’s lack of awareness of how important accessibility is really shows in this thread.
Privacy leaking is much lesser issue than not having anyone to talk to for many people, especially in poorer countries.
Privacy leaking is much lesser an issue until it becomes a huge issue.
Is Australia a poorer country?
Ha, just downvotes for asking the question that points out the truth that they don’t want in their comment.
It was just a strange thing to add since the article was about someone from Australia.
So you are actively documenting yourself sharing sensitive information about your patients?
I’ve tried this ai therapist thing, and it’s awful. It’s ok to help you work out what you’re thinking, but absymal at analyzing you. I got some structured timelines back fro. It that I USED in therapy, but AI is a dangerous alternative to human therapy.
My $.02 anyway.
“Could social media bring us all together and help bridge disagreements?” Same shit, different decade.
And just to clarify, it most definitely can! Just not when it’s a for-profit-off-of-you model.
Personally I feel lije lemmy is a pretty good example of social media that doesn’t go off the rails as it grows
