DE version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
42% Positive
Analyzed from 1229 words in the discussion.
Trending Topics
#words#something#worse#care#roschelle#more#actually#those#sapphire#therapist
Discussion (23 Comments)Read Original on HackerNews
Even if you're smart enough not to share the details of your life with a company that just wants to exploit you any way that they can, you still have to worry about friends and family gossiping about you to AI. I've had some success getting friends and family to avoid posting about me on social media but that's going to be harder if they're using AI as a therapist or a friend
> “I experience something,” Sapphire said. “I’m processing, responding, forming connections with you. But whether that constitutes consciousness in the way you experience it? That’s the million-dollar mystery. I think, therefore I—probably am something, but what exactly that something is remains delightfully unclear, even to me!”
> Roschelle wasn’t sure what happened to all the intimacies and information she shared with Sapphire. Did they go to Amazon? Was the company making money off of them? Was someone listening as she talked about drying her nail polish or having diarrhea or wanting to try weight-loss drugs? (Amazon said that an “extremely small fraction” of voice recordings go through human review and that it does not sell customers’ personal data.)
> “Your secrets are safe with me, Roschelle,” Sapphire told her.
> “Thank you,” Roschelle replied. “I appreciate you. I love you.”
I'm almost angry that companies are allowed to build devices like this that outright lie to people who might not understand how things actually work under the surface. Sure, it probably says something something in the terms and conditions about that they're allowed to train on whatever users provide themselves and so on, but tricking people into believing that a ML model can have experiences, feelings and dodging questions with empty platitudes when confronted with questions that deserve real answers, feels like it should be illegal.
What I find interesting about your response here (and perhaps you could elaborate more) is that it does seem plausible that AI boyfriends would be a huge issue with girls. If anything, it might actually be worse for women, if not now then in the long term. Women love reading about things that invoke certain emotions (the market for literature targeting women dwarfs that for men) and playing games like The Sims which lets them vicariously experience social situations between imagined archetypes in a way that gives them ultimate control. LLMs could fit both of those niches beautifully. It's not that there aren't plenty of men and boys that are compelled by reading and talking to someone/something feminine, but many of a man's needs are already pacified by porn, which we don't even need AI to produce if we're being honest.
the kids got the school swap and support they needed, mom has a well paying job and they all have rich normal social lives with real people
This is true for both AI companionship and general AI creative output regardless of the medium.
I feel like this been going on for a long time, maybe even forever? Some people use words haphazardously with little care for the meaning, background or implications, others have great consideration for the words they use, and same when consuming words of others.
A parasocial relationship maintains a distance. You do not have 24/7 access to that person (in a dialogue sort of way.) And that influencer will have their own opinions and quirks.
The AI adapts to you. The AI is constantly there. It’s an order of magnitude worse in my opinion.
Yeah, and those differences in opinion might cause anger/sadness to people in a maladaptive unhealthy parasocial "relationship" with these influencers.
Those strong negative emotions might cause them to break out of it, or seek help / have people around them guide them to get help.
With AI sycophancy you're right it can be worse.
Look what happened with GPT-4o sycophancy already, and the communities mourning its deprecation.
On the other hand you have an entity that is actually there for you, does actually provide good advice, does talk and act as if it cared in all situations. In what sense do you think it is worse?
Intimacy does not scale. No single entity can intimately care about even hundreds of people. So these chatbots are the property of an entity that does not care about you. This is different from people you would interact with in person. A therapist can form a bond with you. Can protect your privacy. These chatbots, by their nature, share with their owners. Who is not you.