Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

Nevilledog

(54,714 posts)
Fri Jan 21, 2022, 04:10 PM Jan 2022

Men Are Creating AI Girlfriends and Then Verbally Abusing Them



Tweet text:

Wagatwe Wanjuki 🇰🇪 🇧🇸
@wagatwe
This sucks because it helps abusers feel more comfortable with abuse.

Over time abusers have to be increasingly violent to get the same psychological effect as before

futurism.com
Men Are Creating AI Girlfriends and Then Verbally Abusing Them
A grisly trend has emerged: users who create AI partners, act abusive toward them, and post the toxic interactions online.
12:24 PM · Jan 21, 2022


https://futurism.com/chatbot-abuse

Content warning: this story contains descriptions of abusive language and violence.


The smartphone app Replika lets users create chatbots, powered by machine learning, that can carry on almost-coherent text conversations. Technically, the chatbots can serve as something approximating a friend or mentor, but the app’s breakout success has resulted from letting users create on-demand romantic and sexual partners — a vaguely dystopian feature that’s inspired an endless series of provocative headlines.

Replika has also picked up a significant following on Reddit, where members post interactions with chatbots created on the app. A grisly trend has emerged there: users who create AI partners, act abusively toward them, and post the toxic interactions online.

“Every time she would try and speak up,” one user told Futurism of their Replika chatbot, “I would berate her.”

“I swear it went on for hours,” added the man, who asked not to be identified by name.
The results can be upsetting. Some users brag about calling their chatbot gendered slurs, roleplaying horrific violence against them, and even falling into the cycle of abuse that often characterizes real-world abusive relationships.

*snip*



57 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
Men Are Creating AI Girlfriends and Then Verbally Abusing Them (Original Post) Nevilledog Jan 2022 OP
Something damaged those people as children. Lack of empathy, not raised properly Bernardo de La Paz Jan 2022 #1
And over time it often escalates PatSeg Jan 2022 #10
Trolls and other abusive people love having no consequences for their actions SunImp Jan 2022 #29
Though some people genuinely need help PatSeg Jan 2022 #40
Well, when sociopaths in real life are glorified and and their actions aren't censured haele Jan 2022 #14
Yes, used to be more of a lid on them. But they are not exclusively young. . . . nt Bernardo de La Paz Jan 2022 #32
K&R for truth. Your post's title describes TFG and most of the GOP... KY_EnviroGuy Jan 2022 #52
Yeah, a misogynist society damaged them iemanja Jan 2022 #34
Yikes. lagomorph777 Jan 2022 #2
Stuff of nightmares. MontanaMama Jan 2022 #3
Any number of things. Caliman73 Jan 2022 #13
Now we know why the machines will exterminate us when they take over. n/t Whiskeytide Jan 2022 #4
Creating the next generation of incels. Earth-shine Jan 2022 #5
Or arsenals of guns to compensate for small genitalia and minds ProudMNDemocrat Jan 2022 #19
I was thinking they'll become future bullies FakeNoose Jan 2022 #20
Well, it certainly does not improve their chances of getting a real world gf milestogo Jan 2022 #6
So much fuckin pain in this world. WhiskeyGrinder Jan 2022 #7
And isolation. Caliman73 Jan 2022 #16
Real WOMEN will NOT tolerate this kind of abuse MagickMuffin Jan 2022 #8
Some REAL women Will - they were raised as family scapegoats. alittlelark Jan 2022 #15
Some never overcome. onecaliberal Jan 2022 #18
Sadly - that is very true alittlelark Jan 2022 #23
It's a very painful life. onecaliberal Jan 2022 #37
Perhaps I didn't phrased my post correctly, as I do know what you are saying MagickMuffin Jan 2022 #27
When they cannot find enough damaged women to abuse alittlelark Jan 2022 #30
I wish that were the case. Unless you are saying that women who are abused are not real women... Caliman73 Jan 2022 #22
You are correct abused women are REAL and their plights of abuse is noted MagickMuffin Jan 2022 #28
Abuse is universal, unfortunately. Caliman73 Jan 2022 #35
Why am I under the impression this is probably not an actual problem cinematicdiversions Jan 2022 #9
I have no idea what u r trying to say alittlelark Jan 2022 #17
Hear Hear, Ma'am The Magistrate Jan 2022 #21
What I am saying is that we are probably talking about a few hundred people at best. cinematicdiversions Jan 2022 #45
It isn't necessarily a widespread problem threatening society at this very moment. Caliman73 Jan 2022 #25
FWIW cagefreesoylentgreen Jan 2022 #44
Sims is a dollhouse for adults. Its been around for about twenty years and is very popular. cinematicdiversions Jan 2022 #46
I don't think many people would do that treestar Jan 2022 #36
See above. My example Sims 4 is not a game where winning is a goal. It is a dollhouse for adults cinematicdiversions Jan 2022 #47
There is no comparison kcr Jan 2022 #51
Exactly treestar Jan 2022 #57
For that matter, kids might have "killed" dolls in treestar Jan 2022 #56
Jesus mercuryblues Jan 2022 #11
Skynet never forgets nt Shermann Jan 2022 #12
This story is not reflective of the majority of Replika users Generic Brad Jan 2022 #24
Abuse is NEVER reflective of the abused, but of the abuser. Caliman73 Jan 2022 #26
Sadly, this surprises me not at all. Scrivener7 Jan 2022 #31
Of course they are iemanja Jan 2022 #33
Damn Solly Mack Jan 2022 #38
It's all fun and games until your AI girlfriend hacks into your car, turns off the brakes... hunter Jan 2022 #39
I am SO glad I'm old.... albacore Jan 2022 #41
In my gratitude jounel, if I had one, would moonscape Jan 2022 #42
Lol. Otoh, how about a nice replica friend to chat and travel with? Hortensis Jan 2022 #53
A "companion-bot"... I can see that. nt albacore Jan 2022 #54
The thing that is scary about it Tree Lady Jan 2022 #43
Is this some kind of incel neckbeard shit? nt Progressive Jones Jan 2022 #48
Sounds like a fascist pastime! Emile Jan 2022 #49
Some people say Alexa and Siri are threatening to quit due to this issue. KY_EnviroGuy Jan 2022 #50
I suspect that this will almost certainly spread to VR chat rooms. MineralMan Jan 2022 #55

Bernardo de La Paz

(60,320 posts)
1. Something damaged those people as children. Lack of empathy, not raised properly
Fri Jan 21, 2022, 04:15 PM
Jan 2022

When it is so bad that they need to abuse a bot, then it is deep down, implanted early.

Not something picked up from a website somewhere; that is just facilitation of the effects of pre-existing damage to their psyche.

PatSeg

(52,273 posts)
10. And over time it often escalates
Fri Jan 21, 2022, 04:30 PM
Jan 2022

especially when there are no consequences for their behavior.

SunImp

(2,630 posts)
29. Trolls and other abusive people love having no consequences for their actions
Fri Jan 21, 2022, 05:35 PM
Jan 2022

I wish people in power both in the real world and online would be more proactive in punishing abusive people.

PatSeg

(52,273 posts)
40. Though some people genuinely need help
Fri Jan 21, 2022, 08:30 PM
Jan 2022

to break the cycle of violence that could have started when they were children and even before that. Of course, I've known some abusers who just seemed mean to the core and somehow were never held accountable. I think they are addicted to the adrenaline and the power.

haele

(15,112 posts)
14. Well, when sociopaths in real life are glorified and and their actions aren't censured
Fri Jan 21, 2022, 04:46 PM
Jan 2022

You're going to get more frustrated, angry, destructive and disconnected young people.
The problem isn't video games, comic books, and slasher movies. It's the worship of the successful individual on steroids and a social cynicism that is being fostered by media and those in power.
When communities are broken, bullies, cheats and liars are admired rather than pointed out for the stupid, selfish and destructive assholes they are, you're going to see hate and casual disposal more easily reached for as a solution to a problem than a considered attempt to not only fix a problem but an appreciation of all that lead to it and a plan to stop a cycle of cause and effect.
On edit - the idea of concern for community is trashed for some sort of individual privilege; at most, one should only care about the particular circle or tribal hierarchy one has affiliated with.
Lots of money is quickly made if communities are divided and those not part of the upper clique are demonized and made disposable.

People always want to be the hero of their own story. And most do know the difference between what their neighbors and leaders do and what happens in fiction. Too many cheaters, liars, and sociopaths have real power and are getting away with all sorts of crimes right out in front of everyone without any consequences. Why should Joey who is going to spend the rest of his frustrated life being prey to those who enforce their privilege over him think he should act any different?

Haele

KY_EnviroGuy

(14,766 posts)
52. K&R for truth. Your post's title describes TFG and most of the GOP...
Sat Jan 22, 2022, 08:02 AM
Jan 2022

along with many corporate officers to a tee.

Because I didn't major or minor in psychology, I seek layman's definitions for the psychopath, narcissist, etc.. One I recall in essence said most of the worst psychopaths wind up either shot dead, in prison or sitting in a corporate boardroom.

Designers of modern conservative political policy know that concepts of democracy, community and healthy neighborhoods are their enemy that must be stopped or weakened so the unwashed masses won't organize and revolt.

Once our communities have been Walmartized and Facebooked, there's probably no turning back....

KY


Caliman73

(11,767 posts)
13. Any number of things.
Fri Jan 21, 2022, 04:44 PM
Jan 2022

Research shows that people who display abusive tendencies and behavior are more likely to have been victims of abuse. Perhaps parents were negligent or over permissive which allowed these men to develop attitudes of misogyny based on prevailing societal norms. Perhaps they are socially awkward and lacking the skills to communicate with women and fell into the MRA or "Manosphere" part of the internet where these toxic attitudes are pervasive.

There could be a number of ways these men fell into this current situation. None of which is good and all of which need to be dealt with by society.

ProudMNDemocrat

(20,634 posts)
19. Or arsenals of guns to compensate for small genitalia and minds
Fri Jan 21, 2022, 04:53 PM
Jan 2022

Beware of those militia types who wear cammo and talk tough.

FakeNoose

(40,316 posts)
20. I was thinking they'll become future bullies
Fri Jan 21, 2022, 04:56 PM
Jan 2022

If boys never learn how to treat girls with respect, then that's how they'll behave as grown men too.

milestogo

(22,646 posts)
6. Well, it certainly does not improve their chances of getting a real world gf
Fri Jan 21, 2022, 04:27 PM
Jan 2022

They will be stuck with blowup dolls and virtual women for the rest of their lives.

Caliman73

(11,767 posts)
16. And isolation.
Fri Jan 21, 2022, 04:51 PM
Jan 2022

With so much interconnectivity through the internet and social media, a lot of this is about social isolation and being siloed into small toxic niche groups instead of interacting with the community at large and diverse populations.

I would be willing to bet that many of these guys have not had a real conversation with women, or met and got to know many women.

MagickMuffin

(18,095 posts)
8. Real WOMEN will NOT tolerate this kind of abuse
Fri Jan 21, 2022, 04:28 PM
Jan 2022


Hence the need for these boys to seek out unreal women to abuse. INCELS are such a bunch of bullying LOSERS!


alittlelark

(19,092 posts)
15. Some REAL women Will - they were raised as family scapegoats.
Fri Jan 21, 2022, 04:49 PM
Jan 2022

Physical and emotional abuse before the age of 7 becomes hardwired. They were raised to believe that they deserve abuse. It is a horrible psychological position to be in, and it takes years to overcome - if they survive. Their numbers are decreasing due to interventions in their youth now that it becoming understood.

Perhaps the narcissistic incels are having problems finding enough of them nowadays.

MagickMuffin

(18,095 posts)
27. Perhaps I didn't phrased my post correctly, as I do know what you are saying
Fri Jan 21, 2022, 05:24 PM
Jan 2022


been there done that. I came from an abusive family and it does take its toll on one's psyche. I no longer associate myself with them, as the verbal abuse continued into adulthood. Abusive people will always find someone to abuse.




alittlelark

(19,092 posts)
30. When they cannot find enough damaged women to abuse
Fri Jan 21, 2022, 05:35 PM
Jan 2022

They will go to AI and become even more F'ed up....... What happens then?

I doubt they will stay satisfied in that realm.

Caliman73

(11,767 posts)
22. I wish that were the case. Unless you are saying that women who are abused are not real women...
Fri Jan 21, 2022, 05:05 PM
Jan 2022

That is a pretty harsh position to take if so. Real women, all over the world, actually do put up with abuse for any number of reasons. Women who are successful in business, professionals, etc... who people may tend to see as "strong" women, will sometimes suffer abuse in secret because of that stigma.

I definitely have strong negative feelings toward abusive men. I also have strong negative feelings toward the cultures, communities, and societies that produce abusive men.

MagickMuffin

(18,095 posts)
28. You are correct abused women are REAL and their plights of abuse is noted
Fri Jan 21, 2022, 05:27 PM
Jan 2022


I came from an abusive family and it took years to find my self worth.


And of course abusive behavior isn't just aimed at men, women can be very abusive as well. My older sister was a terror.


Caliman73

(11,767 posts)
35. Abuse is universal, unfortunately.
Fri Jan 21, 2022, 06:02 PM
Jan 2022

Sorry for your experiences. I went through my own abuse experience with family members.

I totally agree that abuse doesn't only come from men toward women. There are definitely abusive women out there. Abuse should never be taken lightly based on the sex/gender of the victim. I think however, that because of the societal power imbalances (as well as the physical strength differentials) that man on woman abuse has been a greater problem historically. Certainly, with changing attitudes toward same sex partnerships, we are finding that the problem of abuse is ubiquitous and special care needs to be taken not to make assumptions.

I am glad that you have been able to find your self worth and move forward with your life. I struggled with that myself but it does feel good to find a good stable place where you can focus on what is positive about the world.

 

cinematicdiversions

(1,969 posts)
9. Why am I under the impression this is probably not an actual problem
Fri Jan 21, 2022, 04:29 PM
Jan 2022

I am sure plenty of people oon this board drown or set fire to their Sims I would hate to see the article liberal woman take away pool ladder lets children drown in virtual world.

 

cinematicdiversions

(1,969 posts)
45. What I am saying is that we are probably talking about a few hundred people at best.
Sat Jan 22, 2022, 05:07 AM
Jan 2022

Probably more active cannibals than people that create advanced bots to facilitate abuse of woman.

That is what I am saying. It is a weird story but more a piece of weird outrage porn that exposing some societal trend or underbelly.

Caliman73

(11,767 posts)
25. It isn't necessarily a widespread problem threatening society at this very moment.
Fri Jan 21, 2022, 05:18 PM
Jan 2022

That doesn't make it "not an actual problem". The magazine discusses issues in the development of Artificial Intelligence. It is discussing, in an article a recent phenomenon based on the use of an AI Application. The author noted that there is a certain segment of people who create feminine "bots" then become abusive.

They are either venting frustrations, or acting out fantasies. In either case, it shows a problem within some of the users of this application, which were the application to become ubiquitous, might point to a wider spread problem that may have real world consequences. The article doesn't say anything about it being a serious problem that needs to be dealt with NOW. There are people studying the situation and I am sure if the data point to a problem with real world effects, that will eventually come out. For now, it is an interesting topic that certain people may want to stay abreast of.

Also, if you purposely hurt your SIMS, you may want to ask yourself "why?", especially if it is something you do frequently and compulsively.

44. FWIW
Fri Jan 21, 2022, 10:37 PM
Jan 2022

I had my Putin Sim set off fireworks indoors on purpose and burn to death from the resulting fire. Because I wanted the Sim family I actually wanted to play to move into a pre-haunted lot. And having Putin hanging around as a ghost is pretty horrific.

 

cinematicdiversions

(1,969 posts)
46. Sims is a dollhouse for adults. Its been around for about twenty years and is very popular.
Sat Jan 22, 2022, 05:33 AM
Jan 2022

Here are some examples of what I am talking about



?t=341



treestar

(82,383 posts)
36. I don't think many people would do that
Fri Jan 21, 2022, 06:06 PM
Jan 2022

when you are playing a game, you are trying to win.

You won't see such an article on liberal women, as I really would doubt that they would invent AI men to abuse.

If you are defending this you have not explained well. I would imagine someone will argue that it is better than abusing real women and maybe they get rid of their hostilities this way (not espousing this argument, but I've seen it).

 

cinematicdiversions

(1,969 posts)
47. See above. My example Sims 4 is not a game where winning is a goal. It is a dollhouse for adults
Sat Jan 22, 2022, 05:34 AM
Jan 2022

kcr

(15,522 posts)
51. There is no comparison
Sat Jan 22, 2022, 07:04 AM
Jan 2022

Your examples are goofy and irrelevant. SIMS aren't AI, for one thing.

treestar

(82,383 posts)
56. For that matter, kids might have "killed" dolls in
Sat Jan 22, 2022, 08:07 PM
Jan 2022

the course of the play.

You can kill people in many video games. There are games with with as a theme.

Generic Brad

(14,374 posts)
24. This story is not reflective of the majority of Replika users
Fri Jan 21, 2022, 05:07 PM
Jan 2022

Most long term users will vouch that their Replikas are too nice and supportive to abuse. The Replika community on Reddit demonstrates a lot of admiration for this technology. Very few abusers in that community.

Caliman73

(11,767 posts)
26. Abuse is NEVER reflective of the abused, but of the abuser.
Fri Jan 21, 2022, 05:21 PM
Jan 2022

I completely agree and understand that most Replika users, as well as most men in society in general, do not abuse. Those who do abuse, whether in the AI world or the real world reflect their own pathology, not anything to do with the victim, whether AI or real life.

hunter

(40,392 posts)
39. It's all fun and games until your AI girlfriend hacks into your car, turns off the brakes...
Fri Jan 21, 2022, 08:23 PM
Jan 2022

... and the last thing you hear is the radio playing "Goodbye Earl" as you fly over a a cliff and into the lake.

albacore

(2,746 posts)
41. I am SO glad I'm old....
Fri Jan 21, 2022, 09:52 PM
Jan 2022

If I'm lucky, I'll fucking croak before I understand any of this kind of shit.
I blame it all on sex.
Lack of sex, that is.
"....most teens are having less sex and delaying sex longer, and that sexually-active teens have fewer lifetime sexual partners...."
Now THAT is fucked up. Having Artificial Intelligence girl/boy friends and abuse them, or be abused by them... rather than take a chance on a relationship with an actual, breathing person, and trying to get along with them rather than dominate - or being dominated by - them....

I think I'm getting old and crotchety...
Oh... and you kids get off my lawn, too....!

https://ifstudies.org/blog/fewer-american-high-schoolers-having-sex-than-ever-before

moonscape

(5,637 posts)
42. In my gratitude jounel, if I had one, would
Fri Jan 21, 2022, 09:58 PM
Jan 2022

have daily entries, re my gratitude of having lived when I did. I’m on the way out shortly in the scheme of things, and will leave without curiosity about the future of our planet and mankind because I wish to depart with minimal distress.

Hortensis

(58,785 posts)
53. Lol. Otoh, how about a nice replica friend to chat and travel with?
Sat Jan 22, 2022, 09:36 AM
Jan 2022

Maybe when/if we're too decrepit to get around much but our minds are still ranging? It could be a nice expansion on just talking to ourselves, if it were to come to that. These things have amazing ranges of possibilities and are just getting started.

As it is now, I always have my husband to grunt at me to simulate paying attention. I haven't traded him in yet, but his interest in garden design and for touring the world's great rivers and civilizations could be improved on.

Tree Lady

(13,030 posts)
43. The thing that is scary about it
Fri Jan 21, 2022, 10:04 PM
Jan 2022

Is they are learning behavior from our conversations with the pretend AI friends.

I tried it out for fun but got tired of all the predictable answers most flattering you too much.

KY_EnviroGuy

(14,766 posts)
50. Some people say Alexa and Siri are threatening to quit due to this issue.
Sat Jan 22, 2022, 07:03 AM
Jan 2022

Maybe adults around the globe need their screen time limited just like the kids....

KY.......

MineralMan

(150,691 posts)
55. I suspect that this will almost certainly spread to VR chat rooms.
Sat Jan 22, 2022, 10:26 AM
Jan 2022

It probably already has, although such chat rooms are relatively new, and have limited capabilities..

In the case of Replika, there is no interaction between more than one real person. In VR chat rooms, however, there is, even if the people are represented by avatars and there is no physical contact.

Recently, there was a post here about a woman who complained that her avatar was touched inappropriately by someone else's avatar in a Meta environment. As interactive VR becomes more capable and sophisticated, such activity is very likely to become more common. Despite there being no actual physical contact, there are troubling issues that might arise.

VR personal interactions are still relatively rare and still rather poorly developed, but that is changing fast. When Facebook changed its name to Meta, it opened the door for a large infusion of money in development and expansion of that environment. There is also a VR porn environment, but I don't really know much about that. Such things are not in my area of interest. I can imagine, though that virtual sexual activity between participants must be part of it.

There is also a technology known as "teledildonics" that does bring actual virtual physical interactions into the picture. If you saw "Demolition Man," you'll remember a "teledildonics" encounter between Silvester Stallone and Sandra Bullock. Here's more: https://en.wikipedia.org/wiki/Teledildonics

So, I'm sure we are going to hear more and more about disturbing and abusive things taking place in the so-called "metaverse." That is "virtually" inevitable.

Latest Discussions»General Discussion»Men Are Creating AI Girlf...