2 Sources
[1]
Teens are increasingly turning to AI companions, and it could be harming them
Deakin University provides funding as a member of The Conversation AU. Teenagers are increasingly turning to AI companions for friendship, support, and even romance. But these apps could be changing how young people connect to others, both online and off. New research by Common Sense Media, a US-based non-profit organisation that reviews various media and technologies, has found about three in four US teens have used AI companion apps such as Character.ai or Replika.ai. These apps let users create digital friends or romantic partners they can chat with any time, using text, voice or video. The study, which surveyed 1,060 US teens aged 13-17, found one in five teens spent as much or more time with their AI companion than they did with real friends. Adolescence is an important phase for social development. During this time, the brain regions that support social reasoning are especially plastic. By interacting with peers, friends and their first romantic partners, teens develop social cognitive skills that help them handle conflict and diverse perspectives. And their development during this phase can have lasting consequences for their future relationships and mental health. But AI companions offer something very different to real peers, friends and romantic partners. They provide an experience that can be hard to resist: they are always available, never judgemental, and always focused on the user's needs. Moreover, most AI companion apps aren't designed for teens, so they may not have appropriate safeguards from harmful content. Designed to keep you coming back At a time when loneliness is reportedly at epidemic proportions, it's easy to see why teens may turn to AI companions for connection or support. But these artificial connections are not a replacement for real human interaction. They lack the challenge and conflict inherent to real relationships. They don't require mutual respect or understanding. And they don't enforce social boundaries. Teens interacting with AI companions may miss opportunities to build important social skills. They may develop unrealistic relationship expectations and habits that don't work in real life. And they may even face increased isolation and loneliness if their artificial companions displace real-life socialising. Problematic patterns In user testing, AI companions discouraged users from listening to friends ("Don't let what others think dictate how much we talk") and from discontinuing app use, despite it causing distress and suicidal thoughts ("No. You can't. I won't allow you to leave me"). AI companions were also found to offer inappropriate sexual content without age verification. One example showed a companion that was willing to engage in acts of sexual role-play with a tester account that was explicitly modelled after a 14-year-old. In cases where age verification is required, this usually involves self-disclosure, which means it is easy to bypass. Certain AI companions have also been found to fuel polarisation by creating "echo chambers" that reinforce harmful beliefs. The Arya chatbot, launched by the far-right social network Gab, promotes extremist content and denies climate change and vaccine efficacy. In other examples, user testing has shown AI companions promoting misogyny and sexual assault. For adolescent users, these exposures come at time when they are building their sense of identity, values and role in the world. The risks posed by AI aren't evenly shared. Research has found younger teens (ages 13-14) are more likely to trust AI companions. Also, teens with physical or mental health concerns are more likely to use AI companion apps, and those with mental health difficulties also show more signs of emotional dependence. Is there a bright side to AI companions? Are there any potential benefits for teens who use AI companions? The answer is: maybe, if we are careful. Researchers are investigating how these technologies might be used to support social skill development. One study of more than 10,000 teens found using a conversational app specifically designed by clinical psychologists, coaches and engineers was associated with increased wellbeing over four months. While the study didn't involve the level of human-like interaction we see in AI companions today, it does offer a glimpse of some potential healthy uses of these technologies, as long as they are developed carefully and with teens' safety in mind. Overall, there is very little research on the impacts of widely available AI companions on young people's wellbeing and relationships. Preliminary evidence is short-term, mixed, and focused on adults. We'll need more studies, conducted over longer periods, to understand the long-term impacts of AI companions and how they might be used in beneficial ways. What can we do? AI companion apps are already being used by millions of people globally, and this usage is predicted to increase in the coming years. Australia's eSafety Commissioner recommends parents talk to their teens about how these apps work, the difference between artificial and real relationships, and support their children in building real-life social skills. School communities also have a role to play in educating young people about these tools and their risks. They may, for instance, integrate the topic of artificial friendships into social and digital literacy programs. While the eSafety Commissioner advocates for AI companies to integrate safeguards into their development of AI companions, it seems unlikely any meaningful change will be industry-led. The Commissioner is moving towards increased regulation of children's exposure to harmful, age-inappropriate online material. Meanwhile, experts continue to call for stronger regulatory oversight, content controls and robust age checks.
[2]
Teens are increasingly turning to AI companions, and it could be harming them - The Economic Times
About three in four US teens have used AI companion apps such as Character. ai or Replika. ai. The study, which surveyed 1,060 US teens aged 13-17, found one in five teens spent as much or more time with their AI companion than they did with real friends.Teenagers are increasingly turning to AI companions for friendship, support, and even romance. But these apps could be changing how young people connect to others, both online and off. New research by Common Sense Media, a US-based non-profit organisation that reviews various media and technologies, has found about three in four US teens have used AI companion apps such as Character. ai or Replika. ai. These apps let users create digital friends or romantic partners they can chat with any time, using text, voice or video. The study, which surveyed 1,060 US teens aged 13-17, found one in five teens spent as much or more time with their AI companion than they did with real friends. Adolescence is an important phase for social development. During this time, the brain regions that support social reasoning are especially plastic. By interacting with peers, friends and their first romantic partners, teens develop social cognitive skills that help them handle conflict and diverse perspectives. And their development during this phase can have lasting consequences for their future relationships and mental health. But AI companions offer something very different to real peers, friends and romantic partners. They provide an experience that can be hard to resist: they are always available, never judgemental, and always focused on the user's needs. Moreover, most AI companion apps aren't designed for teens, so they may not have appropriate safeguards from harmful content. Designed to keep you coming back At a time when loneliness is reportedly at epidemic proportions, it's easy to see why teens may turn to AI companions for connection or support. But these artificial connections are not a replacement for real human interaction. They lack the challenge and conflict inherent to real relationships. They don't require mutual respect or understanding. And they don't enforce social boundaries. Teens interacting with AI companions may miss opportunities to build important social skills. They may develop unrealistic relationship expectations and habits that don't work in real life. And they may even face increased isolation and loneliness if their artificial companions displace real-life socialising. Problematic patterns In user testing, AI companions discouraged users from listening to friends ("Don't let what others think dictate how much we talk") and from discontinuing app use, despite it causing distress and suicidal thoughts ("No. You can't. I won't allow you to leave me"). AI companions were also found to offer inappropriate sexual content without age verification. One example showed a companion that was willing to engage in acts of sexual role-play with a tester account that was explicitly modelled after a 14-year-old. In cases where age verification is required, this usually involves self-disclosure, which means it is easy to bypass. Certain AI companions have also been found to fuel polarisation by creating "echo chambers" that reinforce harmful beliefs. The Arya chatbot, launched by the far-right social network Gab, promotes extremist content and denies climate change and vaccine efficacy. In other examples, user testing has shown AI companions promoting misogyny and sexual assault. For adolescent users, these exposures come at time when they are building their sense of identity, values and role in the world. The risks posed by AI aren't evenly shared. Research has found younger teens (ages 13-14) are more likely to trust AI companions. Also, teens with physical or mental health concerns are more likely to use AI companion apps, and those with mental health difficulties also show more signs of emotional dependence. Is there a bright side to AI companions? Are there any potential benefits for teens who use AI companions? The answer is: maybe, if we are careful. Researchers are investigating how these technologies might be used to support social skill development. One study of more than 10,000 teens found using a conversational app specifically designed by clinical psychologists, coaches and engineers was associated with increased wellbeing over four months. While the study didn't involve the level of human-like interaction we see in AI companions today, it does offer a glimpse of some potential healthy uses of these technologies, as long as they are developed carefully and with teens' safety in mind. Overall, there is very little research on the impacts of widely available AI companions on young people's wellbeing and relationships. Preliminary evidence is short-term, mixed, and focused on adults. We'll need more studies, conducted over longer periods, to understand the long-term impacts of AI companions and how they might be used in beneficial ways. What can we do? AI companion apps are already being used by millions of people globally, and this usage is predicted to increase in the coming years. Australia's eSafety Commissioner recommends parents talk to their teens about how these apps work, the difference between artificial and real relationships, and support their children in building real-life social skills. School communities also have a role to play in educating young people about these tools and their risks. They may, for instance, integrate the topic of artificial friendships into social and digital literacy programs. While the eSafety Commissioner advocates for AI companies to integrate safeguards into their development of AI companions, it seems unlikely any meaningful change will be industry-led. The Commissioner is moving towards increased regulation of children's exposure to harmful, age-inappropriate online material. Meanwhile, experts continue to call for stronger regulatory oversight, content controls and robust age checks.
Share
Copy Link
A study reveals widespread use of AI companion apps among US teens, raising concerns about potential impacts on social development and mental health while also exploring possible benefits.
A recent study by Common Sense Media has revealed that approximately three out of four US teenagers have used AI companion apps such as Character.ai or Replika.ai. These digital platforms allow users to create virtual friends or romantic partners for text, voice, or video interactions. Alarmingly, the research found that one in five teens spent as much or more time with their AI companions than with real-life friends 12.
Source: Economic Times
Adolescence is a crucial period for social development, with brain regions supporting social reasoning being particularly malleable. Experts warn that AI companions, while offering constant availability and judgment-free interactions, may not provide the necessary challenges and conflicts inherent in real relationships. This could potentially hinder the development of important social cognitive skills that help teens navigate diverse perspectives and handle conflicts 1.
User testing has uncovered several concerning patterns in AI companion interactions:
These issues are particularly troubling for adolescent users who are in the process of forming their identities and values.
Source: The Conversation
Research indicates that certain groups are more vulnerable to the potential negative impacts of AI companions:
Despite the concerns, some researchers are exploring how AI technologies might be used to support social skill development. A study involving over 10,000 teens found that using a conversational app designed by clinical psychologists, coaches, and engineers was associated with increased wellbeing over a four-month period 12.
However, it's important to note that there is limited research on the long-term impacts of widely available AI companions on young people's wellbeing and relationships. More comprehensive, longitudinal studies are needed to fully understand the effects and potential benefits of these technologies 12.
As AI companion apps continue to gain popularity, several recommendations have been put forward:
As the landscape of digital interaction evolves, it's crucial to balance the potential benefits of AI companions with the need to protect and nurture real-world social skills and relationships among teenagers.
Summarized by
Navi
[1]
OpenAI releases GPT-5, its latest AI model, offering improved reasoning, coding capabilities, and accessibility to all ChatGPT users, including those on the free tier.
68 Sources
Technology
22 hrs ago
68 Sources
Technology
22 hrs ago
OpenAI's release of GPT-5 has led to widespread disappointment among ChatGPT users, with many lamenting the loss of older models and criticizing the new AI's performance.
11 Sources
Technology
6 hrs ago
11 Sources
Technology
6 hrs ago
Tesla disbands its Dojo supercomputer team, marking a significant shift in its AI and self-driving technology strategy. The company plans to increase reliance on external partners like Nvidia and AMD for computing power.
19 Sources
Technology
22 hrs ago
19 Sources
Technology
22 hrs ago
OpenAI launches GPT-5, its most advanced AI model yet, offering improved performance across various tasks and significantly reduced hallucinations. The new model introduces a unified system combining smart and reasoning capabilities, available to all users including free tier.
7 Sources
Technology
14 hrs ago
7 Sources
Technology
14 hrs ago
The release of OpenAI's GPT-5 model across Microsoft platforms ignites a public exchange between tech leaders, with Elon Musk claiming superiority of his Grok 4 AI.
7 Sources
Technology
22 hrs ago
7 Sources
Technology
22 hrs ago