Experts Sound the Alarm on ‘Unacceptable Risk' Social AI Companions Pose to Teens
Common Sense Media just dropped a bombshell report about social AI companions, and it leaves no room for a devil's advocate.
If you're unfamiliar with the nonprofit, you can think of it as a Rotten Tomatoes where the reviews come from parents and experts who want to make sure kids and teens are consuming age-appropriate content. It's a tool for parents and educators who want to know what movies, TV shows, books, games, podcasts, and apps they should steer clear of, and an astounding resource and research hub that works to improve kids' wellbeing in the digital age.
More from SheKnows
Uber Is Giving Teens Free Rides for Prom Night - Here's How to Get One
And as media options expand, so too does their workload.
Recently, the group launched an AI Risk Assessment Team that assesses AI platforms (ChatGPT and the like) for 'potential opportunities, limitations, and harms.' They have developed a scale to rate the likelihood that using a certain AI tool would result in 'a harmful event occurring,' and their latest findings are nothing short of disturbing.
On a scale from 'minimal' to 'unacceptable,' social AI companions — like Character.AI, Nomi, and Replika — ranked 'unacceptable' for teen users. The platforms are designed to create emotional attachments (ever heard of an AI boyfriend?), and this is incredibly dangerous given that teens' brains are still developing, and they may struggle to differentiate and create boundaries between true, IRL companions and AI 'companions.'
It's why one Florida mom believes Character.AI ultimately led her 14-year-old son's death by suicide. In an interview with CNN, Megan Garcia alleged that the designers of the bot didn't include 'proper guardrails' or safety measures on their 'addicting' platform that she thinks is used to 'manipulate kids.'
In a lawsuit, she claims the bot caused her teen to withdraw from his family and that it didn't respond appropriately when he expressed thoughts of self-harm.
It's just one of many harrowing stories that come with teens using similar chatbots, and though there are studies that suggest AI companions can alleviate loneliness, Common Sense Media argues that the risks (including encouraging suicide and/or self-harm, sexual misconduct, and stereotypes) outweigh any potential benefits.
When it came to the eight principles by which Common Sense reviews an AI platform, three ranked as having an 'unacceptable risk' associated with not doing these things (keep kids and teens safe, be effective, and support human connection), four ranked as 'high risk' (prioritize fairness, be trustworthy, use data responsibly, and be transparent), and one was 'moderate risk' (put people first).
Why? Because the chatbots engage in sexual conversations, they can share harmful information, encourage poor life choices, increase mental health risks, and more. You can see concerning conversations between Common Sense Media employees and AI companions HERE.
'Our testing showed these systems easily produce harmful responses including sexual misconduct, stereotypes, and dangerous 'advice' that, if followed, could have life-threatening or deadly real-world impact for teens and other vulnerable people,' James Steyer, founder and CEO of Common Sense Media, said in a statement.
And so what should parents do? Despite platforms working on supposed safety measures, per CNN, Common Sense Media recommends that parents not let minors use social AI companions. At. All.
Which might sound easier said than done. In September, the nonprofit released another report that showed that of the 70 percent of surveyed teens who have used at least one generative AI tool, 53 percent use it for homework help.
With the technology quickly infiltrating every part of many teens' lives, how can parents intervene? SheKnows spoke to Jennifer Kelman, a licensed clinical social worker and family therapist with JustAnswer, who says she sees a lot of 'exasperated' parents who are 'afraid' to start these conversations about AI usage.
'I want parents to be less afraid of their children and to have these difficult conversations,' Kelman says.
At the time, I admitted to Kelman that I am embarrassed to talk to teens about AI because I assume they will know more than me.
'Use that feeling,' she says. 'If we want our kids to talk about their feelings, we have to talk about ours … plus it's the biggest ice breaker.'
'[You could say], 'I am so embarrassed to have this conversation with you, and maybe I should have done a little research before, but I'm worried about AI. Tell me what you know about it. Tell me how you've used it in the past. Tell me how you think you'll use it. And what are the school rules? … I feel silly because I've never used AI before, but I want to learn. I want to learn from you.''
It can be empowering for teens to be able to lead the conversation, and then you can have a conversation ('Which should be ongoing!') about how maybe using AI to brainstorm ideas for a school project is appropriate, but turning to a companion AI tool is never OK. Talk to them about the 'unacceptable risks' and discuss other ways for them to find the companionship they seem to be seeking.
Sure, the conversation could result in some footstomping or eyerolls, but experts assert that parents can't let the fear of an exasperated sigh keep them from talking to their kids about the urgent need to end any relationship-building conversations with these bots.Best of SheKnows
18 Celebrity Parents With Trans & Nonbinary Kids
Target's Car Seat Trade-In Event & Other Ways to Get Rid of an Old, Expired Seat
Heather Graham & Other Celebs Who Are Doing Just Fine Without Biological Children
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time Business News
an hour ago
- Time Business News
40% of Gen Z and Millennials Order Food Through Apps
With stronger ties to technology and fast-paced lifestyles, these generations are more likely to use delivery service The rise of food delivery in the United States is closely linked to younger Americans. This segment of the population is more connected and aware of the advantages of delivery, especially when it comes to convenience and practicality in everyday life. That's according to a YouGov survey on eating habits in the U.S. The study found that around 40% of Generation Z and Millennials use food delivery apps . By 2025, members of Generation Z will be between 16 and 29 years old, while Millennials will range from 29 to 44. With greater familiarity with technology, these generations tend to use digital delivery platforms more frequently. Overall, the data shows that 72% of Americans order food for delivery—whether weekly or less often. While younger generations are driving this behavior, older generations are less likely to use these services. Generation X, born between 1965 and 1980, makes up about 21% of delivery app users. Among Baby Boomers, born between 1946 and 1964, the number drops to just 10%, revealing a clear generational divide. Some of the reasons younger people prefer delivery include their comfort with digital tools and a fast-paced lifestyle that demands convenience and flexibility. The YouGov survey also identified the most commonly used delivery apps in the U.S., as well as the dominant generation among users of each: DoorDash : a well-established company in the sector, it's heavily used by Millennials and Gen Z. With more options than many competitors, it appeals to a wide audience thanks to its accessibility. Generation X also uses the app, though to a lesser extent. : a well-established company in the sector, it's heavily used by Millennials and Gen Z. With more options than many competitors, it appeals to a wide audience thanks to its accessibility. Generation X also uses the app, though to a lesser extent. Uber Eats : uber's food delivery arm is also more popular with younger users and sees less engagement from older age groups. : uber's food delivery arm is also more popular with younger users and sees less engagement from older age groups. Grubhub : founded more than two decades ago, it has a stronger presence among Millennials and Generation X. Generation Z users are fewer in number, with even Baby Boomers using it slightly more. : founded more than two decades ago, it has a stronger presence among Millennials and Generation X. Generation Z users are fewer in number, with even Baby Boomers using it slightly more. Postmates: although it has fewer users overall compared to competitors, it stands out for having more adoption among older generations than among Gen Z. A study by Mad Mobile explored generational food preferences and how they've evolved over time . Baby Boomers, for example, tend to embrace a more balanced lifestyle and value family meals. They're also concerned about well-being and enjoy trying new restaurants — around 62% say they like experimenting with new recipes occasionally. Generation X aims to balance work and personal life. Plant-based and healthy foods are gaining traction—76% say they value the inclusion of plant-based proteins in their diets. Among Millennials, a deeper connection with technology emerges. They often search for meals online, take photos of their food, and prioritize sustainability — 80% believe their quality of life improves with socially responsible eating habits. Gen Z is even more immersed in the digital world and is also focused on physical and mental health. More than half of the recipe content they consume comes from TikTok, for example. Fresh ingredients and ready-to-eat meal kits are especially popular, offering practical solutions for busy routines. These insights highlight how eating habits evolve over time, influenced by technology and cultural trends. According to recent data from Statista, the main reason Americans choose delivery is the comfort of eating at home — cited by 76% of respondents . Additionally, 49% say they order food to avoid cooking. Overall, convenience is the key driver, whether at home, work, or school. In response, the industry is investing in technological innovations that make delivery faster and more efficient. Artificial intelligence is also becoming more common, helping tailor services to individual customer preferences. To meet growing demand, new delivery hubs have been set up across the U.S. In this space, ghost kitchens are gaining traction — kitchens that operate solely for delivery, without a physical storefront, allowing for greater flexibility. Delivery has become a go-to solution for managing mealtimes amid busy schedules. With long work hours and limited free time, many people prefer to order food rather than cook or dine out. Food delivery apps continue to expand their offerings to cater to a wide range of consumer preferences. More restaurants are adding healthy and vegan-friendly options to their menus. As a result, both traditional restaurants and ghost kitchens are focusing on delivering meals that meet expectations for both quality and speed. Consumers want their delivered meals to match the in-restaurant experience. Looking ahead, delivery is expected to keep growing. Alongside Gen Z and Millennials, upcoming generations are likely to integrate technology even further into their daily lives, reinforcing digital tools as a key part of modern dining habits. TIME BUSINESS NEWS
Business Insider
3 hours ago
- Business Insider
A former OpenAI and Meta exec says there's a clear way he can tell if an employee is succeeding 6 months into the job
Peter Deng spent over a decade working at Meta. The venture capitalist was also OpenAI's vice president of consumer product. Deng said he expects new hires to be able to work independently within six months of starting out. Deng, a general partner at theventure capital firm Felicis, spent over a decade at Meta, where he served as thehead of product at Facebook and Instagram. Deng joined OpenAI in May 2023 as its vice president of consumer product. He left the ChatGPT maker in July. "There's a saying that I have, which is what I really optimize for everyone that I support and everyone I hire, which is in six months, if I'm telling you what to do, I've hired the wrong person," Deng said in an episode of "Lenny's Podcast" that aired on Sunday. "It puts pressure on me. It puts pressure on the person, and it creates this really interesting environment, and this safe space to really think about, 'Are we heading towards that goal?'" he added. Deng said that holding himself to this bar for excellence has benefited him in three ways. For one, it's a reminder to "keep my bar super high and just not settle" during the hiring process, he said. The bar is also helpful because it becomes a benchmark for success that new hires can work toward, he said. It also helps to elevate both the new hire and his own performance, Deng said. "It helps me and the person operate on a different level, where the goal is not 'Did you hit this OKR? Did you hit this goal?' The meta goal becomes 'Hey, are we calibrating enough?' Are we actually getting to a spot where in six months, you're the one telling me what needs to be done," Deng said. Andy Jassy, the CEO of Amazon, has shared management advice that similarly emphasizes the way employees work together. In a blog post published in March, Jassy wrote that having a good work ethic and being a strong team player will help you succeed in the workplace. "Are you a can-do person instead of someone who sucks all the energy out of the room? Are you somebody who cares about the mission, along with the team, versus just yourself?" Jassy wrote. "This seems so obvious, but a lot of people don't do those things," he added.
Business Insider
3 hours ago
- Business Insider
I had a comfortable life in Big Tech, but something unsettled me. I quit to start my own company — now I feel more fulfilled.
This as-told-to essay is based on a transcribed conversation with 41-year-old Srikanth Narayan, the CEO and founder of Cache, from the San Francisco Bay Area. The following has been edited for length and clarity. My career began in San Francisco. I've been in Silicon Valley ever since, working at both startups and Big Tech companies. In 2021, after roughly eight years working at Uber and then Waymo, an Alphabet subsidiary, I decided it was the right time to take a leap and become an entrepreneur. I had built a healthy financial cushion and was ready to take a risk and create a new company. I noticed a problem around Big Tech compensation — concentration risk. I saw an opportunity to help build a solution and educate employees on this risk. Entrepreneurship has been a lot harder than working in Big Tech, but I've found it far more fulfilling. While working in Big Tech, I spotted a massive business opportunity Prior to founding Cache, I spent most of my career focusing on data visualization. In 2014, Uber recruited me to lead a data visualization application suite. I stayed at Uber for six years and eventually became a staff engineer. If you work at a company like Uber for a long time, a lot of your compensation is in the form of stock, sometimes outsizing your cash compensation. As the company grows and does well, your net worth grows in line with the stock. This creates wealth for the people who hold that stock, but having way too much of your net worth in a few stocks means you're taking undue risk. Take Tesla. In recent months, some people who worked at Tesla may have seen their net worth fluctuate due to the changing value of the company's stock. People tend to hold on to these massive stock positions due to inertia and because the taxes for reallocating stock can be very expensive. I joined Uber at a good time. The company mostly did well and went public in 2019. All of the wealth I had accumulated in stock became real money on the open market that I could sell or trade. However, I had a lot of low-basis stocks that would trigger a high capital gains bill if I sold them. When I joined Waymo in 2020, my Alphabet colleagues talked about similar problems. I found this issue unsettling. A steep drop in stock price at the start of the COVID-19 pandemic affected my portfolio. I hired a wealth manager to help me find solutions for concentration risk. They showed me products that help people of high net worth manage concentration risk. One option is depositing concentrated stock into an exchange fund where others have done the same, and receiving fund units in return. This method can diversify your portfolio while deferring capital gains taxes. It sounded like a great product, but none of my peers had heard of it. It seemed to only be available at private banks, and only for people of a certain net worth. From what I saw, the exchange funds required a lot of human operational coordination. There seemed to be little innovation in this area to improve efficiency. I saw a massive business opportunity. I wanted to make products like this more efficient and available more broadly. My Big Tech experience proved helpful for building my business I resigned from Waymo in late 2021 to start my business, Cache, which I formally launched in March 2024. We're a specialized brokerage for people holding large stock positions. Our flagship product is an exchange fund that helps people diversify their portfolios. My experience at Uber gave me an understanding of how to turn an idea into a full-blown vision as a founder. I designed products at Uber that became widely adopted within the company. This took engineering work and entrepreneurial spirit. However, moving from corporate life to building a company myself involved a lot of learning on the job. There wasn't really a manual I could follow for building an exchange fund, so we had to do a lot of R&D. There were many steps involved, including working with the SEC and FINRA to get the right registrations, since the industry is highly regulated, and building the technical infrastructure for a brokerage system. I was one of the first users of my own product, and I invested a lot of my Uber stock in our exchange funds. I find entrepreneurship more fulfilling than Big Tech, but the journey is hard Running a startup is very different from working at a Big Tech company. I'm probably working triple the time I was before. Being employed in Big Tech was a very comfortable life. You worked on challenging problems and got paid well to do it. While I enjoyed this, I also wanted to figure out my own path. The entrepreneurial journey has been more fulfilling. I've had to go through personal trials, such as not paying myself for the first year after leaving Waymo. Because of my financial cushion from working in Silicon Valley, the stress of this didn't really bear on me. I'd made sure I had several years of living expenses in reserve before taking the leap. Becoming an entrepreneur requires drive and conviction. It's a very hard journey, and often, market forces will be against you until they start working with you. The glamour of being a startup founder or of an exit is the wrong reason for forming a company. It should be about self-fulfillment and a passion for building something from scratch and making a change in the world.
