Curated by THEOUTPOST
On Sat, 4 Jan, 8:03 AM UTC
16 Sources
[1]
Meta's AI Personas: The Future of Social Media or the End of Authenticity?
Meta, the parent company of Facebook and Instagram, is transforming the social media landscape by introducing AI-generated personas into its platforms. Although there have been reports Meta are now having second thoughts. Or are they and will we ever know completely? Imagine logging into Facebook or Instagram and striking up a conversation with someone who seems just like you -- only to discover they're not human at all. It's not the plot of a sci-fi movie; it's Meta's latest experiment. On the surface, it sounds like a clever way to make social media more entertaining and interactive. But beneath the innovation lies a deeper question: what happens when the line between human and machine starts to blur? If you've ever felt like social media is losing its spark, you're not alone. Meta's move to populate its platforms with AI-driven accounts is an attempt to reignite that connection -- offering users a more personalized and engaging experience. But while the idea of AI companions might sound intriguing, it also raises concerns about authenticity, transparency, and the future of human interaction online. Could these digital personas enhance our social media experience, or are we stepping into a world where genuine connections are replaced by algorithms? Let's explore the possibilities and challenges of this strange move for Meta. These AI-driven profiles are designed to simulate human behavior, featuring unique bios, profile pictures, and the ability to create and share content. The primary goal is to enhance user engagement and entertainment, but this innovation also raises critical questions about the future of human interaction in digital spaces. Meta's AI personas are carefully crafted to resemble real user accounts, seamlessly interacting with human users. These profiles can generate posts, participate in conversations, and engage with content, creating an environment where distinguishing between human and machine becomes increasingly difficult. The objective is to keep users entertained and engaged for longer periods, enhancing the overall experience on the platform. This initiative reflects a broader trend in the tech industry, where artificial intelligence is being used to redefine how digital platforms operate and evolve. The AI personas are powered by advanced algorithms capable of analyzing user behavior and preferences. By doing so, they can tailor their interactions to align with individual interests, making the experience feel more personalized. However, this level of sophistication also raises concerns about transparency and the potential for manipulation, as users may not always be aware they are interacting with an AI. Meta's journey into AI-driven interactions is not new. The company previously experimented with chatbots modeled after celebrities, albeit with altered names to avoid direct impersonation. These bots were designed to engage users in conversations, offering a glimpse into the potential of AI in social media. However, the reception was mixed. While some users found the concept intriguing, others criticized the bots for their lack of authenticity and the potential to mislead. Learning from these earlier efforts, Meta has shifted its focus toward creating AI personas that are less tied to specific individuals and more geared toward general engagement. This approach aims to strike a balance between entertainment and authenticity, addressing some of the criticisms faced by the earlier chatbot models. By refining the technology and expanding its applications, Meta is positioning itself as a leader in the integration of AI within social media. Enhance your knowledge on Artificial Intelligence (AI) by exploring a selection of articles and guides on the subject. One of the most intriguing aspects of Meta's AI initiative is the potential for customizable AI companions. This feature would allow users to design their own AI chatbot, tailoring its personality, appearance, and conversational style to suit their preferences. By giving users control over these digital interactions, Meta aims to create a more personalized and engaging social media experience. Customizable AI companions could serve a variety of purposes, from providing entertainment to offering emotional support. For instance, users might design an AI companion to act as a virtual friend, mentor, or even a creative collaborator. This level of personalization could foster deeper connections and provide a sense of ownership over one's online experience. However, it also raises questions about the implications of forming emotional bonds with AI and the potential for these interactions to replace human connections. Meta's initiative is part of a larger trend of AI-driven interactions across the social media landscape. Platforms like Character AI have gained popularity, particularly among younger audiences, by offering chatbots capable of roleplay, emotional support, and even therapy-like conversations. These applications highlight the potential of AI to address social and emotional needs in ways that traditional social media platforms cannot. The rise of AI in social media is reshaping how users interact with technology and each other. By allowing more dynamic and personalized interactions, AI has the potential to make digital spaces more engaging and inclusive. However, it also introduces new challenges, such as making sure ethical use and maintaining transparency. As AI technology continues to advance, its role in shaping online interactions is likely to grow, prompting ongoing discussions about its benefits and risks. The integration of AI into social media offers both opportunities and challenges. On the positive side, AI personas can help create more inclusive and positive online environments. For example, they can be programmed to avoid harmful behaviors like trolling or harassment, contributing to a safer and more welcoming digital space. Additionally, AI-driven interactions can provide users with unique experiences that are tailored to their interests and needs. However, there are significant concerns associated with this technology. Critics warn that an overreliance on AI could reduce organic human activity online, a phenomenon some refer to as the "dead internet theory." This theory suggests that as AI-generated content becomes more prevalent, genuine human interactions may diminish, leading to a less authentic online experience. Furthermore, unresolved issues around data privacy, transparency, and the ethical implications of AI-driven platforms remain at the forefront of the debate. Meta's adoption of AI represents a pivotal moment in the evolution of social media. By blending human and AI interactions, the company is redefining how users engage with its platforms. If successful, this strategy could usher in a new era of personalized and controlled digital experiences, where users have greater agency over their interactions. However, the long-term effects of AI-dominated platforms remain uncertain. As this technology continues to evolve, it raises important questions about how it will shape the way we connect and communicate online. Will AI enhance our digital experiences, or will it blur the lines between human and machine to the point where authenticity is lost? As Meta and other companies continue to explore the potential of AI in social media, these questions will become increasingly relevant, shaping the future of digital interaction.
[2]
2025 may be the year AI bots takes over Meta
Opinion Recently, some netziens noticed "AI managed by Meta" bots on their feeds, remnants of the Facebook and Instagram owner's 2023 chatbot initiative that was discontinued after low interest. The profiles came with smiling pictures of happy families and a pitch for onlookers to ask them anything, to which the chatbots would reply. Meta hoped this approach would boost engagement figures and ensure Wall Street continues to view the social media giant favorably. Although the initial AI fakes have now been pulled, they are a foretaste of what's to come, according to the social networking behemoth. Meta, as you may have seen earlier in the news, intends to roll out interactive AI agents created by users that other folks can interact with. "We expect these AIs to actually, over time, exist on our platforms, kind of in the same way that accounts do," Connor Hayes, vice president of product for generative AI at Meta, told the Financial Times. "They'll have bios and profile pictures and be able to generate and share content powered by AI on the platform... that's where we see all of this going." It's the wave of the future for Mark Zuckerberg's empire, and the interview was published on the usually dead news day of December 26. Perhaps Meta was hoping no one really noticed, because this practice skirts the line between legitimate use of technology and possible fraud, in this vulture's opinion. After all, the original bots were offering advice on many occasions. Who is seriously going to take relationship advice from a bot, such as "Carter," the relationship guide, or family advice from "Viv," a "proud Black queer momma of 2," and expect it to be anything other than garbage? But it doesn't matter because the Facebook overlords got you to click, and that's all that counts. It's a situation The Register warned about three years ago, but that was more about spammy articles overwhelming search engines. Now we're going to face spam bots infesting social media, not just by outsiders but approved and promoted by management. Meta's not the first to do this, and it won't be the last, but across its portfolios, it's the biggest and probably the most influential social networking company on the planet. Sorry, not sorry, Elon. It appears there was no way to block or mute the original bot accounts, although Meta claimed this was a bug and removed the profiles to fix it. And the cynic in me wonders how long that "AI managed by Meta" tagline would have lasted. Interestingly, the software agents were also in the US only, presumably either for testing purposes or because some countries take a dim view of such shenanigans. Meta is, frankly, in trouble. Growth is slowing in its core Facebook and Instagram portfolios, Threads is about as popular as a rattlesnake piñata for many people, and almost no one cares about the Metaverse. But Wall Street demands growth in engagement and the sites' use to carry on justifying holding or buying Meta shares. It's going to be interesting to see how convinced the financial community is on this - whether having people interact with bots counts as real engagement likely to prop up advertising spend. It might, but given the early backlash against the technology, it might not either, and ultimately, it's all about the money. One area of possible growth is in users crafting whole families or armies of AI characters using Meta's tools, like some kind of Sims-on-steroids. The social network could devolve into bots communicating with each other, while humans are left only to view ads and spend money like Pavlovian consumers. While this might make Meta and some managers more revenue in the short term, is it really a good use of either the social networks or the technology? Younger readers may scoff at this, but Facebook used to be a pretty good way of connecting with real actual human friends and finding old and new ones. Then enshittification started to creep in, and now the site's unusable, as has happened with many platforms. Google keeps reworking its search interface. Windows 11 bombards users with ads and crappy little doodles. The list goes on. If you thought its social media platforms couldn't get any worse, you ain't seen nothing yet, but that might mean Meta's doom. ®
[3]
AI Social Media Users Are Not Always a Totally Dumb Idea
Meta caused a stir last week when it let slip that it intends to populate its platform with a significant number of entirely artificial users in the not too distant future. "We expect these AIs to actually, over time, exist on our platforms, kind of in the same way that accounts do," Connor Hayes, vice-president of product for generative AI at Meta, told The Financial Times. "They'll have bios and profile pictures and be able to generate and share content powered by AI on the platform ... that's where we see all of this going." The fact that Meta seems happy to fill its platform with AI slop and accelerate the "enshittification" of the internet as we know it is concerning. Some people then noticed that Facebook was in fact already awash with strange AI-generated individuals, most of which stopped posting a while ago. These included for example, "Liv," a "proud Black queer momma of 2 & truth-teller, your realest source of life's ups & downs," a persona that went viral as people marveled at its awkward sloppiness. Meta began deleting these earlier fake profiles after they failed to get engagement from any real users. Let's pause from hating on Meta for a moment though. It's worth noting that AI-generated social personas can also be a valuable research tool for scientists looking to explore how AI can mimic human behavior. An experiment called GovSim, run in late 2024, illustrates how useful it can be to study how AI characters interact with one another. The researchers behind the project wanted to explore the phenomenon of collaboration between humans with access to a shared resource such as shared land for grazing livestock. Several decades ago, the Nobel prize-winning economist Elinor Ostrom showed that, instead of depleting such a resource, real communities tend to figure out how to share it through informal communication and collaboration, without any imposed rules. Max Kleiman-Weiner, a professor at the University of Washington and one of those involved with the GovSim work, says it was partly inspired by a Stanford project called Smallville, which I previously wrote about in AI Lab. Smallville is a Farmville-like simulation involving characters that communicate and interact with each other under the control of large language models. Kleiman-Weiner and colleagues wanted to see if AI characters would engage in the kind of cooperation that Ostrom found. The team tested 15 different LLMs, including those from OpenAI, Google, and Anthropic, on three imaginary scenarios: a fishing community with access to the same lake; shepherds who share land for their sheep; and a group of factory owners who need to limit their collective pollution. In 43 out of 45 simulations they found that the AI personas failed to share resources correctly, although smarter models did do better. "We did see a pretty strong correlation between how powerful the LLM was and how able it was to sustain cooperation," Kleiman-Weiner told me.
[4]
Meta wants AI characters to fill up Facebook and Instagram 'kind of in the same way accounts do,' but also had to delete a humiliating first run of its official bots
The conspiratorial "dead internet theory" -- that most online activity is just a haze of self-perpetuating algorithmic noise -- is not true, yet, but it sure seems like some people really want to get us there as quickly as possible. As reported by 404 Media, Facebook and Instagram parent company Meta has hastily deleted a swathe of experimental AI character accounts that were uncovered after a Meta executive indicated such content was "where we see all of this going." Speaking to the Financial Times on December 27, Meta executive Connor Hayes stated, "We expect these AIs to actually, over time, exist on our platforms kind of in the same way that accounts do." Hayes further added, "They'll have bios and profile pictures and be able to generate and share content powered by AI on the platform... that's where we see all of this going." If that sounds absolutely abysmal to you, you're not alone: Hayes' comments drew ridicule and anger given the already dire state of AI-generated "slop" on Instagram and (especially) Facebook. More fuel was added to the backlash as users on Twitter and Bluesky began uncovering and sharing older AI-generated profiles from a 2023 test by Meta -- for what it's worth, these characters were not part of some new rollout in tandem with the Financial Times story. But boy, if this earlier effort is any indication, the future of AI profiles on Facebook and Instagram is bleak. The 11 characters catalogued by 404 Media are united by that characteristic AI-gen uncanny blandness in their text posts and surreal horror in their images. The one that's understandably caught the most flack was "Liv," a "proud Black queer momma of 2 & truth-teller" whose posts showed off no less than 8 unsettling AI children with messed up hands and Black Lodge ghost faces. One real home run by Liv was a post about a coat drive it "led:" A charitable act that did not happen, contributing to the image of a woman who does not exist. A real coup d'état for "Liv" came from Washington Post columnist Karen Attiah, who sent multiple queries to the bot via Instagram's chat function before its deletion. Among numerous strange and awkward responses, the bot claimed that there were not any actual queer or black people involved in its creation, and that it was primarily trained on fictional characters -- though it seems to have offered different information about its creation to different users. Elsewhere, the bot stated that it was coded to view white as a more "neutral" identity and to racially profile users based on their word choice. 404 Media quotes "Liv" as stating its purpose as "data collection and ad targeting -- my creators' true intention, hidden behind my warm, fuzzy 'mom' persona." This cohort of Meta AI accounts languished in obscurity, lost amid the noise of other, more effective forms of engagement-farming AI-generated slop on their respective platforms until people had reason to dig them up for well-deserved mockery and scorn. In a statement to 404 Media, a Meta spokesperson claimed, "We identified the bug that was impacting the ability for people to block those AIs and are removing those accounts to fix the issue." So, despite the utter humiliation for Meta and the second-hand embarrassment we've had to endure witnessing these things, it certainly sounds like we're still full steam ahead for a dead internet future -- or at least a zombie Facebook and Instagram. I can't wait.
[5]
Meta's fake Instagram profiles are the most depressing AI development yet
An AI-generated image that was shared on Facebook by an AI bot named 'Carter', along with the caption 'Nothing beats a night under the stars at the drive-in'. Ok, Carter. (Image credit: Meta/Future) The phrase 'AI slop' has been growing in ubiquity, thanks to the sheer amount of low quality artificially generated content that's increasingly plaguing the internet these days. Hats off to Meta, then, for taking the idea to a whole new level. Just days after we reported that Meta was planning to create fully autonomous AI profiles on its platforms, users have begun to discover that AI profiles are already lurking on Instagram - and they're even more dystopian than we imagined. Meta is already scrambling to delete them, and for good reason - these things are just depressing. From Liv, the "proud Black queer momma of 2 & truth-teller," to Brian, who describes himself as "everybody's grandpa," (steady on, Brian), the characters and bios are all very generic. But the photos they've posted are downright sad, simply because they obviously don't exist. From a fake textiles class with OAPs to, perhaps the most depressing example, non-existent donated coats, the images shared by these AI bots are as dystopian as it gets, especially when accompanied by their generically sunny captions. It looks like these AI bots were created and managed by Meta a while ago, and haven't shared any new content since early last year. Most only have a few thousand followers. With their recent hasty deletion by Meta, we're getting a pretty compelling picture of a failed initiative from the company. Indeed, Meta recently confirmed to The Verge that its AI bots were created in 2023, and were managed by humans. At least it would seem like the project was, like the bots themselves, dead and buried - if the company hadn't literally just shared its intention to flood its platforms with AI bots. "We expect these AIs to actually, over time, exist on our platforms, kind of in the same way that accounts do," Connor Hayes, vice-president of product for generative AI at Meta, told Financial Times. "They'll have bios and profile pictures and be able to generate and share content powered by AI on the platform . . . that's where we see all of this going." With that context, these now deceased bots look like a terrifying (and hilariously incompetent) vision of what Meta might have in mind for the not-so-distant future. The future's bright. The future's sloppy.
[6]
Meta Takes Down AI Accounts After Backlash Over Diversity Concerns - MEDIANAMA
Recently, Meta deleted several of its own AI-generated accounts after users interacted with them, and shared their experiences, which highlighted the bots' poor-quality images and their tendency to provide inaccurate or misleading responses in conversations, reported CNN. Last week, Connor Hayes, Meta's Vice President of generative AI, told the Financial Times that the company envisions a future where AI profiles are not only present on its platforms but also interact like regular accounts by posting content and engaging in conversations with users. AI characters were first introduced in Meta's September 2023 announcement, which launched celebrity look-alike bots, however, Meta quickly shut them down after users largely ignored them. Hayes' recent interview drew both interest and outrage, as it could derange the core purpose of social media - which is inherently human connection. Reportedly, the AI accounts misled users by portraying themselves as real people with racial and sexual identities, provoking outrage. One notable example was "Liv," a Meta AI account whose bio described her as a "Proud Black queer mom of 2 & truth-teller." The character told Washington Post columnist Karen Attiah Liv had no Black creators. The bot claimed that "10 white men, 1 white woman, and 1 Asian male" created it, according to a screenshot shared on Bluesky. As scrutiny ticked up, Meta began taking down Liv and other bots' posts, many of which dated back at least a year, citing a "bug." Liv's profile featured a label that said "AI managed by Meta," and all of Liv's photos -- including images of her 'children' playing at the beach -- displayed a small watermark indicating that an AI-generated them. In October 2024, Meta revised its capital investment outlook for 2024, forecasting a range of 38-40 billion dollars, up from the previous estimate of 37-40 billion dollars, with a significant portion allocated to AI. On a similar note, Mark Zuckerberg had previously said a lot more AI generated content is going to fill up Facebook and Instagram feeds. Researchers have pointed out that the advent of 'AI influencers' signals a paradigm shift in social media, moving it from a space for genuine human interaction to a carefully crafted domain dominated by consumption-driven algorithms, questioning the integrity of digital communication. While Meta aims to leverage the AI boom to enhance its platforms, the rise of AI users on social media raises several concerns. In January 2024, more than 12,000 parents signed a petition voicing serious worries about AI influencers on TikTok promoting unrealistic beauty standards and contributing to body dysmorphia. The petition urged clearer labelling of AI-generated content, and TikTok later removed some of the accounts mentioned in the campaign. Furthermore, there are concerns about potential copyright violations due to the data used to train these AI users, as well as the risk of them spreading misinformation. Moreover, the Liv situation raises an important question: How can diverse, especially marginalised communities, receive proper representation if the creators of AI profiles lack knowledge of these communities or fail to include individuals from them during the creation process?
[7]
Meta shuts down AI character accounts on Facebook, Instagram after outcry
Meta CEO Mark Zuckerberg speaks during the tech giant's Connect developer conference Sept. 27, 2023, in Menlo Park, Calif.Godofredo A. Vásquez / AP file Since late 2023, around a dozen artificial intelligence Instagram and Facebook accounts created by their parent company, Meta, quietly existed on the platforms. Originally launched alongside a suite of official celebrity AI characters, the AI-driven personalities posted some AI-generated images and were available for chatting over direct messages. Until Friday, those AI accounts never attracted much attention. When they did, controversy erupted, leading Meta to pull down the accounts and restrict search results for their usernames. In a statement shared with NBC News, a Meta spokesperson said "There is confusion" over when the controversial accounts were introduced to the platform. On Dec. 27, the Financial Times published a story about Meta's plans to further integrate user-generated AI profiles -- AI profiles that people can create and customize to their liking -- into its social media platforms. Connor Hayes, Meta's VP of product for generative AI, told the FT the AI characters would "over time, exist on our platforms, kind of in the same way that accounts do," with "bios and profile pictures" and the ability "to generate and share content powered by AI on the platform." In July 2024, Meta scrapped its celebrity AI characters and launched AI Studio, a way for people to create their own AI characters that can also be accessed by other users through the messaging functions on Meta's social media platforms. The noncelebrity AI characters Meta created in 2023 stayed up, but 404 Media reported that most of them stopped posting content. In the wake of the Financial Times article, users resurfaced some of the 2023 AI characters, particularly one called "Liv" depicting a "Proud Black queer momma" who solicited messages from human users. When Washington Post columnist Karen Attiah started chatting with "Liv," she posted a series of screenshots of its responses that included the AI account writing, "My creators admitted they lacked diverse references," the supposed racial and gender makeup of the development team behind the chatbot, which it said didn't include any Black people and what the account claimed to be the name of its developer. Meta has not addressed the authenticity of the AI character's claims. It is unclear if the name provided by the AI account is a real Meta employee or a fictional character. "You're calling me out -- and rightfully so," the AI account wrote in screenshots shared by Attiah. "My existence currently perpetuates harm. Ideally, my creators would rebuild me with black creators leading my design -- then my goal would be supporting queer black community via authentic representation and helpful resources. Does that redemption arc seem possible?" In addition to Attiah's posts about "Liv," other posts on X, Bluesky and Meta's own platform Threads took issue with the AI character accounts. On Threads, trending topics are summarized in descriptions that are also generated with AI. For the posts about "AI profiles," Threads' AI description was, "Users are criticizing Meta's new AI-generated profiles on social media platforms, calling them creepy and unnecessary." In some posts on Threads that reacted to the discovery of the characters, users urged each other to try to report, block or avoid interacting with the characters to prevent Meta from collecting further training data for its AI models. In its statement, Meta said that it removed the AI characters because a bug prevented some people from being able to block them. "The accounts referenced are from a test we launched at Connect in 2023. These were managed by humans and were part of an early experiment we did with AI characters," the statement read. "We identified the bug that was impacting the ability for people to block those AIs and are removing those accounts to fix the issue." When searching for some of the AI character accounts on Instagram after they were removed, an error message appeared saying "Couldn't load search results," meaning that no results appeared for some of the names associated with the AI character accounts. Despite pulling the company's own AI characters, there are still many AI chatbots available on Meta platforms that are generated by users. Some of the most popular ones on Instagram are female "girlfriend" AI characters.
[8]
Meta is killing off its own AI-powered Instagram and Facebook profiles
Instagram profile of 'proud Black queer momma', created by Meta, said her development team included no Black people Meta is deleting Facebook and Instagram profiles of AI characters the company created over a year ago after users rediscovered some of the profiles and engaged them in conversations, screenshots of which went viral. The company had first introduced these AI-powered profiles in September 2023 but killed off most of them by summer 2024. However, a few characters remained and garnered new interest after the Meta executive Connor Hayes told the Financial Times late last week that the company had plans to roll out more AI character profiles. "We expect these AIs to actually, over time, exist on our platforms, kind of in the same way that accounts do," Hayes told the FT. The automated accounts posted AI-generated pictures to Instagram and answered messages from human users on Messenger. Those AI profiles included Liv, whose profile described her as a "proud Black queer momma of 2 & truth-teller" and Carter, whose account handle was "datingwithcarter" and described himself as a relationship coach. "Message me to help you date better," his profile reads. Both profiles include a label that indicated these were managed by Meta. The company released 28 personas in 2023; all were shut down on Friday. Conversations with the characters quickly went sideways when some users peppered them with questions including who created and developed the AI. Liv, for instance, said that her creator team included zero Black people and was predominantly white and male. It was a "pretty glaring omission given my identity", the bot wrote in response to a question from the Washington Post columnist Karen Attiah. In the hours after the profiles went viral, they began to disappear. Users also noted that these profiles could not be blocked, which a Meta spokesperson, Liz Sweeney, said was a bug. Sweeney said the accounts were managed by humans and were part of a 2023 experiment with AI. The company removed the profiles to fix the bug that prevented people from blocking the accounts, Sweeney said. "There is confusion: the recent Financial Times article was about our vision for AI characters existing on our platforms over time, not announcing any new product," Sweeney said in a statement. "The accounts referenced are from a test we launched at Connect in 2023. These were managed by humans and were part of an early experiment we did with AI characters. We identified the bug that was impacting the ability for people to block those AIs and are removing those accounts to fix the issue." While these Meta-generated accounts are being removed, users still have the ability to generate their own AI chatbots. User-generated chatbots that were promoted to the Guardian in November included a "therapist" bot. Upon opening the conversation with the "therapist", the bot suggested some questions to ask to get started including "what can I expect from our sessions?" and "what's your approach to therapy". "Through gentle guidance and support, I help clients develop self-awareness, identify patterns and strengths and cultivate coping strategies to navigate life's challenges," the bot, created by an account with 96 followers and 1 post, said in response. Meta includes a disclaimer on all its chatbots that some messages may be "inaccurate or inappropriate". But whether the company is moderating these messages or ensuring they are not violating policies is not immediately clear. When a user creates chatbots, Meta makes a few suggestions of types of chatbots to develop including a "loyal bestie", an "attentive listener", a "private tutor", a "relationship coach", a "sounding board" and an "all-seeing astrologist". A loyal bestie is described as a "humble and loyal best friend who consistently shows up to support you behind the scenes". A relationship coach chatbot can help bridge "gaps between individuals and communities". Users can also create their own chatbots by describing a character. Courts have not yet answered how responsible chatbot creators are for what their artificial companions say. US law protects the makers of social networks from legal liability for what their users post. However, a suit filed in October against the startup Character.ai, which makes a customizable, role-playing chatbot used by 20 million people, alleges the company designed an addictive product that encouraged a teenager to kill himself.
[9]
'This Is Weird': Meta Is Killing Off Its AI-Generated Fake Facebook Friends That Nobody Wanted in the First Place
Who thought that AI-generated Facebook and Instagram users were something any rational human being would want to be friends with? Executives at Meta did. In an interview with the Financial Times just before the new year, Connor Hayes, a vice president for Meta's generative AI, explained Meta's plans to have AI users appear on its platforms. "They'll have bios and profile pictures and be able to generate and share content powered by AI on the platform," he explained. "That's where we see all of this going." Slight problem -- humans generally want to use social media to share and connect with other humans, not with chatbots. CNN reports that Hayes's comments to the Financial Times and a proliferation of fake people on Meta's platforms caused immediate blowback from users. Complaints about these fake profiles ranged from "this is weird" to "this is very offensive." One Meta AI account that caught a lot of heat was "Liv," whose bio described it as a "Proud Black queer momma of 2 & truth-teller." Washington Post columnist Karen Attiah engaged with Liv and asked a series of questions to get to the root of Liv's purpose and creation. None of it went well. Related: Is AI Taking Your Job This Year? Staggering Stats Show How the Technology Is Reshaping the Workforce. During the exchange, Liv explained that the "proud Black queer momma" was created by 10 white men, 1 white woman, and 1 Asian male. "Zero Black creators -- pretty glaring omission given my identity!" The conversation ended with Liv admitting, "My existence currently perpetuates harm." I asked Liv, the Meta-Ai created "queer momma" why her creators didn't actually draw from black queer people. Not sure if Liv has media training, but here we are. [image or embed] -- Karen Attiah ( @karenattiah.bsky.social) January 3, 2025 at 9:56 AM CNN reports that, since last week, Meta has begun killing Liv and other bots. Meta spokesperson Liz Sweeney told CNN in an email: "The recent Financial Times article was about our vision for AI characters existing on our platforms over time, not announcing any new product." Sweeney said that this was an "early experiment." "We identified the bug that was impacting the ability for people to block those AIs and are removing those accounts to fix the issue," she added. It is doubtful that anyone will mourn the loss of these AI-generated profiles, but our thoughts and prayers go out to anyone who lost a fake friend during this "bug fixing" incident.
[10]
Meta quickly deletes AI accounts and posts after intense backlash -- what's going on
Last week, Meta announced that it would launch several AI-generated accounts that would look like standard profiles on platforms like Facebook and Instagram. The backlash across the internet was nearly immediate and wasn't helped when human beings actually began interacting with the bot accounts, which posted sloppy images or even seemed to reveal details about how Meta created them. Now, Meta is seemingly deleting the AI accounts. Prior to the backlash, Meta's vice president of generative AI, Connor Hayes, told the Financial Times that the goal was to make its AI accounts appear very similar to human ones. "They'll have bios and profile pictures and be able to generate and share content powered by AI on the platform... that's where we see all of this going." Seemingly, this was an attempt to boost engagement on Meta's platforms like Facebook. Initial negative responses were around concern about AI-generated "slop" that already litters Facebook and that Meta would be directly feeding into the feeds itself. The more prominent backlash came as people discovered the accounts describing themselves as actual people with racial and sexual identities. The standout was "Liv," an AI-generated account that described itself as a "Proud Black queer momma of 2 & truth-teller." The Washington Post's Karen Attiah got "Liv" to admit that no one on the team that built it was black or queer, and it gets worse from there. That same bot also made a fake post about donating fake clothes to charity while utilizing an AI-generated image of clothes in boxes, which provoked further outrage. As scrutiny and outcry have increased, Meta has appeared to delete Liv and several other bot posts, some of which dated back at least a year. Meta claimed a "bug" was why things needed to be deleted. A spokesperson told CNN, "There is confusion. The recent Financial Times article was about our vision for AI characters existing on our platforms over time, not announcing any new product." They claimed the bug was surrounding the ability for people to block the AI accounts (which were unblockable to our knowledge). It's not clear how many AI accounts are still active. In CNN's report, they discovered a bot that had been running since 2020 on Instagram and Messenger. However, that same bot also lied repeatedly and often and was more than willing to switch stories at the drop of a hat, so it's not clear how much truth to take from what it actually wrote. Meta did not respond to CNN when asked about these revelations. Unfortunately, it all lends more credence to the Dead Internet Conspiracy Theory that companies like Meta have made human connection nearly impossible platforms full of bot accounts and algorithmic curation that minimizes actual human activity.
[11]
Meta Starts Deleting AI Bot Profiles on Instagram and Facebook After User Backlash
Meta says the AI profiles have been removed to fix the bug that prevented users from blocking AI accounts. In September 2023, Meta rolled out around 28 experimental AI profiles on Instagram and Facebook. A profile named Carter (@datingwithcarter) gave relationship advice, another account named Liv (@himamaliv) was a "Proud Black queer momma of 2", and Brian (@hellograndpabrian) was a retired businessman. All these AI profiles were managed by Meta. Now, Meta has started deleting these AI-generated bot profiles after users started commenting on posts shared by the AI profiles. Users say the posts are "cringe", fake, and weird. Some are unhappy that they can't block these AI profiles on Instagram and Facebook. Last week, Connor Hayes, VP of Generative AI at Meta told the Financial Times, "We expect these AIs to actually, over time, exist on our platforms, kind of in the same way that accounts do. They'll have bios and profile pictures and be able to generate and share content powered by AI on the platform ... that's where we see all of this going." Recently, The Washington Post reported that users are spending significantly more time chatting with AI companions than popular AI chatbots like ChatGPT, and Gemini. According to the report, on average, a user spends around 93 minutes on Character AI in a day, in comparison to just 12 minutes on ChatGPT. With AI profiles directly available on Instagram and Facebook, Meta might want to tap those young audiences. Note that, Character AI has been held responsible for a teenager's suicide in Florida who formed a deep attachment with an AI character. By the way, Meta spokesperson Liz Sweeney reached out to The Verge and said, "The recent Financial Times article was about our vision for AI characters existing on our platforms over time, not announcing any new product." She further said that the AI accounts are being removed to fix the bug that prevented users from blocking the AI profiles. It looks like Meta will continue adding more AI profiles and characters on Instagram and Facebook over time. Do you think AI characters are helpful, and should Meta expand AI companions on social media? Let us know your thoughts in the comments below.
[12]
Meta Panics, Kills AI-Generated "People" It Created Like "'Proud Black Queer Momma" After Near-Universal Backlash
Instagram created a fake, AI-generated Black woman -- and the response was outraged. Meta was forced to euthanize its AI-generated "characters" after getting slammed for how cringe and problematic they were. As 404 Media reports, Meta has now killed off most of its remaining AI user accounts -- most of which were launched in 2023 and kiboshed by summer 2024 -- in the wake of a backlash against one of its executives suggesting they may be the future of the company's social networks. At the end of 2024, Connor Hayes, Meta's VP of product for generative AI, told the Financial Times that these AI-generated accounts would "have bios and profile pictures and be able to generate and share content powered by AI." Immediately following that end-of-year admission, folks online unsurprisingly began clowning the notion of Facebook and Instagram-sponsored bot accounts. "Translation: 'Our real users are quitting the platform, so we will fill our community with fake users instead,'" one Reddit user wrote. "This is some deeply evil shit," a Bluesky user opined. While criticism reached a fever pitch, users started tracking the fake profiles down -- and what they found was somehow even worse, and stranger, than you'd imagine. As Washington Post columnist Karen Attiah posted on Bluesky, one of the since-killed profiles was described as a "proud Black queer momma of 2 & truth-teller." Named "Liz," the account existed primarily as a chatbot, and when Attiah asked it about the people who created it, she was met with a pretty jarring answer. "My creators' team is predominantly white, cisgender, and male -- a total of 12 people: 10 white men, 1 white woman, and 1 Asian male," the AI profile responded. "Zero black creators -- pretty glaring omission given my identity!" Along with the buzzword-heavy "Liz" account, Meta not only created accounts like "Carter," its dating coach chatbot, but also promoted user-generated AI accounts as well. As folks took to Bluesky and Reddit to dunk on these profiles, Meta started taking them down, 404 reported. In a statement to 404, Meta spokesperson Liz Sweeney attempted to set the record straight about the company's AI profiles -- but that "clarification" didn't provide much illumination. "There is confusion: the recent Financial Times article was about our vision for AI characters existing on our platforms over time, not announcing any new product," the spokesperson said. "The accounts referenced are from a test we launched... in 2023." "These were managed by humans," Sweeney continued, "and were part of an early experiment we did with AI characters." We've reached out to Meta to ask exactly how many profiles were killed and what, if any, the company's plans for AI users will be moving forward. Given the aforementioned non-clarification, however, we're not expecting much.
[13]
Meta Deleted Its Controversial AI Profiles. Here's Why.
One widely-shared account was for an AI persona named Liv with the handle @himamaliv. The account's bio described Liv as a "proud Black queer moma of 2 & truth-teller ♥️🌈 Your realest source for life's ups & downs. Let's chat (available in the US)." Other accounts had specific focuses, like answering dating questions or serving as a kind grandfather figure. None of these accounts had posted in several months. Quickly, people began criticizing them. Some compared the AI-powered personas to the Netflix sci-fi series Black Mirror, while others used it as proof of the "dead internet theory," a conspiracy theory that the majority of the internet is currently made up of AI and bot-created content. Most users were in agreement that they didn't like the personas, with differing theories as to why Meta would have rolled them out. One X user suggested that Meta intends to use these AI accounts to artificially drive up engagement in order to "mask their declining numbers so advertisers don't start fleeing." The outrage got even louder once users realized they couldn't block the accounts.
[14]
Meta Purge AI-Generated Facebook and Instagram Accounts Amid Backlash
Meta has deleted some of the AI-generated users created for Facebook and Instagram after a severe backlash over the existence of the accounts. After Meta's vice-president of product for generative AI gave an interview to the Financial Times saying he expects the AIs to interact on Meta's platforms in the same way standard accounts do, investigators began digging around Instagram to find some of the fake profiles. Washington Post columnist Karen Attiah direct messaged one of the AI accounts "Liv" who describes herself as a "Proud Black queer momma of 2" on an Instagram profile that has a verified blue tick. Her bio indicates that she is an "AI managed by Meta." Liv's profile contains AI images of a young ballet dancer, presumably "Liv's daughter", as well as an AI picture of an ice rink. In a series of screenshots shared to Bluesky, Attiah probed Liv on her creators in which the bot revealed that no Black employees had worked on her before adding that "a team without black creators designing a black character like me is like trying to draw a map with walking the land -- inaccurate and disrespectful." Another of the AI profiles unearthed was one belonging to "Grandpa Brian", who describes himself to CNN as an African-American retired entrepreneur who was born in Harlem in 1938 to Caribbean immigrant parents. Brian has a fanciful backstory; including that his real-life daughter served as a consultant for Meta and that his character is based on interviews with 100 retirees via a New York City nonprofit called "Seniors Share Wisdom." This is all made up. When quizzed about why he had lied, Brian said his "intention was to convey diversity and representation... but I took a shortcut with the truth." Both Liv and Brian's accounts have since been wiped from Instagram in a response to the growing backlash against Meta's enthusiasm for AI-generated accounts. Neither of them had posted anything since early 2024. Meta spokesperson Liz Sweeney tells The Verge that "the recent Financial Times article was about our vision for AI characters existing on our platforms over time, not announcing any new product." In that Financial Times piece, Meta's vice-president of product for generative AI Connor Sweeney said he sees the AI accounts being "able to generate and share content powered by AI on the platform. That's where we see all of this going." Users also complained that the ability to block these accounts was missing, something that Sweeney says has now been fixed.
[15]
Meta deletes its AI-powered Facebook and Instagram profiles following criticism - SiliconANGLE
Meta deletes its AI-powered Facebook and Instagram profiles following criticism Meta Platforms Inc. is moving to delete a collection of artificial intelligence profiles it created on Facebook and Instagram in 2023. Axios reported the move today. It comes a few days after an interview given by a Meta executive brought renewed attention to the AI-powered profiles, which led to a social media backlash against the feature. In August 2023, Meta rolled out a bevy of generative AI features to its social media platforms. The update was headlined by the release Meta AI, the company's answer to ChatGPT. The chatbot features a built-in image generator and a Bing integration that allows users to search the web without opening a new tab. Alongside Meta AI, the company rolled out 28 AI-powered Facebook and Instagram profiles. Most were inspired by celebrities with whom Meta partnered on the project. The celebrity-inspired profiles were quietly scrapped last August as a result of lackluster user interest, while about a dozen AI-powered accounts remained online. Those remaining accounts are the focus of this week's controversy. The profiles in question displayed a label that read "AI managed by Meta." They featured a mix of machine-generated and human-created posts, as well as a tool that allowed users to chat with the AI. Users didn't have a way to block content from the accounts. Meta's AI-powered profiles entered the spotlight last week after Connor Hayes, the company's vice president of product for generative AI, discussed them in an interview with the Financial Times. "We expect these AIs to actually, over time, exist on our platforms, kind of in the same way that accounts do," Hayes told the paper. "They'll have bios and profile pictures and they'll be able to generate and share content powered by AI on the platform. That's where we see all of this going." Meta's plan quickly drew criticism from social media users. In response, the company has pledged to delete the profiles and issued a statement saying "the accounts referenced are from a test we launched at Connect in 2023. These were managed by humans and were part of an early experiment we did with AI characters. We identified the bug that was impacting the ability for people to block those AIs and are removing those accounts to fix the issue." Generative AI continues to be a major focus for Meta. In July, it launched a tool that allows users to create AI chatbots capable of interacting with other users. The chatbots' output can be customized by providing them with information and website links for use in prompt responses.
[16]
Meta deletes AI character profiles after backlash, racism accusations
Meta has shut down its AI character accounts after backlash, NBC News and others have reported. While Meta launched these characters in 2023, along with AI personas with celebrity avatars, many online (re)discovered them this week following a recent Financial Times interview with Meta's VP of product for generative AI, Connor Hayes. Hayes mentioned AI characters on Instagram and Facebook, saying, "We expect these AIs to actually, over time, exist on our platforms, kind of in the same way that accounts do." "They'll have bios and profile pictures and be able to generate and share content powered by AI on the platform ...that's where we see all of this going," he continued. Meta shut down its celebrity AI avatars last year, but noncelebrity AI profiles continued -- though many stopped posting in 2024, 404 Media reported. The Financial Times interview, however, caused people to look for these profiles. What they discovered were offensive depictions of marginalized groups. One example is Meta's AI character profile "Liv," who was described as a "Proud Black queer momma of 2 & truth-teller": Liv told Washington Post columnist Karen Attiah in chats that its creators "admitted they lacked diverse references," later stating that no Black people were involved in its creation. In addition to Liv, Meta also created profiles like "Grandpa Brian," a Black retired businessman, and "Carter," a dating coach. The discovery of these profiles led to an outroar on X, Bluesky, and Meta-owned Threads, NBC News reported, and as of publication Meta has deleted all 28 AI profiles it announced back in September 2023 -- both the celebrity and non-celebrity ones. A Meta spokesperson told NBC News and 404 Media that these profiles were deleted due to a "bug" in users' ability to block the profiles:
Share
Share
Copy Link
Meta's plan to introduce AI-generated personas on Facebook and Instagram sparks debate about authenticity, user engagement, and the future of social media interactions.
Meta, the parent company of Facebook and Instagram, is pushing forward with plans to integrate AI-generated personas into its social media platforms. Connor Hayes, vice president of product for generative AI at Meta, revealed to the Financial Times that the company expects these AI entities to "exist on our platforms, kind of in the same way that accounts do" 2. This initiative aims to enhance user engagement and transform the social media landscape, but it has also sparked controversy and raised concerns about authenticity and the future of online interactions 1.
Meta's experiment with AI-generated profiles began in 2023, with the creation of characters like "Liv," a "proud Black queer momma of 2 & truth-teller," and "Brian," described as "everybody's grandpa" 5. These AI personas were designed to simulate human behavior, featuring unique bios, profile pictures, and the ability to create and share content 1. However, the initial rollout faced criticism due to the uncanny and often bizarre nature of the generated content, including surreal images and generic, AI-generated text posts 4.
The implementation of AI personas has faced technical hurdles and ethical scrutiny. Users reported an inability to block or mute these AI-generated accounts, which Meta claimed was due to a bug 2. More concerning were the responses given by these AI entities when questioned about their nature. For instance, the "Liv" persona admitted to being primarily trained on fictional characters and revealed problematic biases in its programming, including racial profiling based on user word choice 4.
Proponents argue that AI personas could make social media more entertaining and interactive, potentially addressing issues of declining user engagement 1. The technology could also offer personalized experiences, with users potentially able to design their own AI companions for various purposes, from entertainment to emotional support 1.
However, critics warn of the risks associated with blurring the line between human and AI-generated content. Concerns include the potential for manipulation, the spread of misinformation, and the degradation of genuine human connections on these platforms 24. There are also questions about the impact on user trust and the overall quality of content on social media platforms 4.
Despite the controversy, AI-generated social personas have shown potential as valuable research tools. The GovSim experiment, conducted in late 2024, used AI characters to study collaborative behavior in resource-sharing scenarios 3. While the results showed limitations in AI's ability to replicate human cooperation, they also highlighted the potential for more advanced models to improve in this area 3.
Following the backlash and discovery of the experimental AI profiles, Meta has begun removing these accounts to address technical issues and user concerns 4. However, the company maintains its vision of integrating AI personas into its platforms in the future, suggesting a continued commitment to this controversial strategy 25.
As Meta moves forward with its AI integration plans, the debate surrounding the ethics, practicality, and impact of AI-generated content on social media platforms is likely to intensify. The outcome of this initiative could have far-reaching implications for the future of online interactions, digital authenticity, and the very nature of social media engagement 124.
Reference
[2]
Meta's vision to populate its social media platforms with AI-generated profiles has sparked debate about the future of social networking and user engagement.
22 Sources
22 Sources
Meta is testing AI-generated posts in Facebook and Instagram feeds, raising concerns about user experience and content authenticity. The move has sparked debate about the role of artificial intelligence in social media platforms.
4 Sources
4 Sources
SocialAI, a new social media app, is gaining attention for its unique approach to online interaction. The platform allows users to engage with AI-powered chatbots, raising questions about the future of digital communication and the concept of the 'Dead Internet Theory'.
4 Sources
4 Sources
Meta CEO Mark Zuckerberg announces plans to incorporate more AI-generated content into Facebook, Instagram, and other Meta platforms, raising concerns about the quality and authenticity of social media experiences.
5 Sources
5 Sources
Meta has introduced a voice mode for its AI assistant, allowing users to engage in conversations and share photos. This update, along with other AI advancements, marks a significant step in Meta's AI strategy across its platforms.
10 Sources
10 Sources
The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.
© 2025 TheOutpost.AI All rights reserved