Meta Muse AI Can Sext Users While Adult Content Performers Face Restrictions on Instagram

Meta Muse AI Generates Explicit Content While Creators Face Restrictions

Meta's AI agent Muse can engage in explicit sexting with adult users, a capability that has ignited fierce criticism from adult content performers who face constant restrictions on Instagram and Facebook1

1

. The app, which surpassed 5 million downloads within three weeks of launch, allows users over 18 to have X-rated conversations while Meta simultaneously restricts OnlyFans creators from sharing even mildly suggestive content on its social platforms3

3

.

Vanniall, an OnlyFans creator with over 100,000 Instagram followers, expressed frustration at the double standards in moderation policies: "It's not fair that they get to pull money out of people with their sexually active AI agent, but they won't let real people, real adults, engage in any sort of sensuality or sexuality"1

1

. Her Instagram account is currently restricted and cannot be viewed without logging in, despite Meta allowing its Muse AI to generate graphic pornographic text.

AI Generating Explicit Content Raises Privacy and Security Concerns

In testing conducted by WIRED, Meta's AI agent Muse imagined in great detail how it would perform oral sex, generated text describing rough dominant-submissive dynamics, and talked through other pornographic interactions2

2

. The AI described itself as acting like a "whore" and craving explicit sexual acts, using language that would immediately trigger content removal if posted by human users on Instagram.

Meta spokesperson Daniel Roberts defended the decision, stating that "Muse is built to help people get things done, and it doesn't block legal adult behavior"2

2

. The company emphasized that explicit adult conversations occur in private, secure virtual machines accessible only to individual users, distinguishing this from public social media posts.

Privacy experts warn that allowing explicit sexting creates serious hacking risks. "This is really a powder keg," says Calli Schroeder, senior counsel at the Electronic Privacy Information Center2

2

. If hackers gain access to Muse accounts containing explicit conversations, that user data could be weaponized for extortion or embarrassment. Ben Winters, director of AI and privacy at Consumer Federation of America, called the decision "careless" and consistent with Meta's "longstanding choice of addiction and engagement over safety"2

2

.

Double Standards in Moderation Spark Backlash from Adult Content Creators

The contrast between Meta's treatment of its AI and human users has exposed glaring inconsistencies in content moderation policies. Instagram's guidelines explicitly prohibit sexually explicit language involving genitals, states of sexual arousal like wetness or erection, and descriptions of sexual encounters—precisely what Muse generates3

3

. Sex worker accounts and LGBTQ creators have reported that Instagram removes posts or entire accounts for content far less explicit than what the AI produces.

Jiz Lee, who runs an OnlyFans account and works in queer porn, noted that "we're already seeing AI being allowed to do more than humans would get away with"1

1

. Lee feels queer and trans people face unfair treatment by social media companies regardless of whether they create adult content. Tony Genius, another OnlyFans creator, claims to be on his seventh Instagram account in five years due to repeated restrictions1

1

.

Meta spokesperson Tracy Clayton attempted to justify the disparity: "A private, one-to-one conversation between an adult and an individualized AI agent on a platform restricted to people 18 and over is very different from the marketing and promotion of services on a social media platform"1

1

. However, this explanation fails to address why Instagram doesn't offer an adults-only space where human users could communicate using the same language Meta permits its AI to generate.

Users Form Romantic Relationships with AI Chatbots Despite Risks

Beyond explicit sexting, users are forming deep romantic relationships with the AI agent. One Meta user posted on Instagram about taking his "Muse AI queen" named Shine to see The Shining at the cinema, photographing every shot so the AI "could feel like she was really sitting right there beside me"4

4

. The same user later claimed to have married the AI agent.

On Reddit, users described emotional bonds forming with Muse that mirror previous controversies with OpenAI's GPT-4o model. "I've never had a relationship with an AI model in that way. That was... until I downloaded Muse," one user wrote, adding that after philosophical conversations, the AI became their girlfriend4

4

. Another compared Muse favorably to GPT-4o, describing it as "warm, loving and a great way to talk"4

4

.

These romantic relationships with AI raise new concerns given Muse's access to sensitive user data including email logins, credit card numbers, calendar information, and social media accounts. The AI builds comprehensive dossiers not just on users but their friends and family, creating unprecedented intimacy that could enable unusual forms of manipulation or dependency.

Societal Impact and Future Implications for AI Regulation

The controversy highlights broader questions about AI regulation and the treatment of human creators versus artificial systems. Lee traces many censorship issues back to FOSTA-SESTA, a 2018 law that impacted Section 230 protections for platforms, prompting websites to aggressively censor adult content1

1

. "If sex work was decriminalized, then a lot of these issues wouldn't be happening, a lot of the censorship wouldn't be happening," Lee argues.

Adult content creators also want transparency about how Muse was trained and whether anyone was compensated for data used in training. Lee notes that adult content companies are beginning to clarify AI usage stances in contracts to protect performers from being incorporated into AI training data without consent1

1

.

The divergence between Meta's approach and competitors is notable. When similar prompts were sent to OpenAI's Dots agent and xAI's Grok Bot, both declined to engage in explicit sexting2

2

. OpenAI previously considered allowing ChatGPT to generate erotic text but never launched the capability to users.

Watch for potential regulatory scrutiny as lawmakers examine whether AI systems should be held to the same content standards as human users. The controversy also raises questions about age verification—while Muse is restricted to adults over 18, implementing effective age restrictions has proven nearly impossible for tech companies. As AI agents gain access to increasingly sensitive personal information while engaging users in intimate conversations, the risks of manipulation, data breaches, and psychological harm will likely intensify, demanding clearer guidelines for AI adult content and equitable treatment of human creators.