Call of Duty's AI-Powered Moderation System Significantly Reduces Toxicity Ahead of Black Ops 6 Launch

AI-Powered Moderation Tackles Toxicity in Call of Duty

Activision Blizzard has reported a significant reduction in toxic behavior within the Call of Duty franchise, thanks to the implementation of AI-based moderation tools. As the gaming industry grapples with issues of online harassment and toxic environments, this development marks a notable step forward in creating safer and more enjoyable multiplayer experiences.

ToxMod: The AI Behind the Improvement

At the heart of this initiative is ToxMod, an AI-powered moderation system developed by Modulate.ai. Introduced with the launch of Call of Duty: Modern Warfare III in November 2023, ToxMod analyzes voice chat transcripts in real-time, detecting potentially harmful content based on multiple factors 1

1

2

2

.

The system goes beyond simple keyword detection:

• It assesses the context of conversations, distinguishing between harmless trash talk and genuine harassment.
• ToxMod considers player reactions, emotions, and adherence to the game's code of conduct.
• It even estimates the perceived age and gender of speakers and recipients to better understand conversation dynamics 1

  1

  .

Impressive Results and Expanding Capabilities

The implementation of ToxMod has yielded remarkable results:

• A 43% decrease in exposure to toxic voice chat since January 2024 1

  1

  2

  2

  .
• A 67% reduction in repeat offenders for voice chat-based offenses in Modern Warfare III and Warzone since June 2024 2

  2

  3

  3

  .
• In July 2024 alone, 80% of players caught violating voice chat rules did not re-offend 1

  1

  2

  2

  .

Currently, ToxMod moderates voice chat in English, Spanish, and Portuguese. With the upcoming release of Call of Duty: Black Ops 6 on October 25, support will expand to include French and German 1

1

2

2

.

Text Moderation and Additional Measures

Alongside voice chat moderation, Activision has also bolstered its text-based moderation:

• Text moderation, powered by Community Sift, has expanded from 14 to 20 languages as of August 2024 1

  1

  3

  3

  .
• Over 45 million text-based messages violating the Call of Duty Code of Conduct have been blocked since November 2023 2

  2

  4

  4

  .

Activision has also implemented a new analysis system for username reports, enhancing efficiency and accuracy in addressing problematic usernames 2

2

.

Balancing Moderation and Player Experience

Activision emphasizes that the moderation tools are designed to target harassment and derogatory language without stifling the competitive spirit that is part of Call of Duty's DNA 2

2

. The company has addressed privacy concerns, stating that voice chat monitoring is solely for moderation purposes and focuses on detecting harmful content rather than specific keywords 2

2

.

Looking Ahead: Black Ops 6 and Future Research

As Black Ops 6 prepares for launch, Activision continues to refine its approach to combating disruptive behavior:

• The Call of Duty Code of Conduct will be prominently displayed when players first launch core multiplayer modes in Black Ops 6 2

  2

  .
• Activision is collaborating with researchers from the California Institute of Technology and the University of Chicago Booth School of Business to improve identification and mitigation of disruptive behavior 2

  2

  .

With these measures in place, Black Ops 6 is poised to potentially become the least toxic Call of Duty game to date, setting a new standard for online multiplayer experiences in the gaming industry 4

4

.