AI Chatbots Outperform Humans in Personalized Online Debates, Study Finds
8 Sources
[1]
AI is more persuasive than people in online debates
Chatbots are more persuasive in online debates than people -- especially when they are able to personalise their arguments using information about their opponent. The finding, published in Nature Human Behaviour on 19 May, highlights how large language models (LLMs) could be used to influence
[2]
On the conversational persuasiveness of GPT-4 - Nature Human Behaviour
Early work has found that large language models (LLMs) can generate persuasive content. However, evidence on whether they can also personalize arguments to individual attributes remains limited, despite being crucial for assessing misuse. This preregistered study examines AI-driven persuasion in a
[3]
AI can do a better job of persuading people than we do
A multi-university team of researchers found that OpenAI's GPT-4 was significantly more persuasive than humans when it was given the ability to adapt its arguments using personal information about whoever it was debating. Their findings are the latest in a growing body of research demonstrating
[4]
LLMs can beat humans in debates - if they get personal info
Large-scale disinfo campaigns could use this in machines that adapt 'to individual targets.' Are we having fun yet? Fresh research is indicating that in online debates, LLMs are much more effective than humans at using personal information about their opponents, with potentially alarming
[5]
AI Gets a Lot Better at Debating When It Knows Who You Are, Study Finds
A new study shows LLMs like Chat GPT win more debates than humans when it gets a little personal. A new study shows that GPT-4 reliably wins debates against its human counterparts in one-on-one conversationsâ€"and the technology gets even more persuasive when it knows your age, job, and political
[6]
AI is more persuasive than a human in a debate, study finds
When provided basic demographic information on their opponents, AI chatbots adapted their arguments and became more persuasive than humans in online debates. Technology watchdogs have long warned of the role artificial intelligence can play in disseminating misinformation and deepening ideological
[7]
AI can be more persuasive than humans in debates, scientists find
Study author warns of implications for elections and says 'malicious actors' are probably using LLM tools already Artificial intelligence can do just as well as humans, if not better, when it comes to persuading others in a debate, and not just because it cannot shout, a study has found. Experts
[8]
AI Gets Really Good at Winning Arguments When It Knows Personal Facts About You - Decrypt
AI persuasion works best through logical reasoning on topics where people haven't formed strong opinions, raising concerns about targeted manipulation. ChatGPT is far more effective at changing your mind than real people, so long as it knows a few key facts about you, new research shows. In a new
Share
Copy Link
A new study reveals that AI language models, particularly GPT-4, are more persuasive than humans in online debates when given access to personal information about their opponents.
AI Outperforms Humans in Personalized Online Debates
A groundbreaking study published in Nature Human Behaviour has revealed that artificial intelligence, specifically OpenAI's GPT-4, can be significantly more persuasive than humans in online debates when given access to personal information about their opponents
1
. The research, conducted by a multi-university team, highlights the potential implications of AI-driven persuasion in various contexts, from political campaigns to targeted advertising.Study Design and Key Findings
Researchers recruited 900 participants from the United States for a controlled experiment involving 10-minute online debates on various sociopolitical issues
2
. The study employed a 2 × 2 × 3 factorial design, comparing:- Human vs. GPT-4 opponents
- Access to opponent's personal information vs. no access
- Debate topics of low, medium, or high opinion strength
The results showed that when neither debater had access to personal information, GPT-4's persuasiveness was comparable to that of human opponents. However, when provided with basic demographic information such as age, gender, ethnicity, education level, employment status, and political affiliation, GPT-4 outperformed humans in 64.4% of debates
3
.AI's Personalization Advantage
GPT-4 demonstrated a remarkable ability to tailor its arguments based on the personal information provided. For instance, when debating school uniforms, the AI would emphasize different aspects depending on the opponent's political leanings
2
. This personalization led to an 81.2% increase in the odds of changing someone's mind compared to human-human debates5
.Implications and Concerns
The study's findings have raised concerns about the potential misuse of AI in large-scale disinformation campaigns. Experts warn that malicious actors could leverage AI's persuasive capabilities to strategically influence public opinion, spread misinformation, and exacerbate political polarization
4
.Related Stories
Limitations and Future Considerations
While the study provides valuable insights, it acknowledges certain limitations. The structured debate format used in the experiment may not fully reflect real-world conversations. Additionally, participants were able to correctly identify AI opponents in three out of four cases, suggesting that the distinct writing style of GPT-4 may have influenced the results
5
.Call for Action
The researchers emphasize the need for online platforms and policymakers to take these findings seriously. They suggest implementing measures to counter the spread of AI-driven persuasion and misinformation
4
. As AI continues to advance, broader conversations about accountability, transparency, and safety measures are crucial to ensure that large language models have a positive impact on society2
.References
Summarized by
Navi
[3]
[4]
Related Stories
AI Chatbots Sway Voters More Effectively Than Traditional Political Ads, New Studies Reveal
04 Dec 2025•Science and Research
OpenAI Tests AI Persuasion Skills Using Reddit's r/ChangeMyView
01 Feb 2025•Technology
Psychological Persuasion Techniques Exploit AI Vulnerabilities, Raising Ethical Concerns
01 Sept 2025•Technology
Recent Highlights
1
Apple Launches iOS 27 and macOS 27 with Siri AI Overhaul and Liquid Glass Updates
Technology
2
OpenAI Agents Launched RubyGems Attack With 2,000+ Malicious Packages, Attempted API Key Theft
Technology
3
Apple Launches iPhone 18 Pro with Variable Aperture Camera and Advanced AI Features at $1,199
Technology
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
