Model Performance

Twitter

Facebook

Copy Link

Key Facts

Key PlatformsLMSYS Arena, Open LLM Leaderboard

Key BenchmarksMMLU, HumanEval, GSM8K, ARC

Top News

AI chatbots fail to improve medical advice for patients, Oxford study reveals

A University of Oxford study published in Nature Medicine found that AI chatbots offer no advantage over internet searches when patients seek medical advice. Despite large language models achieving 94.9% accuracy in controlled tests, real-world human-AI interaction in healthcare revealed a troubling gap between AI potential and performance, with patients struggling to provide complete information and receiving inconsistent advice.

Health14 sources

AI chatbots fail to improve medical advice for patients, Oxford study reveals

Health14 sources

AI in surgery faces scrutiny as TruDi Navigation System linked to strokes and patient injuries

A Johnson & Johnson surgical device saw malfunctions surge from 7 to over 100 after adding AI, with at least 10 patients injured. Two stroke victims have filed lawsuits alleging the TruDi Navigation System's AI contributed to botched surgeries, including skull punctures and arterial injuries. The incidents highlight growing concerns about inadequate safety standards as the FDA approves AI-powered medical devices at an accelerating pace.

Health3 sources

AI in surgery faces scrutiny as TruDi Navigation System linked to strokes and patient injuries

Health3 sources

Takeda inks $1.7 billion Iambic deal to accelerate AI drug discovery for cancer treatments

Japan's Takeda Pharmaceutical has partnered with AI startup Iambic in a deal exceeding $1.7 billion to design small-molecule drugs targeting cancer and gastrointestinal diseases. The collaboration leverages Iambic's NeuralPLexer model to predict protein binding, potentially compressing traditional six-year drug discovery timelines to less than two years through AI predictions and automated laboratories.

Technology3 sources

Takeda inks $1.7 billion Iambic deal to accelerate AI drug discovery for cancer treatments

Technology3 sources

AI stethoscope doubles detection of heart valve disease, outperforming traditional methods

New research shows artificial intelligence-powered stethoscopes can detect heart valve disease with 92% accuracy compared to 46% using traditional methods. The AI algorithm identified twice as many cases of previously undiagnosed moderate-to-severe disease, potentially enabling earlier treatment and saving thousands of lives.

Health3 sources

AI stethoscope doubles detection of heart valve disease, outperforming traditional methods

Health3 sources

Indian AI models beat global giants in speech recognition as Voice of India benchmark exposes gaps

A new national benchmark reveals that leading global AI systems from OpenAI and Microsoft struggle to understand how Indians actually speak. Sarvam AI, a Bengaluru-based startup, consistently ranks first across 15 Indian languages, achieving 93%+ accuracy while OpenAI's models trail by over 50 percentage points in the comprehensive evaluation.

Technology7 sources

Indian AI models beat global giants in speech recognition as Voice of India benchmark exposes gaps

Technology7 sources

University of Michigan's Prima AI model reads brain MRI scans in seconds with 97.5% accuracy

Researchers at University of Michigan developed Prima, an AI model that analyzes brain MRI scans and delivers diagnoses in seconds with up to 97.5% accuracy. Trained on over 220,000 MRI studies, Prima can prioritize emergency cases like strokes and brain hemorrhages, automatically alerting specialists. The system aims to address growing radiology shortages and reduce diagnostic delays across health systems.

Science4 sources

University of Michigan's Prima AI model reads brain MRI scans in seconds with 97.5% accuracy

Science4 sources

Anthropic releases Claude Opus 4.6 as AI model advances rattle software stocks and cybersecurity

Anthropic unveiled Claude Opus 4.6, its most capable AI model yet, with significant improvements in coding, financial analysis, and vulnerability detection. The release found 500+ high-severity flaws in open-source libraries and triggered market concerns about traditional software companies. The upgrade handles complex enterprise workflows with broader autonomy and includes new features like agent teams and PowerPoint integration.

Technology23 sources

Anthropic releases Claude Opus 4.6 as AI model advances rattle software stocks and cybersecurity

Technology23 sources

Fundamental raises $255 million for AI model that tackles enterprise tabular data blind spot

DeepMind alumni launch Fundamental with $255 million in funding to solve a critical gap in AI: analyzing structured tabular data. The startup's Nexus model brings deep learning to enterprise spreadsheets, promising faster predictions than traditional machine learning algorithms. Fortune 100 companies have already signed seven-figure contracts.

Technology4 sources

Fundamental raises $255 million for AI model that tackles enterprise tabular data blind spot

Technology4 sources

Goodfire Raises $150 Million at $1.25 Billion Valuation to Decode AI Models and Improve Safety

Goodfire has raised $150 million in Series B funding at a $1.25 billion valuation to advance AI interpretability research. The startup creates interpreter models to decode neural networks and understand how AI models make decisions. CEO Eric Ho warns the industry is moving too fast without understanding the technology it's deploying.

Technology4 sources

Goodfire Raises $150 Million at $1.25 Billion Valuation to Decode AI Models and Improve Safety

Technology4 sources

Claude Sonnet 5 leak reveals one-million-token context and imminent Anthropic release

Anthropic is preparing to release Claude Sonnet 5, a new mid-tier AI model that could reshape the large language model market. Leaked references found in Google Vertex AI logs point to a February 3, 2026 launch, with the model codenamed Fennec showing a one-million-token context window, 50% lower cost than Opus 4.5, and TPU-based training for faster inference speeds.

Technology3 sources

Claude Sonnet 5 leak reveals one-million-token context and imminent Anthropic release

Technology3 sources

OpenScholar AI tool surpasses GPT-4o in literature reviews and eliminates citation hallucinations

Academic researchers unveiled OpenScholar, an open-source AI tool that outperformed major LLMs like GPT-4o in scientific literature reviews. The system combines a language model with 45 million open-access articles to deliver accurate citations without hallucinations. Over 30,000 scientists have already tested the free tool since its debut.

Technology2 sources

OpenScholar AI tool surpasses GPT-4o in literature reviews and eliminates citation hallucinations

Technology2 sources

Apple researchers unlock faster, more natural-sounding Siri through new speech technology

Apple researchers have published a breakthrough study proposing a new text-to-speech approach that could dramatically improve Siri's performance. The research introduces Acoustic Similarity Groups (ASGs) to accelerate speech token generation while maintaining quality, potentially addressing long-standing complaints about the voice assistant's sluggish response time.

Science3 sources

Apple researchers unlock faster, more natural-sounding Siri through new speech technology

Science3 sources

Contextual Errors Keep Medical AI From Reaching Its Full Potential in Clinical Settings

Harvard Medical School researchers have identified contextual errors as a major barrier preventing medical AI from transitioning into real-world clinical use. Despite thousands of models being developed, very few succeed in hospitals because they lack critical information about medical specialty, geographic location, and socioeconomic factors needed for accurate patient care.

Science2 sources

Contextual Errors Keep Medical AI From Reaching Its Full Potential in Clinical Settings

Science2 sources

Carbon Robotics unveils Large Plant Model trained on 150M+ plants to transform farming

Seattle-based Carbon Robotics launched its Large Plant Model, an AI model that detects and identifies plants instantly without retraining. Trained on over 150 million photos from 100+ farms across 15 countries, the model powers LaserWeeder robots that use lasers to eliminate weeds, helping farmers reduce labor costs and herbicide use while improving yields.

Technology2 sources

Carbon Robotics unveils Large Plant Model trained on 150M+ plants to transform farming

Technology2 sources

AI creativity matches average humans but top creators still outperform machines, new studies show

Two major studies reveal a nuanced picture of AI creativity versus human creativity. While generative AI scored better than average participants in a 100,000-person creativity experiment, the top 10% of humans far exceeded AI performance. Separately, CMU research found AI-generated music was judged less creative than human compositions, highlighting the complex relationship between AI and humans in creative fields.

Science2 sources

AI creativity matches average humans but top creators still outperform machines, new studies show

Science2 sources

Prev 1…121314…22 Next