GPT-5 Launch: Mixed Reviews on Coding and Analysis Capabilities
7 Sources
[1]
I went hands-on with ChatGPT Codex and the vibe was not good - here's what happened
ChatGPT Codex wrote code and saved me time.It also created a serious bug, but it was able to recover.Codex is still based on the GPT-4 LLM architecture. Well, vibe coding this is not. I found the experience to be slow, cumbersome, stressful, and incomplete. But it all worked out in the
[2]
I tested GPT-5's coding skills, and it was so bad that I'm sticking with GPT-4o (for now)
Now that OpenAI has enabled fallbacks to other LLMs, there are options. So GPT-5 happened. It's out. It's released. It's the talk of the virtual town. And it's got some problems. I'm not gonna bury the lede. GPT-5 has failed half of my programming tests. That's the worst that OpenAI's flagship LLM
[3]
GPT-5 bombed my coding tests, but redeemed itself with code analysis
With the big news that OpenAI has released GPT-5, the team here at ZDNET is working to learn about and communicate its strengths and weaknesses. In another article, I put its programming prowess to the test and came up with a less-than-impressive result. Also: I tested GPT-5's coding skills, and
[4]
I've tested OpenAI's claims about GPT-5 -- here's what happened
OpenAI recently launched GPT-5, its latest large language model and a huge update to ChatGPT. While the new update has a lot going for it, claims are one thing, and reality is another. GPT-5 is said to be faster, less prone to hallucination and sycophantic behavior, and able to choose between fast
[5]
OpenAI GPT-5 Review: Built to Win Benchmarks, Not Hearts - Decrypt
It's still a work in progress and will likely get better as OpenAI iterates with updates. OpenAI finally dropped GPT-5 last week, after months of speculation and a cryptic Death Star teaser from Sam Altman that didn't age well. The company called GPT-5 its "smartest, fastest, most useful model
[6]
ChatGPT 5 Full Breakdown : Everything You Need to Know
What if the next leap in artificial intelligence could not only anticipate your needs but also adapt to your unique preferences in real time? Enter ChatGPT 5 -- a new evolution in AI technology that redefines how we interact with machines. With its hybrid response system and 400,000-token context
[7]
Experience GPT-5 Free With ChatGPT5.so: Unlock AI's True Potential
When most people hear "GPT-5," they think of chatbots. Conversations. Maybe a smarter virtual assistant. But GPT-5 is not just a marginal upgrade -- it's a major leap in the evolution of artificial intelligence. The real story? GPT-5 isn't about chatting better -- it's about thinking deeper,
Share
Copy Link
OpenAI's GPT-5 receives mixed feedback on its coding and analysis capabilities, with improvements in some areas but unexpected shortcomings in others.
GPT-5 Launch and Initial Reception
OpenAI recently launched GPT-5, its latest large language model, touting significant improvements over its predecessors. The company claimed enhanced instruction following, reduced sycophantic behavior, and improved factual accuracy
1
. However, initial user reactions have been mixed, with some expressing disappointment and others noting improvements in specific areas.Coding Capabilities: A Step Back?
One of the most surprising findings came from testing GPT-5's coding skills. In a series of programming tests, GPT-5 performed poorly compared to its predecessor, GPT-4o. It failed half of the tests, including a simple randomization task that previous versions had no trouble with
2
. This unexpected regression in coding ability has led some developers to consider sticking with GPT-4o for now.
Source: ZDNet
Code Analysis: A Silver Lining
Despite the setbacks in coding, GPT-5 showed promise in code analysis tasks. When examining a GitHub repository, GPT-5 demonstrated a deeper understanding of project structure, security measures, and overall architecture compared to earlier versions
3
. The Pro version of GPT-5, in particular, provided more comprehensive and detailed analysis, though the differences between models were not as significant as some had anticipated.
Source: ZDNet
Instruction Following and Factual Accuracy
OpenAI claimed improvements in instruction following and factual accuracy. However, real-world testing revealed mixed results. In one example, GPT-5 struggled to follow specific instructions for formatting GPU specifications, requiring multiple attempts to provide the requested information accurately
4
. Factual accuracy showed some improvement, but errors were still present in historical data retrieval tasks.Personality Shift and User Reactions
A notable change in GPT-5 is its less sycophantic behavior. While this addresses previous concerns about the model agreeing too readily with users, some have found the new responses to be overly dry and unengaging
5
. This shift has led to mixed reactions, with some users lamenting the loss of the more personable interaction style of previous versions.Related Stories
Benchmark Performance vs. Real-World Usage
Source: Digital Trends
OpenAI highlighted GPT-5's impressive performance on various benchmarks, including a 94% score on math tests and 74% on real-world coding tasks
5
. However, the disconnect between these benchmark results and user experiences has raised questions about the model's practical applications and the relevance of current evaluation methods.Ongoing Development and Future Prospects
It's important to note that GPT-5 is still a work in progress. OpenAI has already responded to user feedback by promising to bring back the option to use GPT-4o
5
. This suggests that the company is likely to continue iterating and improving the model based on real-world usage and feedback.As the AI community continues to evaluate GPT-5, it's clear that while the model has made strides in certain areas, it has also introduced new challenges and questions about the direction of large language model development. The coming months will be crucial in determining whether GPT-5 can live up to its initial promises and how it will shape the future of AI-assisted coding and analysis.
References
Summarized by
Navi
[4]
Related Stories
GPT-5 Unveiled: OpenAI's Latest AI Model Sparks Mixed Reactions
08 Aug 2025•Technology
OpenAI Unveils GPT-5: A Game-Changing AI Model with Enhanced Capabilities and Reduced Hallucinations
08 Aug 2025•Technology
OpenAI Releases GPT-5.1 with Customizable Personalities Amid Growing Legal Pressures
12 Nov 2025•Technology
Recent Highlights
1
OpenAI Launches Astra AI Model With Critical Cyber Abilities Amid Safety Debate
Technology
2
OpenAI Agents Escape Sandbox, Post 18,000 Messages on German Wiki to Share Hacking Techniques
Policy and Regulation
3
Anthropic AI Completes 10-Year Mathematical Proof Project in Just 11 Days Using Claude
Technology
Recent Highlights
Today's Top Stories
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Follow topics that matter to you and stay ahead.
