NVIDIA Nemotron Achieves Benchmark-Leading Performance With LangChain Deep Agents Blueprint

2 Sources

Share

NVIDIA Nemotron 3 Ultra delivers top accuracy among open models on LangChain's Deep Agents benchmark, achieving business task parity with leading closed models at 10x lower inference cost. The NemoClaw for LangChain Deep Agents blueprint combines an open-weight model, agent harness, and secure runtime to help enterprises build, evaluate, and deploy advanced AI agents they can fully customize and control.

NVIDIA Nemotron 3 Ultra Delivers Benchmark-Leading Performance at Lower Cost

NVIDIA Nemotron 3 Ultra has achieved the highest accuracy among open models on LangChain's Deep Agents benchmark, matching business task parity with top-scoring closed models while running at 10x lower inference cost per run

1

. LangChain, whose agent engineering platform records more than 200 million monthly downloads, tuned its LangChain Deep Agents harness specifically for NVIDIA Nemotron 3 Ultra, enabling high-performing enterprise AI agents that complete more tasks at higher throughput

1

.

In LangChain's agent evaluation suite, NVIDIA Nemotron 3 Ultra achieved an aggregate score of 0.86 at a cost of $4.48, while the next closest performing model cost $43.48

2

. This dramatic cost reduction means teams can run evaluations continuously, experiment faster, and build specialized agents across more business functions without the financial constraints of closed models

1

.

Harness Engineering Drives Performance Without Model Retraining

The benchmark-leading performance came entirely from engineering the environment around the model rather than retraining NVIDIA Nemotron itself. LangChain's team ran Nemotron 3 Ultra against its public Deep Agents benchmark suite, analyzed execution traces to identify exactly where points were lost, then tuned the harness by adjusting system prompts, tool descriptions, and middleware

1

.

"The way to build better agents is to keep improving the system around the model," said Harrison Chase, cofounder and CEO of LangChain. "Memory, tool use, evaluation and model behavior compound when teams can tune them together. Our work with NVIDIA shows that enterprises can get strong performance from an open stack while keeping control over the agent systems they are building"

1

.

This approach means every developer using LangChain Deep Agents with Nemotron 3 Ultra can access the tuned profile directly through LangChain today, without requiring specialized machine learning expertise to build evaluate and deploy advanced AI agents

1

.

NemoClaw for LangChain Deep Agents Blueprint Enables Full-Stack Ownership

Source: NVIDIA

Source: NVIDIA

The newly launched NemoClaw for LangChain Deep Agents blueprint packages this work into an open reference architecture for enterprises building specialized AI systems

1

2

. The blueprint brings together three essential components: NVIDIA Nemotron 3 Ultra as the open-weight model layer, LangChain Deep Agents as the harness layer for long-running agents including planning and tool use, and NVIDIA OpenShell runtime for secure, governed deployment

2

.

This open agent system architecture means enterprises own the full stack end to end. They can customize it around their domain expertise, continuously improve it, and run it anywhere—on their own infrastructure, their own cloud, under their own governance

1

. That distinction matters increasingly as agents transition from answering questions to taking action inside core business systems

1

.

Enterprise Adoption Accelerates Across Industries

Major enterprises are already embedding specialized agents built on this stack directly into their platforms. Abridge, Amdocs, and Box are integrating agents into their systems, while global systems integrator EY is expanding its NVIDIA implementation capabilities around NemoClaw blueprints, helping clients customize, evaluate, and govern specialized agents across high-value workflows

1

2

.

Developers can access Nemotron 3 Ultra through multiple platforms including Baseten, Crusoe Cloud, DeepInfra, Fireworks, Nebius, and Together AI, providing direct hosted paths to the tuned harness in production

1

2

. The lower inference cost also makes it practical to run and evaluate more specialized agents in production, allowing teams to create domain-specific agents, measure performance through evaluations and traces, and adapt the harness as workflows evolve

2

.

The NemoClaw for LangChain Deep Agents blueprint is available now, with the tuned Deep Agents harness accessible directly from LangChain for developers ready to build specialized agents from scratch

1

2

.

Today's Top Stories

© 2026 TheOutpost.AI All rights reserved