Nvidia GTC 2026: Jensen Huang shifts focus from chips to AI agents with NemoClaw launch

Reviewed byNidhi Govil

27 Sources

Share

At Nvidia's annual GTC developer conference in San Jose, CEO Jensen Huang unveiled NemoClaw, an open-source platform for building AI agents, marking a strategic pivot beyond hardware. The chipmaker also detailed its $20 billion Groq technology integration to accelerate AI inference and showcased next-generation Rubin GPUs, positioning itself as the operating system for AI's future.

Nvidia Unveils NemoClaw Platform at GTC Developer Conference

Nvidia kicked off its annual GTC developer conference in San Jose, California, on March 16, with CEO Jensen Huang delivering a two-hour keynote address to more than 18,000 attendees at the SAP Center

1

. The GPU Technology Conference, running through March 19, served as the stage for what analysts are calling Nvidia's most significant strategic shift yet—moving beyond its dominance in AI chip manufacturing to position itself as the operating system for artificial intelligence

4

.

Source: BNN

Source: BNN

The centerpiece announcement was NemoClaw, an open-source platform designed to give businesses a structured way to build and deploy AI agents—software that can carry out multistep tasks autonomously

1

. "Every company in the world should have an agentic system strategy," Jensen Huang declared during his keynote. "This is the new computer now"

4

. The chip-agnostic platform positions Nvidia to compete directly with similar offerings from companies like OpenAI, while extending its reach beyond hardware into the software layer that will define how enterprises deploy generative AI applications.

Source: ET

Source: ET

Groq Integration Addresses AI Inference Bottleneck

Nvidia's $20 billion licensing deal with Groq, finalized in December, took center stage as the chipmaker addressed one of its most pressing competitive vulnerabilities. The integration combines Nvidia's training-focused GPUs with Groq's SRAM-heavy dataflow architecture, which excels at AI inference—the process by which AI models generate responses in real time

1

. While Nvidia commands an estimated 80% share of the AI training market, it has faced intensifying competition in inference from custom chips built by Google, Amazon, and upstarts like Cerebras

1

.

Groq's technology can achieve token generation rates exceeding 500 to 1,000 tokens per second, dramatically outpacing GPU-based architectures in latency-sensitive scenarios

2

. This capability proved decisive when Cerebras won OpenAI's business earlier this year to power its Codex model—a deal that underscored the gap in Nvidia's portfolio

2

. As companies like OpenAI, Anthropic, and Meta shift from training AI models to serving hundreds of millions of users, faster and cheaper inference has become critical

3

.

New Hardware and Software Signal Computing Power Evolution

Beyond software, GTC showcased Nvidia's relentless hardware innovation. The Rubin GPUs, first revealed at CES in January, pack up to 288 GB of HBM4 memory with 22 TB/s of bandwidth and deliver 35-50 petaFLOPS of dense NVFP4 performance—a 5x uplift over current Blackwell-generation parts

2

. Available in eight-way HGX platforms or NVL72 rack systems that cram 72 Rubin SXM modules into a single configuration, these chips represent a major leap in computing power for data centers

2

.

Source: Gadgets 360

Source: Gadgets 360

However, with thermal design power estimates reaching 1.8kW or higher, liquid cooling has become mandatory—a requirement that could benefit AMD's air-cooled alternatives

2

. Speculation suggests Nvidia may release a single-die, air-cooled version with five or six HBM stacks to address buyers reluctant to invest in liquid cooling infrastructure

2

.

The conference also provided updates on the standalone Vera CPU, featuring 88 custom-Arm cores with simultaneous multithreading and confidential computing features previously exclusive to x86 platforms

2

. Meta has already begun evaluating Vera CPU for datacenter deployment, marking Nvidia's expansion beyond specialized HPC applications into mainstream computing

2

. Additional details emerged about next-generation Feynman GPUs and Kyber racks—600kW systems designed to accommodate 144 GPU sockets, each housing four Rubin Ultra GPU dies

2

3

.

Strategic Pivot Reflects Changing AI Landscape

With a market capitalization exceeding $4.3 trillion, Nvidia remains the world's most valuable listed company and central to the global AI ecosystem

3

. Nations including Saudi Arabia are building custom AI systems using its chips, and Nvidia continues as one of the few large U.S. companies releasing open-source AI software—a critical battleground in U.S.-China AI competition

3

.

Yet the NemoClaw launch signals recognition that hardware dominance alone won't secure Nvidia's future. By extending its CUDA software libraries to incorporate Groq's dataflow architecture and offering an open-source platform for AI agents, the chipmaker is building what analysts describe as a new moat

4

. The three-day event focused on AI applications across healthcare, robotics, and autonomous vehicles, with partnership announcements demonstrating Nvidia's reach across industries

1

.

Kevin Cook, senior equity strategist at Zacks Investment Research, noted that the integration of Groq founder Jonathan Ross, Groq president Sunny Madra, and other team members into Nvidia will be crucial for scaling the licensed technology

1

. As popular generative AI workloads like code assistants and agentic systems generate massive quantities of tokens at speed, Nvidia's ability to combine GPU excellence with Groq's inference capabilities could dramatically raise the performance curve while reducing cost per token

2

.

Today's Top Stories

TheOutpost.ai

Your Daily Dose of Curated AI News

Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.

© 2026 Triveous Technologies Private Limited
Instagram logo
LinkedIn logo