NVIDIA Unveils Comprehensive AI Stack for Next-Generation Humanoid Robots

NVIDIA Unveils Comprehensive AI Stack for Next-Generation Humanoid Robots

NVIDIA, a leader in AI and graphics processing technology, has announced a suite of new tools and models aimed at accelerating the development of advanced humanoid robots. These innovations, unveiled at the Conference on Robot Learning (CoRL) in Seoul, South Korea, represent a significant leap forward in the field of physical AI and robotics1

1

2

3

The Three-Computer Approach to Robotics

At the core of NVIDIA's strategy is a three-computer approach to building robots:

1. Blackwell DGX or HGX AI systems for training physical AI models
2. RTX PRO servers and Omniverse with Cosmos for simulation and testing
3. Jetson AGX Thor, powered by Blackwell, for on-robot inference

This architecture provides researchers and developers with a unified, open, and accelerated robotics stack, designed to speed up iteration, standardize testing, and facilitate the safe transfer of skills from simulation to the real world1

1

2

Key Components of the New Robotics Stack

Isaac GR00T N1.6 Foundation Model

The latest version of NVIDIA's Isaac GR00T, now available on Hugging Face, incorporates Cosmos Reason, a vision language model that enables human-like reasoning in humanoid robots. This integration allows robots to break down complex instructions, execute tasks using prior knowledge, and perform multi-task operations such as opening heavy doors while carrying items2

2

3

Newton Physics Engine

Developed in collaboration with Google DeepMind and Disney Research, the open-source Newton Physics Engine is now available in NVIDIA Isaac Lab. Managed by the Linux Foundation, it supports complex actions like walking on uneven ground and handling delicate objects. Early adopters include prestigious institutions such as ETH Zurich, Technical University of Munich, and Peking University3

3

Related Stories

NVIDIA Unveils Advanced AI and Simulation Tools to Accelerate Robot Learning and Humanoid Development

NVIDIA Unveils Cosmos Reason and Advanced AI Models for Robotics and Physical AI Applications

Nvidia Unveils Groot N1: A Groundbreaking Foundation Model for Humanoid Robotics

Nvidia Unveils Isaac GR00T Blueprint: A Leap Forward in Humanoid Robotics Development

Cosmos World Foundation Models

NVIDIA has updated its Cosmos world foundation models, which have been downloaded over 3 million times. The upcoming Cosmos Predict 2.5 and Cosmos Transfer 2.5 versions promise longer video generation, multi-view outputs, and faster synthetic data creation. These models are crucial for generating large-scale training data, reducing reliance on real-world data collection2

2

3

Industry Adoption and Partnerships

Several prominent companies and organizations are already adopting NVIDIA's new robotics technologies:

• Boston Dynamics used NVIDIA's grasping workflow in Isaac Lab 2.3 to improve manipulation skills for its Atlas robots
• Agility Robotics, Figure AI, Franka Robotics, Techman Robot, and Solomon are integrating NVIDIA's Isaac and Omniverse platforms
• Meta, Google DeepMind, and the RAI Institute are adopting NVIDIA's new AI infrastructure2

  2

  3

  3

The Future of Humanoid Robotics

Rev Lebaredian, Vice President of Omniverse and simulation technology at NVIDIA, emphasized the significance of these developments: "Humanoids are the next frontier of physical AI, requiring the ability to reason, adapt and act safely in an unpredictable world." He added that with these updates, developers now have the necessary tools to bring robots from research into everyday life1

1

2

3

As the "era of robot reasoning" begins, NVIDIA's comprehensive approach to physical AI and robotics is poised to play a crucial role in shaping the future of humanoid robots, potentially revolutionizing various industries and applications in the coming years.