2 Sources
2 Sources
[1]
NVIDIA unveils brain-and-body stack to train next-gen humanoids
Together, these technologies give researchers and developers a unified, open, and accelerated robotics stack. The tools promise to speed up iteration, standardize testing, unify training with on-robot inference, and help robots transfer skills more safely from simulation to the real world. "Humanoids are the next frontier of physical AI, requiring the ability to reason, adapt and act safely in an unpredictable world," said Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA. "With these latest updates, developers now have the three computers to bring robots from research into everyday life -- with Isaac GR00T serving as robot's brains, Newton simulating their body and NVIDIA Omniverse as their training ground." The updates also underscore NVIDIA's ambition to define the standard platform for building general-purpose robots, especially humanoids, which demand precise physics and complex reasoning to function in human environments.
[2]
New NVIDIA Models Helps Robots Learn, Reason, and Act in the Real World | AIM
NVIDIA also unveiled the GB200 NVL72 system, RTX PRO servers and Jetson Thor for real-time on-robot inference. NVIDIA has released new open models and simulation libraries to support global robotics research and development. The announcement, made at the Conference on Robot Learning (CoRL) in Seoul, includes the open-source Newton Physics Engine, the Isaac GR00T N1.6 foundation model and new Cosmos world foundation models. The updates aim to accelerate the way robots learn, reason, and transfer skills from virtual to real environments. Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA, said, "Humanoids are the next frontier of physical AI, requiring the ability to reason, adapt and act safely in an unpredictable world." The Newton Physics Engine, developed with Google DeepMind and Disney Research, is now available in NVIDIA Isaac Lab. Managed by the Linux Foundation, the engine supports complex actions such as walking on uneven ground and handling delicate objects. ETH Zurich, Technical University of Munich and Peking University are among the first adopters. NVIDIA has also announced Isaac Lab - Arena, an open-source policy evaluation framework codeveloped with Lightwheel. The tool will enable large-scale testing of robotic skills in diverse simulated environments. The Isaac GR00T N1.6 model integrates NVIDIA's Cosmos Reason, which helps robots turn vague instructions into step-by-step plans using prior knowledge and physics-based reasoning. The model, available on Hugging Face, also supports multi-task operations such as opening heavy doors. NVIDIA's Cosmos world foundation models, which have been downloaded more than 3 million times, have been updated to generate large-scale training data. Cosmos Predict 2.5 and Cosmos Transfer 2.5, due soon, will offer longer video generation, multi-view outputs and faster synthetic data creation. Boston Dynamics used NVIDIA's new grasping workflow in Isaac Lab 2.3 to train its Atlas robots to improve manipulation skills. Other companies adopting NVIDIA's Isaac and Omniverse platforms include Agility Robotics, Figure AI, Franka Robotics, Techman Robot and Solomon. NVIDIA also unveiled new AI infrastructure, including the GB200 NVL72 system, RTX PRO servers and Jetson Thor for real-time on-robot inference. These tools are being adopted by partners such as Figure AI, Meta, Google DeepMind and the RAI Institute. Lebaredian added, "With these latest updates, developers now have the three computers to bring robots from research into everyday life, with Isaac GR00T serving as the robot's brain, Newton simulating their body and NVIDIA Omniverse as their training ground."
Share
Share
Copy Link
NVIDIA announces a suite of new tools and models for developing humanoid robots, including the Isaac GR00T foundation model, Newton Physics Engine, and updates to the Omniverse platform. These advancements aim to revolutionize how robots learn, reason, and act in real-world environments.
NVIDIA, a leading technology company in the field of artificial intelligence and graphics processing, has announced a suite of new tools and models aimed at revolutionizing the development of humanoid robots. This announcement, made at the Conference on Robot Learning (CoRL) in Seoul, represents a significant leap forward in the realm of physical AI and robotics
1
2
.At the core of NVIDIA's new offering is a three-pronged approach to robotics development:
Isaac GR00T (Brain): The Isaac GR00T N1.6 foundation model serves as the "brain" of the robot. This open-source model, now available on Hugging Face, integrates NVIDIA's Cosmos Reason, enabling robots to transform vague instructions into detailed, step-by-step plans. It leverages prior knowledge and physics-based reasoning to support multi-task operations, such as opening heavy doors
2
.Newton Physics Engine (Body): Developed in collaboration with Google DeepMind and Disney Research, the Newton Physics Engine simulates the robot's "body." This open-source engine, now available in NVIDIA Isaac Lab, supports complex actions like walking on uneven ground and handling delicate objects. It's managed by the Linux Foundation and has already been adopted by institutions such as ETH Zurich, Technical University of Munich, and Peking University
1
2
.NVIDIA Omniverse (Training Ground): The Omniverse platform serves as the virtual training ground for these robots, allowing developers to simulate and test robotic skills in diverse environments before deploying them in the real world
1
.NVIDIA's announcement includes several other tools and models to accelerate robotics research and development:
Isaac Lab - Arena: This open-source policy evaluation framework, co-developed with Lightwheel, enables large-scale testing of robotic skills in simulated environments
2
.Cosmos World Foundation Models: These models, which have been downloaded over 3 million times, have been updated to generate large-scale training data. Upcoming versions (Cosmos Predict 2.5 and Cosmos Transfer 2.5) will offer longer video generation, multi-view outputs, and faster synthetic data creation
2
.New AI Infrastructure: NVIDIA unveiled new hardware solutions, including the GB200 NVL72 system, RTX PRO servers, and Jetson Thor for real-time on-robot inference
2
.Related Stories
The new tools and models are already being adopted by major players in the robotics and AI fields. Boston Dynamics has used NVIDIA's new grasping workflow in Isaac Lab 2.3 to improve the manipulation skills of its Atlas robots. Other companies leveraging NVIDIA's Isaac and Omniverse platforms include Agility Robotics, Figure AI, Franka Robotics, Techman Robot, and Solomon
2
.Rev Lebaredian, Vice President of Omniverse and simulation technology at NVIDIA, emphasized the significance of these developments: "Humanoids are the next frontier of physical AI, requiring the ability to reason, adapt and act safely in an unpredictable world"
1
2
.NVIDIA's latest updates underscore the company's ambition to define the standard platform for building general-purpose robots, especially humanoids. These advancements aim to speed up iteration, standardize testing, unify training with on-robot inference, and help robots transfer skills more safely from simulation to the real world
1
.As the field of robotics continues to evolve, NVIDIA's comprehensive AI stack promises to bridge the gap between research and real-world applications, potentially bringing us closer to a future where humanoid robots can seamlessly integrate into our daily lives.
Summarized by
Navi
[1]
[2]
Analytics India Magazine
|07 Nov 2024•Technology
19 Mar 2025•Technology
12 Aug 2025•Technology