Nvidia Unveils Jetson Orin Nano Super: A Powerful, Affordable AI Computer for Developers

Nvidia Upgrades Low-Cost Jetson AI Computer -- More Power for Half the Price - Decrypt

Good news for AI developers and hobbyists: Nvidia just made it a lot cheaper to build AI-powered robots, drones, smart cameras and other gadgets that need a brain. The company's new Jetson Orin Nano Super, announced Tuesday and available now, packs more processing muscle than its predecessor while costing half as much at $249. The palm-sized computer delivers a 70% performance boost, reaching 67 trillion operations per second for AI tasks. That's a significant jump from earlier models, especially for powering things like chatbots, computer vision, and robotics applications. "This is a brand new Jetson Nano Super. Almost 70 trillion operations per second, 25 watts and $249," Nvidia CEO Jensen Huang said in an official video reveal from his kitchen. "It runs everything the HGX does, it even runs LLMs." Memory bandwidth also got a major upgrade, increasing to 102 gigabytes per second, 50% faster than the previous generation of the Jetson. This improvement means the device can handle more complex AI models and process data from up to four cameras simultaneously. The device comes with Nvidia's Ampere architecture GPU and a 6-core ARM processor, allowing it to run multiple AI applications at once. This gives developers the potential to work with more varied competences, like building small models for robots capable of things like mapping environment, object recognition, and voice commands with low processing power. Existing Jetson Orin Nano owners aren't left out in the cold either. Nvidia is releasing software updates to increase efficiency of its legacy AI processors. The numbers behind Nvidia's new Jetson Orin Nano Super tell an interesting story. With just 1,024 CUDA cores, it looks modest compared to the RTX 2060's 1,920 cores, the RTX 3060's 3,584, or the RTX 4060's 3,072. But raw core count doesn't tell the whole story. While gaming GPUs like the RTX series guzzle between 115 and 170 watts of power, the Jetson sips a mere 7 to 25 watts. That's about one-seventh the power consumption of an RTX 4060 -- the most efficient of the bunch. Memory bandwidth numbers paint a similar picture. The Jetson's 102 GB/s might look underwhelming next to the RTX cards' 300+ GB/s, but it's optimized specifically for AI workloads at the edge, where efficient data processing matters more than raw throughput. That said, the real magic happens in AI performance. The device cranks out 67 TOPS (trillion operations per second) for AI tasks -- a number that's hard to compare directly with RTX cards' TFLOPS since they measure different types of operations. But in practical terms, the Jetson can handle tasks like running local AI chatbots, processing multiple camera feeds, and controlling robots -- all simultaneously on a power budget that could barely run a gaming GPU's cooling fan, basically being neck-and-neck against an RTX 2060 at a fraction of the cost and a fraction of the power consumption. It's 8GB of shared memory may seem low, but it means it's more capable than a normal RTX 2060 when it comes to running local AI models like Flux or Stable Diffusion which may throw an "out of memory" error on those GPUs, or offload part of the work to normal RAM, reducing the inference time -- basically the AI thinking process. The Jetson Orin Nano Super also supports various small and large language models, including those with up to 8 billion parameters, such as the Llama 3.1 model. It can generate tokens at a rate of approximately 18-20 per second when using a quantized version of these models. A bit slow, but still good enough for some local applications. Still, it's an improvement over the previous generation of Jetson AI hardware models. Given its price and characteristics, the Jetson Orin Nano Super is primarily designed for prototyping and small-scale applications. For power users, businesses or applications requiring extensive computational resources, the device's capabilities may feel limiting compared to higher-end systems that cost much more and require a lot more power.

Nvidia unveils palm-sized AI supercomputer for $249

In brief: As the AI landscape continues to evolve, the impact of devices like the Jetson Orin Nano Super on democratizing AI development could play an important role. However, its real-world performance will only become clear with time and extensive use by the developer community. Nvidia, known for its graphics processing units, has announced a new addition to its line of AI development tools: the Jetson Orin Nano Super Developer Kit, a palm-sized generative AI supercomputer available for $249, half the cost of its $499 predecessor. Aimed at AI developers, hobbyists, and students, the kit boasts impressive performance claims, including 67 INT8 TOPS (trillion operations per second), which is a 70% increase over the previous model. The company also reports a 50% boost in memory bandwidth, now reaching 102 GB/s, and up to a 1.7x improvement in generative AI inference performance. The Jetson Orin Nano enables real-time decision-making and responsiveness when processing data locally on devices. At the core of the Jetson Orin Nano Super is an Nvidia Ampere architecture GPU with tensor cores, paired with a 6-core Arm CPU. This combination allows for multiple concurrent AI application pipelines and high-performance inference, according to Team Green. The kit supports up to four cameras and offers higher resolution and frame rates compared to earlier versions. Nvidia emphasizes the kit's versatility, suggesting its suitability for creating large language model (LLM) chatbots, visual AI agents, and AI-based robots. However, these capabilities have yet to be independently verified. Interestingly, Nvidia states that existing Jetson Orin Nano Developer Kit owners can access similar performance gains through a software update to the JetPack SDK. This move potentially extends the lifespan of older hardware but raises questions about the necessity of purchasing new hardware for some users. The kit comes with extensive software support, including Nvidia AI tools such as Isaac for robotics, Metropolis for vision AI, and Holoscan for sensor processing. The company also highlights community support and tutorials available through the Nvidia Jetson AI lab. While Nvidia's announcement focuses on the kit's potential for generative AI applications, it's worth noting that the practical applications and limitations of such a compact device in this rapidly evolving field remain to be seen. On the other hand, the release of this more affordable, higher-performance kit could potentially lower the barrier to entry for AI development. Its release comes at a time of increasing interest in edge AI computing - a trend driven by demands for lower latency, improved privacy, and reduced bandwidth usage in AI applications. The edge AI market is experiencing rapid growth, with projections indicating an increase from $20.45 billion in 2023 to $269.82 billion by 2032, at a compound annual growth rate of 33.3%.

Nvidia's $249 dev kit promises cheap, small AI power

Nvidia announced the latest in its Jetson Orin Nano AI computer line, the Jetson Orin Nano Super Developer Kit. Sort of like a Raspberry Pi but for powerful AI processing, the tiny $249 computer packs more of an AI processing punch than the kit did before -- for half the price. It's available to buy now. The Jetson Nano line has been a low-cost way for hobbyists and makers to power AI and robotics projects since its introduction in 2019. Nvidia says the Nano Super's neural processing is 70 percent higher, at 67 TOPS, than the 40 TOPS Nano. It also has 50 percent more memory bandwidth, at 102GB/s, which should speed up those operations. The Jetson Orin Nano Super kit uses essentially the same hardware as the original Orin Nano kit, and the company says it will get the same performance gains with a new JetPack update. Nvidia says the boost comes from "a new power mode which increases the GPU, memory, and CPU clocks." Nvidia's Jensen Huang showed off the Nano Super in a video: The developer kit includes a reference carrier board and a Jetson Orin Nano 8GB system-on-module, comprised of an Nvidia Ampere GPU with tensor cores and 6-core Arm CPU. Nvidia calls the Nano Super Developer Kit "an ideal solution" for building chatbots or visual AI agents, as well as AI-based robots.

NVIDIA's latest compact generative AI supercomputer is also its cheapest

The NVIDIA Jetson Orin Nano Super Developer Kit is designed for both hobbyists and commercial AI developers. NVIDIA has just revealed the Jetson Orin Nano Super Developer Kit, which is the successor to its from 2022. This new compact generative AI supercomputer can fit into the palm of your hand. Included in the developer kit is an 8GB Jetson Orin Nano system-on-module and a reference carrier board. In terms of performance, the Jetson Orin Nano Super can reach 68 trillion operations per second (TOPS), a 70 percent increase from its predecessor. NVIDIA also claims a 1.7 times improvement in generative AI inference performance and a 50 percent bandwidth increase to 102GB per second. As for CPU frequency, it's now 1.7GHz, a modest bump compared to its predecessor's 1.5GHz. NVIDIA also claims that it "delivers gains" for all popular generative AI models. These include large language models (LLMs), vision language models and vision transformers. The Jetson Orin Nano Super's software updates can also boost its predecessor, which is great news if you have the original Jetson Orin Nano. All you need to do is to download the software and install the update. That said, NVIDIA didn't give any specifics on how the older device's performance would change. The Jetson Orin Nano Super Developer Kit is currently available from NVIDIA-approved resellers. It's currently just $249, down from its predecessor's $499, making it the most affordable product of its kind right now.

Nvidia Introduces a Compact Generative AI Supercomputer for Developers

Nvidia said the AI computer supports popular AI models The Nvidia Jetson Orin Nano Super is priced at $249 (roughly Rs. 21,150) The supercomputer offers 67 INT8 TOPS of performance Nvidia unveiled a new compact artificial intelligence (AI) supercomputer on Tuesday. Dubbed Jetson Orin Nano Super, it is the successor of the Jetson Orin Nano which was launched in March 2023. The tech giant claimed that the new AI hardware offers increased performance, a software upgrade, and lower pricing compared to the predecessor. The AI computer is available as a developer kit, and the company said it can be useful for developers, hobbyists, and students who want to learn and build AI-based tools. In a blog post, Nvidia detailed its latest AI computer. It was also showcased in a video by CEO Jensen Huang. The Jetson Orin Nano Super is a palm-sized robotics processor that is optimised to run AI inferences, build large language model (LLM) tools, and even for robotics workflows. The AI computer is priced at $249 (roughly Rs. 21,150). Notably, the latest processor costs less than its predecessor which was priced at $499 (roughly Rs. 42,380). The new AI processor is said to deliver a 1.7x increase in generative AI inference performance. Nvidia claimed it also offers a 70 percent increase in performance to 67 8-bit Integer Tera Operations Per Second (INT8 TOPS) compared to last year's processor. Additionally, the memory bandwidth is also said to be increased to 102GBps, a 50 percent gain compared to the predecessor. Apart from hardware improvements, the tech giant is also adding software updates to the AI supercomputer, which is said to further optimise its performance. Nvidia said that the AI computer is efficient at creating retrieval-augmented generation-based chatbots that leverage LLMs, building visual AI agents, or deploying AI-powered robots. The main advantage of the Nvidia Jetson Orin Nano Super over other AI PCs is that it can handle foundation models and allows developers to build tools and agents that are diverse and can be used for general purposes. With the developer kit, the company is offering a Jetson Orin Nano 8GB system-on-module (SoM) and a reference carrier board. The SoM features a Nvidia Ampere architecture GPU with tensor cores and a six-core ARM CPU. The processor can also support up to four cameras for working with AI vision models.

Nvidia: $249 Palm-Sized Supercomputer Is a Game-Changer for AI Hobbyists

Nvidia today unveiled its most affordable supercomputer yet, the $249 Jetson Orin Nano Super. This tiny device, which fits in the palm of your hand, can help hobbyists, students, and small businesses power their own large language models, build AI agents, and deploy AI-based robots. It's best suited "for those interested in developing skills in generative AI, robotics or computer vision" who want to "transform ideas into reality," says Nvidia. In a brief promo video, CEO Jensen Huang says the Jetson Orin Nano Super "runs everything that the HGX does," referring to the Nvidia HGX AI Supercomputer. It can handle "almost 70 trillion operations per second," or 67 INT8 TOPS, while only drawing 25 watts of power. Compared with its predecessor, the Nano Super has 50% more memory at 1023GB/S. "General humanoid robotics are nearly upon us," says Huang. Those who already own the Jetson Orin Nano Developer Kit can boost its performance to meet that of the new offering with a software update. Though the hardware remains the same, the update enables a new power mode, which increases the GPU, memory, and CPU clocks. That developer kit is being renamed the Jetson Orin Nano Super Developer Kit. Although the Jetson Orin Nano Super brings much more power into hobbyist homes, it's still a far cry from the 200,000 H100 and H200 Nvidia GPUs powering Elon Musk's supercomputer, which he eventually wants to expand to 1 million. Still, it could make generative AI more accessible and affordable to the masses. Nvidia is also rumored to be releasing two next-gen graphics gaming cards at CES 2025, the RTX 5090 and the RTX 5080 for its Predator Orion 7000 desktop systems.

NVIDIA Unveils Budget-Friendly "Jetson Orin Nano Super" Developer Kit, Targeting Commercial AI Development

NVIDIA has unveiled a "mini-supercomputer" for enthusiasts out there, the "Jetson Orin Nano Super," which features exceptional AI performance with a sweet price tag. Well, the AI hype is out there and kicking, and with commercial AI seeing massive development, hardware manufacturers would certainly present solutions that are more common to a broader audience, especially in terms of budget. The new Jetson Orin Nano Super from NVIDIA targets individuals looking to get their hands on decent AI computing power without breaking the bank. "Budget releases" by NVIDIA are often a shocker, but the newest Orin product looks excellent for commercial AI developers. Diving a bit into specifications, the mini-supercomputer features the six-core ARM Cortex-A78E, which comes up to a 1.7 GHz boost clock and much more. Apart from this, the device offers NVIDIA's Ampere GPU with 1024 CUDA cores and 32 Tensor cores, which is instead a low-tier offering and is only ample for running the device in normal use cases. With an onboard 8 GB LPDDR5 memory and TDP of up to 25W, the Jetson Orin Nano Super is designed to focus more on AI computational performance, which we'll discuss next. According to NVIDIA, the device comes with 67 TOPS INT8 performance, a 70% increase from the predecessor. Not only this, but the onboard 102 GB/s memory bandwidth is also a 50% increase from the previous-gen device, and when factoring in the leaps, the Jensen Orin Nano Super becomes a great option for computational needs. NVIDIA has also upscaled the Jetson lineup's software ecosystem, so the company has factored in a 1.7X generative AI performance boost for the Orin NX and Orin Nano series. In terms of pricing, the supercomputer is available for just $249, which is surely an attractive price tag when you consider the device's performance. And since it is rare for NVIDIA to release products at such prices, the Jetson Orin Nano Super surely becomes something to look out for if you are in for budget AI performance.

Nvidia launches most affordable generative AI supercomputer at $249

Priced at $249, down from its original $499 tag, it promises impressive advancements in performance. This latest developer kit offers up to 1.7 times the inference performance for generative AI tasks compared to its predecessor. It features a 70% boost in performance, reaching 67 INT8 TOPS, and an increase in memory bandwidth to 102 GB/s -- improvements that will help users in various AI applications, including creating chatbots, building visual AI agents, and deploying robots. For users who already own the Jetson Orin Nano Developer Kit, exciting software updates will enhance generative AI performance, enabling them to take full advantage of these capabilities without purchasing new hardware. The Jetson Orin Nano Super is designed for those looking to develop skills in fields like generative AI, robotics, and computer vision. As the industry shifts from task-specific to foundation models, this kit provides a valuable platform for turning innovative ideas into real-world applications.

NVIDIA Launches Jetson Orin Nano Super with 1.7x Inference Boost at $249

The device offers up to a 1.7x boost in generative AI inference performance and supports popular models for developers, hobbyists, and students. NVIDIA has introduced its new Jetson Orin Nano Super Developer Kit, a compact generative AI supercomputer priced at $249, down from the earlier price of $499. The device offers up to a 1.7x boost in generative AI inference performance and supports popular models for developers, hobbyists, and students. The Jetson Orin Nano Super delivers improved performance with 67 INT8 TOPS, a 70% increase compared to its predecessor, and a memory bandwidth of 102GB/s, a 50% jump. "Almost 70 trillion operations per second, 25 watts, and just $249. It runs everything the HGX does, including large language models," said NVIDIA chief Jensen Huang. Available starting today, the kit supports applications including LLM chatbot development, visual AI systems, and AI-driven robotics. "The enhanced performance of the Jetson Orin Nano Super provides gains for all popular generative AI models and transformer-based computer vision," NVIDIA said in a statement. The developer kit includes a Jetson Orin Nano 8GB system-on-module (SoM) and a reference carrier board for edge AI application prototyping. The SoM features an NVIDIA Ampere architecture GPU with tensor cores and a 6-core Arm CPU, supporting multiple AI application pipelines and up to four cameras with improved resolution and frame rates. Existing Jetson Orin Nano Developer Kit owners can unlock similar performance gains by upgrading their software. "The software updates available to the new Jetson Orin Nano Super will also boost generative AI performance for those who already own the Jetson Orin Nano Developer Kit," NVIDIA said. The Jetson ecosystem includes NVIDIA AI tools such as Isaac for robotics, Metropolis for vision AI, and Holoscan for sensor processing. NVIDIA also provides resources like the Omniverse Replicator for synthetic data generation and the TAO Toolkit for fine-tuning pre-trained AI models. The Jetson platform benefits from support across NVIDIA's AI community, including tutorials and contributions from developers. NVIDIA noted that partners offer additional AI tools, developer support, cameras, and carrier board solutions for customised development. "The updates will extend to the Jetson Orin NX and Orin Nano series, allowing developers to access boosted generative AI performance across the board," the company added. The new performance upgrades can be enabled today by updating to the latest JetPack SDK.

Nvidia rings in the holidays with a cheaper AI dev board

'Super' edition promises 67 TOPS and 102GB/s of memory bandwidth for your GenAI projects Nvidia is bringing the AI hype home for the holidays with the launch of a tiny new dev board called the Jetson Orin Nano Super. Nvidia cheekily bills the board as the "most affordable generative AI supercomputer," though that might be stretching the term quite a bit. The dev kit consists of a system on module, similar to a Raspberry Pi Compute Module, that sits atop a reference carrier board for I/O and power. And, just like a Raspberry Pi, Nvidia's diminutive dev kit is aimed at developers and hobbyists looking to experiment with generative AI. Under the hood, the Orin Nano features six Arm Cortex-A78AE cores along with an Nvidia GPU based on its older Ampere architecture with 1024 CUDA cores and 32 tensor cores. The design appears to be identical to the original Jetson Orin Nano. However, Nvidia says the "Super" edition of the board is both faster and less expensive, coming in at $249 versus the original $499 price tag. In terms of performance, the Jetson Orin Nano Super packs 67 TOPS at INT8, which is faster than the NPUs in any of Intel, AMD, or Qualcomm's latest AI PCs backed by 8GB of LPDDR5 memory capable of 102GB/s of memory bandwidth. According to Nvidia, these specs reflect a 70 percent uplift in performance and 50 percent more memory bandwidth than its predecessor. The bandwidth boost is particularly important for those looking to play with the kind of large language models (LLMs) that power modern AI chatbots at home. At 102GB/s, we estimate the dev kit should be able to generate words at around 18-20 tokens a second when running a 4-bit quantized version of Meta's 8-billion-parameter Llama 3.1 model. If you're curious about how TOPS, memory capacity, and bandwidth relate to model performance, you can check out our guide here. For I/O, the dev kit's carrier board features the usual fare of connectivity for an SBC, including gigabit Ethernet, DisplayPort, four USB 3.2 Gen 2 type-A ports, USB-C, dual M.2 slots with M and E keys, along with a variety of expansion headers. In terms of software support, you might think those Arm cores might be problematic; however, that really isn't the case. Nvidia has supported GPUs on Arm processors for years, with its most sophisticated designs - the GH200 and GB200 - utilizing its custom Arm-based Grace CPU. This means you can expect broad support for the GPU giant's software suite including Nvidia Isaac, Metropolis, and Holoscan, to name a few. Along with a variety of open AI models available via Nvidia's Jetson AI lab, the dev kit also supports up to four cameras for robotics or vision processing workloads. Alongside the new dev kit, Nvidia is also rolling out a software update to its older Jetson Orin NX and Nano system on modules, which it says should boost GenAI performance by 1.7x, so if you already picked up an Orin Nano, you shouldn't be missing out on too much. ®

NVIDIA unveils affordable AI supercomputer that fits in the palm of a hand

NVIDIA has taken to its website to unveil its latest compact generative AI system that's designed to provide a development platform from commercial AI developers to mere hobbyists looking to explore the capabilities of generative AI. NVIDIA, the company powering the mass push into AI-infused software, has announced the new NVIDIA Jetson Orin Nano Super Developer Kit, which provides as much as a 1.7x leap in generative AI interference performance, along with a 70% increase in performance to 67 INT8 TOPS. Additionally, NVIDIA has increased the Jetson Orin Nano Super's memory bandwidth by as much as 50% compared to its predecessor, bringing its total memory bandwidth to 102GB/s. Moreover, if you are upset because you already own a Jetson Orin Nano and now want the performance of the Super variant, NVIDIA can get you partially the way there as the company explains in its announcement the software updates to the Super variant will benefit performance on the Jetson Orin Nano. NVIDIA writes the developer kit consists of a Jetson Orin Nano 8GB system-on-module (SoM), along with a reference carrier board designed for prototyping AI applications. More specifically, the SoM features an NVIDIA Ampere-based architecture GPU, a 6-core Arm CPU, and support for up to four cameras.

Nvidia launches Jetson Orin Nano Super, a powerful AI brain for robotics and edge - SiliconANGLE

Nvidia launches Jetson Orin Nano Super, a powerful AI brain for robotics and edge Nvidia Corp. today launched a new compact generative artificial intelligence developer kit with the Jetson Orin Nano Super, which fits into the palm of a hand and provides commercial AI developers, hobbyists and students access to powerful robotics and edge AI compute at low cost. Nvidia Jetson Orin is a family of compact energy-efficient AI supercomputers that can power autonomous robots, machines and other networked edge systems. Using Nvidia Ampere graphics processing unit architecture, deep learning and vision AI accelerators, fast memory and multimodal sensor support they support multiple industry use cases for robotics, detectors and network operations. The Jetson Orin Nano Super delivers a 1.7-times leap in generative AI inference performance in model deployment over the previous generation of Orin Nano, Nvidia said, representing a 70% performance increase and a 50% increase in memory bandwidth. Nvidia said in the announcement that the solution is ideal for creating large language model chatbots based on retrieval-augmented generation, building a visual AI agent or deploying AI-based robots. The developer kit consists of a Jetson Orin Nano 8 gigabyte system-on-module and a reference carrier board. That provides a platform for prototyping hardware applications and reference architecture for edge AI applications. The price of the developer kit is now $249, down from $499. This should put it in the hands of more developers, students and engineers, making it more available in the market. "It's like we've taken Orin Nano and added a cape to make it a superhero," said Deepu Talla, vice president and general manager of embedded and edge computing at Nvidia, referring to the "Super" part of Orin Nano Super. "Superhero comes from two things: one, 70% performance improvement and, two, half the price. So, the overall improvement is three-and-a-half times better than before." The company also announced software updates for users of current Jetson Orin Nano Developer Kits that will boost performance for developers. The software updates available for the Super will boost inference for earlier versions of the Orin Nano. The software updates accelerate generative AI performance for Jetson Orin NX and Orin Nano series systems by around 1.7x, Nvidia said. According to Nvidia, the Orin Nano Super is capable of running almost any popular generative AI model and transformer-based computer vision model from Alibaba Group Holding Ltd., Google LLC, Hugging Face, Meta Platforms Inc., Microsoft Corp., OpenAI and more. That makes the developer kit the perfect platform to build and design robotics and internet of things applications to use AI models in the field for autonomous applications such as autonomous vehicles or robots.

NVIDIA Unveils Its Most Affordable Generative AI Supercomputer

The Jetson Orin Nano Super delivers up to a 1.7x gain in generative AI performance, supporting popular models for hobbyists, developers and students. NVIDIA is taking the wraps off a new compact generative AI supercomputer, offering increased performance at a lower price with a software upgrade. The new NVIDIA Jetson Orin Nano Super Developer Kit, which fits in the palm of a hand, provides everyone from commercial AI developers to hobbyists and students, gains in generative AI capabilities and performance. And the price is now $249, down from $499. Available today, it delivers as much as a 1.7x leap in generative AI inference performance, a 70% increase in performance to 67 INT8 TOPS, and a 50% increase in memory bandwidth to 102GB/s compared with its predecessor. Whether creating LLM chatbots based on retrieval-augmented generation, building a visual AI agent, or deploying AI-based robots, the Jetson Orin Nano Super is an ideal solution to fetch. The Gift That Keeps on Giving The software updates available to the new Jetson Orin Nano Super will also boost generative AI performance for those who already own the Jetson Orin Nano Developer Kit. Jetson Orin Nano Super is suited for those interested in developing skills in generative AI, robotics or computer vision. As the AI world is moving from task-specific models into foundation models, it also provides an accessible platform to transform ideas into reality. Powerful Performance With Super for Generative AI The enhanced performance of the Jetson Orin Nano Super delivers gains for all popular generative AI models and transformer-based computer vision. The developer kit consists of a Jetson Orin Nano 8GB system-on-module (SoM) and a reference carrier board, providing an ideal platform for prototyping edge AI applications. The SoM features an NVIDIA Ampere architecture GPU with tensor cores and a 6-core Arm CPU, facilitating multiple concurrent AI application pipelines and high-performance inference. It can support up to four cameras, offering higher resolution and frame rates than previous versions. Extensive Generative AI Software Ecosystem and Community Generative AI is evolving quickly. The NVIDIA Jetson AI lab offers immediate support for those cutting-edge models from the open-source community and provides easy-to-use tutorials. Developers can also get extensive support from the broader Jetson community and inspiration from projects created by developers. Jetson runs NVIDIA AI software including NVIDIA Isaac for robotics, NVIDIA Metropolis for vision AI and NVIDIA Holoscan for sensor processing. Development time can be reduced with NVIDIA Omniverse Replicator for synthetic data generation and NVIDIA TAO Toolkit for fine-tuning pretrained AI models from the NGC catalog. Jetson ecosystem partners offer additional AI and system software, developer tools and custom software development. They can also help with cameras and other sensors, as well as carrier boards and design services for product solutions. Boosting Jetson Orin Performance for All With Super Mode The software updates to boost 1.7X generative AI performance will also be available to the Jetson Orin NX and Orin Nano series of systems on modules. Existing Jetson Orin Nano Developer Kit owners can upgrade the JetPack SDK to unlock boosted performance today.

Nvidia Launches New Affordable AI Kit for Developers and Hobbyists

Software updates available to existing Jetson Orin Nano Developer Kit owners. Nvidia has launched the Jetson Orin Nano Super Developer Kit, a compact generative AI supercomputer designed for developers, hobbyists, and students. Priced at USD 249 (down from USD 499), the new kit delivers a 1.7x increase in generative AI inference performance and a 70 percent boost to 67 INT8 TOPS. Additionally, it provides a 50 percent increase in memory bandwidth, now reaching 102 GBps compared to its predecessor, Nvidia said on Tuesday. Also Read: iGenius and Nvidia to Build AI Supercomputer for Highly Regulated Sectors The kit features a Jetson Orin Nano 8GB system-on-module (SoM) with an Nvidia Ampere GPU with tensor cores, a 6-core Arm CPU, and support for up to four cameras with enhanced resolution and frame rates. According to Nvidia, the platform is ideal for developing generative AI models, LLM-based chatbots, computer vision systems, and AI-powered robotics. "Whether creating LLM chatbots based on retrieval-augmented generation, building a visual AI agent, or deploying AI-based robots, the Jetson Orin Nano Super is an ideal solution to fetch," Nvidia said. Existing owners of the Jetson Orin Nano Developer Kit can unlock the same performance upgrades through a software update via the JetPack SDK. Jetson runs Nvidia AI software including Isaac for robotics, Metropolis for vision AI and Holoscan for sensor processing. Nvidia says development time can be reduced with Omniverse Replicator for synthetic data generation and TAO Toolkit for fine-tuning pre-trained AI models from the NGC catalogue. The software updates to boost 1.7X generative AI performance will also be available to the Jetson Orin NX and Orin Nano series of systems on modules, the official release said. Also Read: Nvidia and Partners Develop AI Model to Predict Future Glucose Levels in Individuals "Jetson Orin Nano Super is suited for those interested in developing skills in generative AI, robotics or computer vision. As the AI world is moving from task-specific models into foundation models, it also provides an accessible platform to transform ideas into reality," Nvidia added.

NVIDIA unveils palm-sized $249 AI computer for robotics By Investing.com

On Tuesday, NVIDIA (NASDAQ:NVDA)'s CEO Jensen Huang introduced the Jetson Orin Nano, a new compact AI computer designed for robotics and on-device AI processing. This small yet powerful device offers a substantial 70 TOPS (INT8) of computing performance and is equipped with advanced features to support large language models (LLMs). The Jetson Orin Nano is priced at $249 and provides 102GB/s of memory bandwidth while operating on a mere 25 watts of power. Huang showcased the Jetson Orin Nano in a video, highlighting its compact size, which is small enough to fit in the palm of a hand. He emphasized the evolution of NVIDIA's processors, starting with Xavier, and the company's vision for robotics. The Nano is a continuation of this vision, aiming to power a variety of robots, from wheeled to humanoid. The CEO pointed out that the Jetson Orin Nano is capable of running the same applications as the larger HGX platform, including CUDA and CUDANN, and TensorRT. This versatility makes it suitable for a range of uses, from robots to workstations. Huang expressed excitement for the potential of the Jetson Orin Nano to foster innovation in robotics and AI. With its ability to run large language models and support for NVIDIA's suite of AI and robotics software, the Jetson Orin Nano is positioned as an accessible yet powerful tool for developers and researchers. Huang's announcement indicates that the device is widely available for purchase, encouraging enthusiasts and professionals alike to explore the capabilities of this new AI computer. NVIDIA's latest offering reflects the company's ongoing commitment to advancing AI and robotics technology. The Jetson Orin Nano is set to enable a new level of creativity and development in the field, with its high performance, low power consumption, and affordability.

Nvidia's Jetson Orin Nano Supercomputer for Generative AI Revealed - Video

Nvidia's Jensen Huang shows off the company's new $249 Jetson Ori Nano meant for developers, students and builders in the generative AI Space. Hi, welcome to my house. I'm living in a different house now. Uh, we're fixing the house that you guys saw the last time you were in my kitchen, and let's see what were we doing. My hair was a lot longer, and I lifted a brand new HGX out of my oven, while I'm cooking something up for you again today, and let me show it to you. OK, here we go. Ladies and gentlemen, our brand new AI computer. Look at this. I think I might have cooked it a little bit too long, it shrunk. The little tiny Judson Nano. Little or computer. This thing that's really amazing is that um a long time ago, starting with the Xavier, you guys might have known that we created a brand new type of processor. It was a robotics processor. Nobody understood what we were building at the time, and we imagined that someday these deep learning models would evolve and we would have, you know, robots of all kinds. Everything that moves would be robotic and. And now here we are, uh, we're seeing all kinds of amazing robots, robots on wheels, robots on legs, 2 legs, 3 legs, and of course, general humanoid robotics are nearly upon us. This is a brand new Jetson Nano Super. Almost 70 trillion operations per second. 25 watts. And $249. It runs everything that the HGX does, uh, even runs large language models, and uh can't wait for all of you to try it. It's available everywhere. Go get it. Enjoy robotics. And it runs Kuda and K and in. And tensor you could create an agenttic AI that reasons and plans, so you could use it for a robot, you could use it for workstation. It's an incredible computer. What do you guys think? Hm.

The robots are coming! And Nvidia is going to power them with a revamped Jetson and lower price - SiliconANGLE

The robots are coming! And Nvidia is going to power them with a revamped Jetson and lower price 'Tis the season to ponder what to get that someone in your life who has everything. If you haven't finished your Christmas shopping and have $249 to spend for a piece of technology about four inches wide, three-and-a-half inches high, and 1.3 inches thick, then Nvidia Corp. has the perfect gift. The tech giant introduced the Jetson Orin Nano Super Developer Kit this week. Though that's a big name for such a small product, don't be fooled. The latest innovation from Nvidia packs a big wallop in its little package. The Jetson Orin Nano Super Developer Kit is a small but mighty artificial intelligence computer that the company says "redefines AI for small edge devices." And by mighty, the new product delivers up to 67 tera operations per second of AI performance. That's a 1.7-times increase over its predecessor, the Jetson Orin Nano. But if you already bought the original model, which sold for $499 and debuted just 18 months ago, don't worry. The team at Nvidia isn't pulling a Grinch move. A free software upgrade for all original Jetson Orin owners turns those devices into the new Super version. The developer kit comprises an 8-gigabyte Jetson Orin Nano module and a reference carrier that accommodates all Orin Nano and Nvidia Orin NX modules. The company says this kit is "the ideal platform for prototyping your next-gen edge-AI product." The 8GB module boasts an Ampere architecture graphics processing unit and a six-core Arm central processing unit, which enables multiple concurrent AI application pipelines. The platform runs Nvidia AI software stack and includes application frameworks for multiple use cases, including robotics, vision AI and sensor processing. Deepu Talla, Nvidia's vice president and general manager of robotics and edge computing, briefed industry analysts before the Dec. 17 announcement. He called the new Jetson Orin Nano Super Developer Kit "the most affordable and powerful supercomputer we build." Talla said the past two years saw generative AI "take the world by storm." Now, he said, we're witnessing the birth of agentic AI. "With agentic AI, most agents are in the digital world. And the same technology now can be applied to the physical world, and that's what robotics is about," he said. "We're taking the Orin Nano Developer Kit and putting a cape on it to make it a superhero." And what superpowers will the Jetson Orin Nano Super Developer Kit have? In addition to increasing performance from 40 to 67 TOPS, the new kit will have much more memory bandwidth -- from 68 to 102 gigabytes per second, a 70% increase. "This is the moment we've been waiting for," said Talla. Nvidia is increasing performance significantly on the same hardware platform by supercharging the software. "We designed [the original Orin Nano system] to be field upgradeable. As generative AI became popular and we did all the different testing, we can support all the old systems in the field without changing the hardware, just through software updates." On the call, Talla mentioned that the total available market for robots, also known as physical AI, is about half the world's gross domestic product, or about $50 trillion. Is it that big? It's hard to quantify, but I do believe the opportunity is massive. Robots represent the next frontier in agentic AI because they combine a physical form factor with advanced decision-making capabilities, bridging the gap between virtual intelligence and the real world. Unlike purely virtual AI systems, robots can interact with their environment, perform tasks and adapt to dynamic situations, making them critical for solving complex real-world problems. Their ability to act autonomously while continuously learning from their surroundings allows them to tackle challenges that are difficult for traditional software and sometimes people. In fields such as healthcare, logistics, retail and manufacturing, robots are already demonstrating their potential by automating repetitive tasks, improving precision and enhancing efficiency. As advancements in machine learning, computer vision, and natural language processing continue, robots will become more capable of understanding and responding to human needs with nuance. They can assist the elderly, manage warehouses or even conduct surgeries accurately and consistently, surpassing human capabilities. Additionally, as robots gain greater autonomy, they will increasingly function as agentic AI -- intelligent agents capable of making decisions, setting goals and pursuing actions without constant human oversight. This shift will unlock new possibilities in sectors such as exploration, disaster response and personal assistance, transforming robots into valuable partners for human endeavors. The convergence of AI, robotics, and automation is poised to redefine industries and everyday life. One of the biggest challenges and expenses with robots is to train them. Creating all the possible scenarios to test a physical robot can take years. For example, teaching a robot to walk requires stairs, gravel roads, side hills and other scenarios. They can fall, get damaged, overheat or experience other events slowing training. Nvidia takes a "full stack" approach to physical AI, where training can be done virtually using synthetic data. When the training is complete, upload the information so the robot can do the tasks. Many products that hit the market have been designed with planned obsolescence in mind, whether by design or just due to rapidly evolving technologies and components. Nvidia is doing the opposite. Call it "planned rejuvenation." Talla said this is possible because Nvidia designed the Jetson architecture to support faster performance. "We are increasing the frequency of the memory," he said. "We are increasing the frequency of the GPU. In fact, we are also slightly increasing the frequency of the CPUs. And the power consumption will go up to 25 watts. But the hardware has been designed to support that already." Jetson runs Nvidia AI software, including Nvidia Isaac for robotics, Nvidia Metropolis for vision AI, and Nvidia Holoscan for sensor processing. These preconfigured kits are also part of why Nvidia has become the runaway leader in AI. Packaging up all the hardware and software required for a developer to get started significantly reduces development time. Nvidia's peers offer many of the same building blocks, but the developer must put them together. The new Jetson Orin Nano Super Developer Kit and software upgrades for owners of the original Jetson Orin Nano Developer Kit are available at nvidia.com.

Jetson Orin Nano : Affordable Local AI Power for Developers and Hobbyists

The NVIDIA Jetson Orin Nano, priced at $249, is a compact, energy-efficient AI developer board tailored for edge AI applications. It combines robust hardware capabilities with seamless integration into NVIDIA's AI ecosystem, offering a practical solution for developers and researchers. Whether you're working on object detection, real-time video analysis, or deploying large language models, the Orin Nano provides the tools to execute AI models in localized, low-power environments. Its affordability and versatility make it a compelling choice for both professionals and hobbyists. What makes the Orin Nano so exciting is its ability to handle demanding AI tasks -- like real-time object detection or running large language models -- all within a small, energy-efficient package. Whether you're a seasoned developer looking to prototype the next big thing or a curious beginner eager to experiment with AI, this device offers a practical solution for localized, low-power AI applications. But how does it stack up against other options on the market, and what makes it such a fantastic option for edge computing? Let's dive in and explore how the Orin Nano is redefining what's possible in AI development. The Jetson Orin Nano delivers significant computational power in a small, portable form factor. Its hardware specifications are designed to handle demanding AI workloads efficiently: Despite its advanced capabilities, the device consumes only 15 watts of power, making it ideal for scenarios where energy efficiency is critical. At $249, it strikes a balance between affordability and performance, catering to a wide range of users, from AI enthusiasts to industry professionals. The Orin Nano is purpose-built for localized AI tasks, particularly in fields such as robotics, drones, and IoT devices. By using NVIDIA's AI ecosystem, including tools like TensorRT and CUDA, developers can deploy pre-trained AI models or fine-tune them for specific applications. Its versatility supports a variety of use cases, including: By processing data locally, the Orin Nano reduces latency and minimizes dependence on cloud-based systems, allowing faster and more secure AI operations. This localized approach is particularly beneficial for applications requiring real-time responses or operating in areas with limited internet connectivity. The Jetson Orin Nano excels in handling diverse AI workloads, offering a cost-effective solution for edge computing. For instance: While it doesn't rival the raw computational power of high-end systems like the M2 Mac Pro Ultra, the Orin Nano provides an efficient and affordable alternative for edge AI tasks. Its performance is well-suited for developers working within budget constraints while still requiring reliable AI capabilities. The Jetson Orin Nano is designed to be user-friendly, making it accessible even for those new to AI development. Setting up the device involves straightforward steps: The board is compatible with a variety of AI frameworks, including TensorFlow and PyTorch, simplifying its integration into existing workflows. Whether you're a beginner experimenting with AI or an experienced developer deploying advanced models, the Orin Nano provides a versatile platform for innovation. In the competitive edge AI market, the Jetson Orin Nano distinguishes itself through its unique combination of performance, cost, and energy efficiency. Here's how it compares to other solutions: This balance of affordability and capability makes the Orin Nano a versatile choice for developers seeking a middle ground between cost and performance. It is particularly appealing for projects requiring localized AI processing without the need for expensive hardware. The adaptability of the Jetson Orin Nano enables a wide range of real-time AI applications across various industries. Examples include: These use cases highlight the device's potential to empower developers working on innovative edge computing projects, from smart home automation to industrial AI applications. The Jetson Orin Nano's strengths lie in its ability to balance cost, performance, and functionality. Key advantages include: These features make the Orin Nano a standout option for edge AI development, offering a practical solution for a wide range of applications. The NVIDIA Jetson Orin Nano is a powerful, affordable, and energy-efficient solution for edge AI development. Its combination of performance, usability, and cost-effectiveness makes it an excellent choice for projects in robotics, IoT, and real-time AI applications. At $249, it provide widespread access tos access to advanced AI capabilities, providing developers with the tools needed to bring innovative ideas to life. Whether you're a seasoned professional or just starting your AI journey, the Orin Nano offers a reliable platform to explore and deploy innovative AI solutions.