NVIDIA Launches Jetson Orin Nano Super with 1.7x Inference Boost at $249

4 months ago 34
  • Published on December 17, 2024
  • In AI News

The device offers up to a 1.7x boost in generative AI inference performance and supports popular models for developers, hobbyists, and students.

NVIDIA has introduced its new Jetson Orin Nano Super Developer Kit, a compact generative AI supercomputer priced at $249, down from the earlier price of $499. The device offers up to a 1.7x boost in generative AI inference performance and supports popular models for developers, hobbyists, and students.

The Jetson Orin Nano Super delivers improved performance with 67 INT8 TOPS, a 70% increase compared to its predecessor, and a memory bandwidth of 102GB/s, a 50% jump. 

“Almost 70 trillion operations per second, 25 watts, and just $249. It runs everything the HGX does, including large language models,” said NVIDIA chief Jensen Huang.

Available starting today, the kit supports applications including LLM chatbot development, visual AI systems, and AI-driven robotics.

“The enhanced performance of the Jetson Orin Nano Super provides gains for all popular generative AI models and transformer-based computer vision,” NVIDIA said in a statement.

The developer kit includes a Jetson Orin Nano 8GB system-on-module (SoM) and a reference carrier board for edge AI application prototyping. The SoM features an NVIDIA Ampere architecture GPU with tensor cores and a 6-core Arm CPU, supporting multiple AI application pipelines and up to four cameras with improved resolution and frame rates.

Existing Jetson Orin Nano Developer Kit owners can unlock similar performance gains by upgrading their software.

“The software updates available to the new Jetson Orin Nano Super will also boost generative AI performance for those who already own the Jetson Orin Nano Developer Kit,” NVIDIA said.

The Jetson ecosystem includes NVIDIA AI tools such as Isaac for robotics, Metropolis for vision AI, and Holoscan for sensor processing. NVIDIA also provides resources like the Omniverse Replicator for synthetic data generation and the TAO Toolkit for fine-tuning pre-trained AI models.

The Jetson platform benefits from support across NVIDIA’s AI community, including tutorials and contributions from developers. NVIDIA noted that partners offer additional AI tools, developer support, cameras, and carrier board solutions for customised development.

“The updates will extend to the Jetson Orin NX and Orin Nano series, allowing developers to access boosted generative AI performance across the board,” the company added. The new performance upgrades can be enabled today by updating to the latest JetPack SDK.

Picture of Siddharth Jindal

Siddharth Jindal

Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.

Association of Data Scientists

GenAI Corporate Training Programs

India's Biggest Developers Summit

February 5 – 7, 2025 | Nimhans Convention Center, Bangalore

Download the easiest way to
stay informed

Subscribe to The Belamy: Our Weekly Newsletter

Biggest AI stories, delivered to your inbox every week.

February 5 – 7, 2025 | Nimhans Convention Center, Bangalore

Rising 2025 | DE&I in Tech & AI

Mar 20 and 21, 2025 | 📍 J N Tata Auditorium, Bengaluru

Data Engineering Summit 2025

May, 2025 | 📍 Bangalore, India

MachineCon GCC Summit 2025

June 2025 | 583 Park Avenue, New York

September, 2025 | 📍Bangalore, India

MachineCon GCC Summit 2025

The Most Powerful GCC Summit of the year

discord icon

Our Discord Community for AI Ecosystem, In collaboration with NVIDIA. 

Read Entire Article