NVIDIA and Microsoft Collaborate to Accelerate AI Development on Windows PCs

NVIDIA and Microsoft Unveil AI Acceleration Tools for Windows PCs

NVIDIA and Microsoft have announced a significant collaboration to enhance AI capabilities on Windows PCs, introducing new tools and technologies that promise to simplify AI development and boost performance 1

1

TensorRT for RTX: Reimagined for AI PCs

At the heart of this collaboration is TensorRT for RTX, a reimagined version of NVIDIA's TensorRT library specifically designed for RTX AI PCs. This new iteration combines TensorRT's industry-leading performance with just-in-time, on-device engine building, and boasts an 8x smaller package size 1

1

Key features of TensorRT for RTX include:

• Native support through Windows ML, a new inference stack
• Just-in-time, on-device engine building
• Significantly reduced file size (8x smaller)
• Over 50% faster performance for AI workloads compared to DirectML 3

  3

Windows ML: Simplifying AI Development

Microsoft's Windows ML, built on top of ONNX Runtime, aims to solve challenges in the current AI PC software stack. It provides:

• Broad hardware compatibility
• State-of-the-art performance
• Automatic hardware selection for AI features
• Seamless connection to optimized AI execution layers 2

  2

NVIDIA NIM and AI Blueprints

To further facilitate AI development, NVIDIA introduced:

• NVIDIA NIM: Pre-packaged, optimized AI models for popular apps
• AI Blueprints: Sample workflows and projects using NIM microservices
• New community plug-ins for Project G-Assist, including integrations with Google Gemini, Spotify, and Twitch 1

  1

Related Stories

NVIDIA Unveils Local AI Foundation Models for RTX AI PCs at CES 2025

NVIDIA's Blackwell GPUs and RTX 50 Series: Revolutionizing AI for Consumers and Creators

NVIDIA RTX delivers 3x faster AI video generation and 35% boost for language models on PC

AI Revolution in Gaming: From Dream to Reality

Expanding AI Ecosystem on Windows PCs

NVIDIA is providing a range of SDKs to help developers add AI features and boost app performance. These include CUDA, TensorRT, DLSS, Optix, RTX Video, Maxine, Riva, and ACE 3

3

Impact on Software Applications

Several top software applications are releasing updates to leverage these new AI capabilities:

• Autodesk
• Bilibili
• Chaos
• LM Studio
• Topaz Labs 1

  1

These developments mark a significant step forward in making AI more accessible and powerful on consumer PCs, potentially transforming various applications from digital assistants to creative tools.