Red Hat Launches Enterprise Linux AI, Partners with Dell for Open-Source AI Workloads

Red Hat unleashes Enterprise Linux AI - and it's truly useful

Red Hat has officially launched Red Hat Enterprise Linux (RHEL) AI into general availability. This isn't just another product release; it's a truly useful AI approach that RHEL administrators and programmers will find exceptionally helpful. RHEL AI is meant to simplify enterprise-wide adoption by offering a fully optimized, bootable RHEL image for server deployments across hybrid cloud environments. These optimized bootable model runtime instances work with Granite models and InstructLab tooling packages. They include optimized Pytorch runtime libraries and GPU accelerators for AMD Instinct MI300X, Intel and NVIDIA GPUs, and NeMo frameworks. Also: Enterprises double their generative AI deployment efforts, Bloomberg survey says This is Red Hat's foundational AI platform. The program is designed to streamline generative AI (gen AI) model development, testing, and deployment. This new platform fuses IBM Research's open-source-licensed Granite large language model (LLM) family, the LAB methodology-based InstructLab alignment tools, and a collaborative approach to model development via the InstructLab project. IBM Research pioneered the LAB methodology, which employs synthetic data generation and multiphase tuning to align AI/ML models without costly manual effort. The LAB approach, refined through the InstructLab community, enables developers to build and contribute to LLMs just as they would to any open-source project. With the launch of InstructLab, IBM also released select Granite English language and code models under an Apache license, providing transparent datasets for training and community contributions. The Granite 7B English language model is now integrated into InstructLab, where users can collaboratively enhance its capabilities. Also: Can AI even be open source? It's complicated RHEL AI is also integrated within OpenShift AI, Red Hat's machine learning operations (MLOps) platform. This allows for large-scale model implementation in distributed Kubernetes clusters. Let's face it: AI isn't cheap. Leading Large Language Models (LLM) out there cost tens of millions to train. That's before you even start thinking about fine-tuning for specific use cases. RHEL AI is Red Hat's attempt to bring those astronomical costs back down to earth. Also: AI spending to reach $632 billion in the next 5 years, research finds Red Hat partially does that by using Retrieval-Augmented Generation (RAG). RAG enables LLMs to access approved external knowledge stored in databases, documents, and other data sources. This enhances RHEL AI's ability to deliver the right answer rather than an answer that just sounds right. This also means you can train your RHEL AI instances from your company's subject matter experts without needing a Ph.D. in machine learning. This will make RHEL AI a lot more useful than general-purpose AI for getting the work done you need to do instead of writing Star Wars fan fiction. Also: Anthropic's new Claude Enterprise plan brings AI superpowers to businesses at scale In a statement, Joe Fernandes, Red Hat's Foundation Model Platform vice president, said, "RHEL AI provides the ability for domain experts, not just data scientists, to contribute to a built-for-purpose gen AI model across the hybrid cloud while also enabling IT organizations to scale these models for production through Red Hat OpenShift AI." RHEL AI isn't tied to any single environment. It's designed to run wherever your data lives -- whether it be on-premise, at the edge, or in the public cloud. This flexibility is crucial when implementing AI strategies without completely overhauling your existing infrastructure. The program is now available on Amazon Web Services (AWS) and IBM Cloud as a "bring your own (BYO)" subscription offering. In the next few months, it will be available as a service on AWS, Google Cloud Platform (GCP), IBM Cloud, and Microsoft Azure. Also: Stability AI's text-to-image models arrive in the AWS ecosystem Dell Technologies has announced a collaboration to bring RHEL AI to Dell PowerEdge servers. This partnership aims to simplify AI deployment by providing validated hardware solutions, including NVIDIA accelerated computing, optimized for RHEL AI. As someone who's been covering open-source software for decades and who played with AI when Lisp was considered state-of-the-art, I think RHEL AI offers a significant shift in how enterprises approach AI. By combining the power of open source with enterprise-grade support, Red Hat is positioning itself at the forefront of the AI revolution. The real test, of course, will be in the adoption and real-world applications. But if Red Hat's track record is anything to go by, RHEL AI could very well be the platform that brings AI out of the realm of tech giants and into the hands of businesses of all sizes.

Red Hat Enterprise Linux AI Now Generally Available for Enterprise AI Innovation in Production

RHEL AI combines open, more efficient models with accessible model alignment, extending the possibilities of AI innovation across the hybrid cloud Red Hat, Inc., the world's leading provider of open source solutions, today announced the general availability of Red Hat Enterprise Linux (RHEL) AI across the hybrid cloud. RHEL AI is Red Hat's foundation model platform that enables users to more seamlessly develop, test and run generative AI (gen AI) models to power enterprise applications. The platform brings together the open source-licensed Granite large language model (LLM) family and InstructLab model alignment tools, based on the Large-scale Alignment for chatBots (LAB) methodology, packaged as an optimized, bootable RHEL image for individual server deployments across the hybrid cloud. While gen AI's promise is immense, the associated costs of procuring, training and fine-tuning LLMs can be astronomical, with some leading models costing nearly $200 million to train before launch. This does not include the cost of aligning for the specific requirements or data of a given organization, which typically requires data scientists or highly-specialized developers. No matter the model selected for a given application, alignment is still required to bring it in-line with company-specific data and processes, making efficiency and agility key for AI in actual production environments. Red Hat believes that over the next decade, smaller, more efficient and built-to-purpose AI models will form a substantial mix of the enterprise IT stack, alongside cloud-native applications. But to achieve this, gen AI needs to be more accessible and available, from its costs to its contributors to where it can run across the hybrid cloud. For decades, open source communities have helped solve similar challenges for complex software problems through contributions from diverse groups of users; a similar approach can lower the barriers to effectively embracing gen AI. An open source approach to gen AI These are the challenges that RHEL AI intends to address - making gen AI more accessible, more efficient and more flexible to CIOs and enterprise IT organizations across the hybrid cloud. RHEL AI helps: Empower gen AI innovation with enterprise-grade, open source-licensed Granite models, and aligned with a wide variety of gen AI use cases. Streamline aligning gen AI models to business requirements with InstructLab tooling, making it possible for domain experts and developers within an organization to contribute unique skills and knowledge to their models even without extensive data science skills. Train and deploy gen AI anywhere across the hybrid cloud by providing all of the tools needed to tune and deploy models for production servers wherever associated data lives. RHEL AI also provides a ready on-ramp to Red Hat OpenShift AI for training, tuning and serving these models at scale while using the same tooling and concepts. RHEL AI is also backed by the benefits of a Red Hat subscription, which includes trusted enterprise product distribution, 24×7 production support, extended model lifecycle support and Open Source Assurance legal protections. RHEL AI extends across the hybrid cloud Bringing a more consistent foundation model platform closer to where an organization's data lives is crucial in supporting production AI strategies. As an extension of Red Hat's hybrid cloud portfolio, RHEL AI will span nearly every conceivable enterprise environment, from on-premise datacenters to edge environments to the public cloud. This means that RHEL AI will be available directly from Red Hat, from Red Hat's original equipment manufacturer (OEM) partners and to run on the world's largest cloud providers, including Amazon Web Services (AWS), Google Cloud, IBM Cloud and Microsoft Azure. This enables developers and IT organizations to use the power of hyperscaler compute resources to build innovative AI concepts with RHEL AI. Availability RHEL AI is generally available today via the Red Hat Customer Portal to run on-premise or for upload to AWS and IBM Cloud as a "bring your own subscription" (BYOS) offering. Availability of a BYOS offering on Azure and Google Cloud is planned in Q4 2024 and RHEL AI is also expected to be available on IBM Cloud as a service later this year. Red Hat plans to further expand the aperture of RHEL AI cloud and OEM partners in the coming months, providing even more choice across hybrid cloud environments. Supporting Quotes Joe Fernandes, vice president and general manager, Foundation Model Platforms, Red Hat "For gen AI applications to be truly successful in the enterprise, they need to be made more accessible to a broader set of organizations and users and more applicable to specific business use cases. RHEL AI provides the ability for domain experts, not just data scientists, to contribute to a built-for-purpose gen AI model across the hybrid cloud, while also enabling IT organizations to scale these models for production through Red Hat OpenShift AI." Hillery Hunter, CTO and general manager of innovation, IBM Infrastructure "IBM is committed to helping enterprises build and deploy effective AI models, and scale with speed. RHEL AI on IBM Cloud is bringing open source innovation to the forefront of gen AI adoption, allowing more organizations and individuals to access, scale and harness the power of AI. With RHEL AI bringing together the power of InstructLab and IBM's family of Granite models, we are creating gen AI models that will help clients drive real business impact across the enterprise." Jim Mercer, program vice president, Software Development, DevOps & DevSecOps, IDC "The benefits of enterprise AI come with the sheer scale of the AI model landscape and the inherent complexities of selecting, tuning, and maintaining in-house models. Smaller, built-to-purpose, and more broadly accessible models can make AI strategies more achievable for a much broader set of users and organizations, which is the area that Red Hat is targeting with RHEL AI as a foundation model platform." Additional Resources Find out more about Red Hat's and Dell's efforts to power open source AI workloads Read more about RHEL AI Learn how RHEL AI makes trying LLMs easier Watch a video about how RHEL AI helps make gen AI more accessible Connect with Red Hat Learn more about Red Hat Get more news in the Red Hat newsroom Read the Red Hat blog Follow Red Hat on Twitter Follow Red Hat on Instagram Watch Red Hat videos on YouTube Follow Red Hat on LinkedIn About Red Hat, Inc. Red Hat is the world's leading provider of enterprise open source software solutions, using a community-powered approach to deliver reliable and high-performing Linux, hybrid cloud, container, and Kubernetes technologies. Red Hat helps customers integrate new and existing IT applications, develop cloud-native applications, standardize on our industry-leading operating system, and automate, secure, and manage complex environments. Award-winning support, training, and consulting services make Red Hat a trusted adviser to the Fortune 500. As a strategic partner to cloud providers, system integrators, application vendors, customers, and open source communities, Red Hat can help organizations prepare for the digital future.

Dell Technologies and Red Hat Announce Collaboration to Fuel Open Source AI Workloads on Dell PowerEdge and Red Hat Enterprise Linux AI

Red Hat Enterprise Linux AI becomes a preferred platform for AI deployments on Dell PowerEdge serversDell PowerEdge servers to be the first servers validated for Red Hat Enterprise Linux AI to help customers more seamlessly develop, test and run large language models (LLMs) to power enterprise applications Dell Technologies (NYSE: DELL) and Red Hat, Inc., the world's leading provider of open source solutions, are bringing Red Hat Enterprise Linux AI (RHEL AI), a foundation model platform built on an AI-optimized operating system that enables users to more seamlessly develop, test and deploy artificial intelligence (AI) and generative AI (gen AI) models, to Dell PowerEdge servers. This joint effort establishes RHEL AI as a preferred platform on the Dell PowerEdge R760xa server. This collaboration helps organizations more readily implement successful artificial intelligence and machine learning (AI/ML) strategies to scale their IT systems and power enterprise applications across their businesses. Dell and Red Hat are providing a more consistent AI experience on optimized, AI-enabled hardware solutions, all delivered on the trusted platform of RHEL AI on Dell PowerEdge. This initiative aims to simplify the AI experience for users by continuously testing and validating hardware solutions, including NVIDIA accelerated computing, with RHEL AI. RHEL AI brings together open source-licensed Granite large language models (LLMs) from IBM Research, InstructLab model alignment tools based on the LAB (Large-scale Alignment for chatBots) methodology and a community-driven approach to model development through the InstructLab project. The solution is packaged as an optimized, bootable Red Hat Enterprise Linux (RHEL) image for individual server deployments across the hybrid cloud and is included as part of Red Hat OpenShift AI, Red Hat's hybrid cloud machine learning operations (MLOps) platform, for running models and InstructLab at scale across distributed cluster environments. RHEL AI on Dell PowerEdge servers will be available in Q3 2024. Test drive the solution in Dell Customer Solution Centers located globally. Supporting Quotes Joe Fernandes, vice president and general manager, Generative AI Foundation Model Platforms, Red Hat "AI by nature requires extensive resources spanning enabled servers, compute power and GPUs. As organizations evaluate and implement gen AI use cases, it is imperative that they build on a platform that is able to scale with their business while also providing the agility to experiment and develop AI-driven innovations. By collaborating with Dell Technologies to validate and empower RHEL AI on Dell PowerEdge servers, we are enabling customers with greater confidence and flexibility to harness the power of gen AI workloads across hybrid cloud environments and propel their business into the future." Arun Narayanan, senior vice president, Dell Technologies "Validating RHEL AI for AI workloads on Dell PowerEdge servers provides customers with greater confidence that the servers, GPUs and foundational platforms are tested and validated on an ongoing basis. This simplifies the gen AI user experience and accelerates the process to build and deploy critical AI workloads on a trusted software stack." Anil Sethi, Vice President, Infrastructure Solutions Group, Dell Technologies India "Dell Technologies' collaboration with Red Hat on AI is an exciting update for businesses across the globe, focused on creating their mark through digital transformation. RHEL AI will be facilitating seamless enterprise development, testing, and deployment of AI and GenerativeAI models empowering businesses with cutting-edge technology. Integrating RHEL AI with our advanced PowerEdge servers provides a robust, validated platform that simplifies AI adoption and accelerates digital transformation. As AI-driven strategies gain momentum, this initiative will help businesses harness AI's full potential and drive growth in a dynamic digital landscape. This collaboration presents an opportunity for Indian enterprises to explore future-ready offerings with Dell Technologies which can support their journey towards the future of work, with the tools needed to innovate and scale." Bob Pette, vice president, Enterprise Platforms, NVIDIA "In today's fast-paced market, it is critical for organizations to be equipped with validated and trusted AI-enabled solutions to kick-start their gen AI use cases. Red Hat and Dell will extend gen AI capabilities for customers with an optimized experience for NVIDIA accelerated computing, including NVIDIA H100 Tensor Core GPUs, with Dell PowerEdge servers and RHEL AI." Additional Resources Learn more about RHEL AIConnect with Dell on X and LinkedIn Connect with Red Hat Learn more about Red HatGet more news in the Red Hat newsroomRead the Red Hat blogFollow Red Hat on XJoin Red Hat on FacebookWatch Red Hat videos on YouTubeFollow Red Hat on LinkedIn About Dell Technologies Dell Technologies (NYSE: DELL) helps organizations and individuals build their digital future and transform how they work, live and play. The company provides customers with the industry's broadest and most innovative technology and services portfolio for the AI era. About Red Hat, Inc. Red Hat is the world's leading provider of enterprise open-source software solutions, using a community-powered approach to deliver reliable and high-performing Linux, hybrid cloud, container, and Kubernetes technologies. Red Hat helps customers integrate new and existing IT applications, develop cloud-native applications, standardize on our industry-leading operating system, and automate, secure, and manage complex environments. Award-winning support, training, and consulting services make Red Hat a trusted adviser to the Fortune 500. As a strategic partner to cloud providers, system integrators, application vendors, customers, and open source communities, Red Hat can help organizations prepare for the digital future.

Dell Technologies and Red Hat Announce Collaboration to Fuel Open Source AI Workloads on Dell PowerEdge and Red Hat Enterprise Linux AI

INDIA - September 5, 2024 - Dell Technologies (NYSE: DELL) and Red Hat, Inc., the world's leading provider of open source solutions, are bringing Red Hat Enterprise Linux AI (RHEL AI), a foundation model platform built on an AI-optimized operating system that enables users to more seamlessly develop, test and deploy artificial intelligence (AI) and generative AI (gen AI) models, to Dell PowerEdge servers. This joint effort establishes RHEL AI as a preferred platform on the Dell PowerEdge R760xa server. This collaboration helps organizations more readily implement successful artificial intelligence and machine learning (AI/ML) strategies to scale their IT systems and power enterprise applications across their businesses. Dell and Red Hat are providing a more consistent AI experience on optimized, AI-enabled hardware solutions, all delivered on the trusted platform of RHEL AI on Dell PowerEdge. This initiative aims to simplify the AI experience for users by continuously testing and validating hardware solutions, including NVIDIA accelerated computing, with RHEL AI. RHEL AI brings together open source-licensed Granite large language models (LLMs) from IBM Research, InstructLab model alignment tools based on the LAB (Large-scale Alignment for chatBots) methodology and a community-driven approach to model development through the InstructLab project. The solution is packaged as an optimized, bootable Red Hat Enterprise Linux (RHEL) image for individual server deployments across the hybrid cloud and is included as part of Red Hat OpenShift AI, Red Hat's hybrid cloud machine learning operations (MLOps) platform, for running models and InstructLab at scale across distributed cluster environments. RHEL AI on Dell PowerEdge servers will be available in Q3 2024. Test drive the solution in Dell Customer Solution Centers located globally.