IBM, Google Launch llm-d 1.0 Framework for Enterprise AI Inference at 10x Lower Cost
IBM, Red Hat, Google Cloud, CoreWeave and NVIDIA released llm-d 1.0, an open-source distributed AI inference framework that enables organizations to run large language models on their own infrastructure. The release delivers multi-tenant quality of service, zero-downtime operations and specialized controls for AI agents, with IBM reporting 5-10x cost savings versus hosted services.