Baseten Secures $75M Funding to Boost AI Inference Performance and Efficiency

Baseten Raises $75 Million in Series C Funding

Baseten, an artificial intelligence startup focused on high-performance inference for large language models (LLMs) and other AI applications, has successfully closed a $75 million Series C funding round. The investment was led by IVP and Spark Capital, with participation from Greylock, Conviction, South Park Commons, 01 Advisors, and Lachy Groom 1

1

2

Addressing the GPU Shortage and Inference Challenges

As AI applications scale, they require fast and reliable inference capabilities. However, many organizations face challenges in accessing the necessary high-performance graphics processing units (GPUs) that power inference. Baseten aims to solve this problem by providing an AI inference platform that allows enterprises to run LLMs either in the cloud or on their own on-premises infrastructure 1

1

Baseten's Unique Approach to AI Inference

Instead of operating its own data centers, Baseten leverages public cloud infrastructure from providers such as Amazon Web Services, Google Cloud, and Microsoft. By combining resources from these cloud platforms, Baseten offers improved access to GPUs. The company's platform provides:

1. A vast library of proprietary and open-source models
2. Modern tooling and workflows for deploying, managing, scaling, and maintaining LLMs in production
3. Multi-cluster, multicloud infrastructure for scaling across regions and AI model modalities
4. Access to applied research for optimizing performance and cost-efficiency
5. Specialist AI engineers to assist with application deployment 1

   1

Cost Efficiency and Performance Improvements

Baseten claims that its average customer experiences a 40% reduction in inference costs while also benefiting from improved performance. This cost-efficiency has contributed to the company's significant growth, with revenue increasing more than six-fold in the last 12 months 1

1

2

Customer Base and Market Position

Baseten boasts over 100 enterprise customers, including notable names such as Patreon, Writer Inc., and Descript Inc. The company's focus on speed, reliability, and cost-efficiency has attracted organizations looking to bring high-quality AI products to market quickly 1

1

2

Related Stories

Baseten Secures $150 Million in Series D Funding, Reaching $2.15 Billion Valuation

Baseten raises $1.5 billion at $13 billion valuation as AI inference demand explodes

Nvidia invests $150 million in Baseten as AI industry shifts from training to inference

Together AI Secures $305 Million in Series B Funding to Expand AI Acceleration Cloud

Competitive Landscape and Future Outlook

As the AI industry continues to evolve, Baseten faces competition from companies like Salesforce-backed Together AI. The recent emergence of Chinese AI lab DeepSeek, which claims to train models at a fraction of the cost of its U.S. counterparts, has also intensified the focus on efficiency in AI 2

2

Baseten has been quick to adapt, adding support for DeepSeek's R1 reasoning model and promising top-tier performance at a fraction of OpenAI's cost. This move has attracted organizations looking to switch from more expensive providers like OpenAI and Anthropic 2

2

Leadership and Growth

Co-founder and CEO Tuhin Srivastava emphasizes the company's ability to guarantee access to GPU resources and handle disruptions without interruptions to their clients' operations. With the new funding, Baseten plans to continue its growth trajectory and compete for talent in the competitive AI market 1

1

2

As the AI inference market continues to expand, Baseten's innovative approach and strong financial backing position it as a key player in enabling enterprises to deploy and scale their AI applications efficiently and cost-effectively.