Cloudflare Acquires AI Deployment Startup Replicate to Expand Workers AI Platform

Cloudflare acquires AI deployment startup Replicate - SiliconANGLE

Cloudflare Inc. has acquired Replicate Inc., a startup with software that makes it easier to deploy artificial intelligence models in production. The companies announced the transaction today without disclosing its financial terms. Replicate previously raised more than $23 million in funding from Y Combinator, Sequoia Capital and other backers. Large language models depend on various auxiliary components to work. The list of required modules often includes CuDNN, an Nvidia Corp. library that provides LLM building blocks such as attention mechanisms. AI models usually also require an implementation of Python, the go-to language for writing AI workloads. Individually setting up all the components an LLM requires can take hours. Software teams speed up the process by packaging an LLM and its dependencies into a container. When it's time to deploy the model in production, developers can simply install the ready-to-use container instead of manually setting up its components. San Francisco-based Replicate offers an AI catalog that includes containerized versions of more than 50,000 models. The company created the containers using Cog, an internally-developed tool it open-sourced in 2019. Packaging AI models and their supporting components into a container speeds up the deployment process, but it can still be time-consuming. Cog automates much of the work involved in the task. Replicate enables customers to deploy its containerized models on a managed cloud platform. The platform, which also supports custom LLMs, removes the need for developers to manage infrastructure. It's billed based on usage. Cloudflare will move Replicate's platform to its infrastructure, a change that is expected to improve its reliability and performance. Additionally, the former company will use the technology that it's obtaining through the acquisition to enhance its Workers AI service. Similarly to Replicate, Cloudflare Workers enables developers to deploy software in the cloud without having to maintain the underlying hardware. That underlying hardware is scattered in data centers around the world. When a user sends a request to a Cloudflare Workers application, the platform uses the closest data center to process it, which lowers latency. Workers AI is a version of the platform optimized for machine learning workloads. Cloudflare plans to expand the platform's catalog of ready-to-use AI models using Replicate's containerized AI library. Additionally, the company will introduce the ability to run custom LLMs and fine-tuned versions of open-source models. The development effort will also see Cloudflare enhance its AI Gateway service. The service enables developers to cache an LLM's responses to frequently recurring user prompts, which removes the need to generate those responses from scratch each time. Additionally, AI Gateway doubles as an LLM observability tool.

Cloudflare is buying Replicate to pull 50,000 AI models into its platform

Cloudflare has agreed to acquire Replicate, a San Francisco-based AI platform that helps developers deploy and run AI models. The deal is expected to close within two months, pending standard closing conditions. Cloudflare stated the acquisition will allow its users to access Replicate's library of more than 50,000 AI models and integrate them with its Workers AI platform. This integration expands options for developers working within Cloudflare's ecosystem. Replicate's team will join Cloudflare and contribute to developing new AI features. These features include support for custom models and deployment pipelines, enhancing capabilities for AI application management. Cloudflare provides cloud-based services to organizations globally. The company aims to make it easier for developers to build and run AI applications at scale through this acquisition. Financial terms of the transaction were not disclosed.