Databricks Unveils New Tools for Scalable and Governed AI Agents in Enterprise Applications

Databricks Introduces New Tools for AI Agent Deployment

Databricks, the Data and AI company, has unveiled a suite of new tools designed to help enterprises scale AI agents from pilot projects to full production. These tools address the challenges companies face in deploying AI agents for high-value use cases, focusing on governance, monitoring, and integration 1

1

.

Addressing Enterprise AI Challenges

According to Databricks, while 85% of global enterprises use generative AI, many struggle to deploy AI agents in high-value scenarios due to concerns about accuracy, governance, and security. Craig Wiley, Senior Director of Product for AI/ML at Databricks, stated, "For these organisations, it's confidence, not just technology, that presents the biggest hurdle to extracting the full data intelligence benefits of generative AI" 2

2

.

Key Features of the New Tools

1. Mosaic AI Gateway: This tool provides centralized governance by integrating and managing both open-source and commercial AI models within a single platform. It ensures unified governance, monitoring, and integration across models 1

   1

   .

2. AI/BI Genie Conversational API: This API allows developers to embed AI-powered chatbots into custom applications and productivity tools such as Microsoft Teams, SharePoint, and Slack. It retains context across conversations, enabling follow-up queries without loss of continuity 1

   1

   2

   2

   .

3. Agent Evaluation Review App: This app streamlines human-in-the-loop workflows, allowing domain experts to provide structured feedback, send traces for labeling, and customize evaluation criteria. This eliminates the need for spreadsheets or custom-built applications 1

   1

   2

   2

   .

4. Batch AI: This provision-less batch inference tool enables enterprises to run batch inference using a single SQL query, integrating with Mosaic AI without requiring infrastructure provisioning 1

   1

   2

   2

   .

Impact on Enterprise AI Deployment

These tools aim to empower organizations to deploy AI agents in high-value, mission-critical applications while ensuring accuracy, governance, and ease of use. By addressing the challenges of enterprise data awareness and model performance, Databricks seeks to boost confidence in AI agent deployment 2

2

.

Ian Cadieu, CTO of Altana, a Databricks customer, commented on the Batch AI tool: "It's allowing us to integrate large-scale AI inference with a simple SQL query -- no infrastructure management needed. This will directly integrate into our pipelines cutting costs and reducing configuration burden" 2

2

.

Databricks' Market Position

Earlier this year, Databricks secured $15.3 billion in financing, valuing the company at $62 billion. The financing, led by major financial institutions, included $10 billion in Series J equity funding and $5.25 billion in debt financing 1

1

. This substantial investment underscores the growing importance of AI infrastructure and tools in the enterprise market.

As these new tools enter public preview, they represent Databricks' commitment to addressing the evolving needs of enterprises in the AI space, potentially reshaping how companies approach AI agent deployment and management in high-stakes business environments.