Databricks Unveils New Tools for Scalable and Governed AI Agents in Enterprise Applications

Databricks Launches New Tools for Scalable and Governed AI Agents

The new tools address challenges enterprises face in deploying AI agents for high-value use cases. Databricks introduced new tools on Tuesday to help enterprises scale AI agents from pilot projects to full production while ensuring governance, monitoring, and integration. These tools, which include Mosaic AI Gateway, AI/BI Genie Conversational API, Agent Evaluation Review App, and Batch AI, are currently available in public preview. The new tools address challenges enterprises face in deploying AI agents for high-value use cases. According to Databricks, 85% of global enterprises use generative AI, but models often fail to deliver accurate and well-governed outputs due to a lack of enterprise data awareness. "Many enterprises still struggle to deploy AI agents in high-value use cases due to concerns around accuracy, governance, and security. For these organisations, it's confidence, not just technology, that presents the biggest hurdle to extracting the full data intelligence benefits of generative AI," Craig Wiley, senior director of product for AI/ML at Databricks, said. "The new tools address these challenges head-on, enabling businesses to move beyond pilots and into full-scale production with AI agents they can trust." The Mosaic AI Gateway provides centralised governance by integrating and managing open-source and commercial AI models within a single platform. It supports custom large language model (LLM) providers and ensures unified governance, monitoring, and integration across models. Moreover, the AI/BI Genie Conversational API allows developers to embed AI-powered chatbots into custom applications and productivity tools such as Microsoft Teams, SharePoint, and Slack. The API retains context across conversations, allowing for follow-up queries without loss of continuity. The Agent Evaluation Review App streamlines human-in-the-loop workflows, allowing domain experts to provide structured feedback, send traces for labelling, and customise evaluation criteria. This eliminates the need for spreadsheets or custom-built applications. The provision-less batch inference tool allows enterprises to run batch inference using a single SQL query, integrating with Mosaic AI without requiring infrastructure provisioning. Earlier this year, Databricks closed $15.3 billion in financing, valuing the company at $62 billion. JPMorgan Chase, Barclays, Citi, Goldman Sachs, and Morgan Stanley led the financing, which included $10 billion in Series J equity funding and $5.25 billion in debt financing.

Databricks Introduces New Tools to Build Scalable and Trusted AI Agents

Databricks' latest AI innovations streamline governance, monitoring, and scaling to help enterprises deploy AI agents with confidence. Databricks, the Data and AI company, today announced new tools that will help enterprises scale AI agents beyond the pilot phase to successful production with greater confidence, including for high-value use cases. While 85% of global enterprises now use Generative AI (GenAI), even the most advanced models struggle to deliver business-specific, accurate, and well-governed outputs, largely because they lack awareness of enterprise data. The new tools will empower organisations to deploy AI agents in high-value, mission-critical applications while ensuring accuracy, governance, and ease of use. The tools are: Centralised governance for all AI models: Integrate and manage both open source and commercial AI models all in one place with Mosaic AI Gateway support for custom LLM providers. The Mosaic AI Gateway provides unified governance, monitoring, and integration across all models. Simplified integration into existing app workflows: AI/BI Genie Conversational API suite enables developers to embed natural language-based chatbots directly into custom-built apps or popular productivity tools like Microsoft Teams, Sharepoint, and Slack. With the Genie API, users can programmatically submit prompts and receive insights just as they would in the Genie user interface. The API is stateful, allowing it to retain context across multiple follow-up questions within a conversation thread. Streamlined human-in-the-loop workflows: The upgraded Agent Evaluation Review App makes it easier for domain experts to provide targeted feedback, send traces for labelling, and customise evaluation criteria - all without needing spreadsheets or custom-built applications. By making it easier to collect structured feedback, teams can continuously refine AI agent performance and drive systematic accuracy improvements. This counters the issue facing practitioners who spend considerable time and effort trying to understand whether their agent will perform successfully in production. Provision-Less Batch Inference: While model selection, governance, and evaluation are critical to building high-quality agents, simplifying the experience is also important for companies wanting to scale this technology across their business. This tool offers a new way to run batch inference with Mosaic AI using a single SQL query, eliminating the need to provision infrastructure while enabling seamless unstructured data integration. "Batch AI with AI Functions is streamlining our AI workflows. It's allowing us to integrate large-scale AI inference with a simple SQL query -- no infrastructure management needed. This will directly integrate into our pipelines cutting costs and reducing configuration burden. Since adopting it we've seen dramatic acceleration in our developer velocity when combining traditional ETL and data pipelining with AI inference workloads," said Ian Cadieu, CTO of Altana, a customer of Databricks. "Many enterprises still struggle to deploy AI agents in high-value use cases due to concerns around accuracy, governance, and security. For these organisations, it's confidence, not just technology, that presents the biggest hurdle to extracting the full data intelligence benefits of Generative AI," said Craig Wiley, Senior Director of Product for AI/ML, Databricks. "The new tools address these challenges head-on, enabling businesses to move beyond pilots and into full-scale production with AI agents they can trust." Mosaic AI Gateway, Genie Conversation API suite, Agent Evaluation Review App, and Batch AI are now available in Public Preview. About Databricks Databricks is the Data and AI company. More than 10,000 organisations worldwide -- including Block, Comcast, Condé Nast, Rivian, Shell and over 60% of the Fortune 500 -- rely on the Databricks Data Intelligence Platform to take control of their data and put it to work with AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on X, LinkedIn and Facebook.