Cloudera Acquires Octopai to Enhance Data Management and AI Capabilities, Launches AI-Powered Assistant

Cloudera Expands Data Lineage, Metadata Management Capabilities With Octopai Acquisition

Cloudera also debuts new AI assistant to help data scientists, data engineers and developers boost productivity and streamline data workflows. Data platform giant Cloudera has struck a deal to acquire data lineage and data catalog technology developed by Israel-based Octopai in a move to expand Cloudera's data catalog and metadata management capabilities for data analytics and AI tasks. The acquisition comes as businesses and organizations are looking for ways to utilize their data for AI, machine learning and predictive analytics initiatives - a move that requires finding and managing all relevant, contextual and trusted data. Automatically managing metadata to provide a unified view of data has become more complex as data is increasingly spread across distributed data architectures, including hybrid and multi-cloud environments. Data security and governance have also become more complex. [Related: Cloudera Teams With Nvidia To Create New AI Inference Service] "When using data to make business-critical decisions, enterprises can't afford to have blind spots or inaccuracies, and they certainly shouldn't let identifying trusted data slow down progress," said Charles Sansbury, CEO of Cloudera, in a statement. "Our customers need to auto-discover data across multiple repositories, show deep lineage of assets both within and outside the Cloudera estate, and leverage a robust data catalog to identify data assets that can be consumed. The acquisition of Octopai's platform enhances Cloudera's data, analytics, and AI platform, enabling customers to have greater visibility of their data regardless of their data management provider," Sansbury said. Cloudera said it has signed a definitive agreement for the deal and expects the transaction to be completed by the end of this month. Terms of the acquisition were not disclosed. While Octopai's website has a banner stating that it has been acquired by Cloudera, the Cloudera statement says it is only acquiring the Octopai platform. Octopai, founded in 2016, is based in Rosh Ha'ayin, Israel, with U.S. headquarters in Wilmington, Del. The company's platform leverages data mapping and knowledge graphs technology to power its automated data discovery, multi-dimensional data lineage, data catalog and impact analysis capabilities. With the addition of the Octopai technology to the Cloudera platform, customers can expect improved data discoverability, data quality, data governance and data migration assistance capabilities, according to Cloudera. "Cloudera and Octopai represent a perfect symbiosis by bringing together centralized data and metadata management," said Octopai CEO Yael Ben Arie, in the statement. "By combining Octopai's metadata capabilities with Cloudera's comprehensive data, analytics and AI platform, we're addressing the critical challenge of understanding and governing data across multi-cloud and on-premises environments." In additional news, Cloudera, part of the CRN 2024 Big Data 100, also has launched Cloudera Copilot for Cloudera AI, which the company said provides "secure and intelligent" assistance capabilities to help data scientists, data engineers and developers boost productivity and streamline data workflows. Cloudera Copilot improves reproducibility across projects, ultimately helping to enable enterprises to get trusted data, analytics and AI applications into production faster, according to the company. Specifically, the new offering automates code generation, data transformation and troubleshooting tasks; provides consistent coding assistance; and includes on-demand guidance, optimal solutions and insights for maintaining high coding standards.

Cloudera to Acquire Octopai to Enhance Data Management and AI Capabilities

Cloudera introduces an AI-powered assistant, Cloudera Copilot, to accelerate data-driven innovation. US-based Cloudera has entered into a definitive agreement to acquire Octopai's data lineage and catalog platform to offer data catalog and metadata management capabilities to enterprises, enabling them to understand and govern their data. The acquisition will strengthen Cloudera's data management, governance, and AI platform by integrating Octopai's automated metadata management and multi-layered data lineage tools, the company announced in a recent statement. Also Read: Red Hat to Acquire Neural Magic to Drive Gen AI Across Hybrid Cloud Environments "Enterprises are under increasing pressure to incorporate data-driven decision-making into their business operations," Cloudera said, adding that enterprises want to utilise their data for artificial intelligence (AI), machine learning (ML), and predictive analytics, requiring a comprehensive data intelligence strategy to find all the relevant, contextual, and trusted data across the company. However, Cloudera noted that for enterprises -- particularly those in finance, healthcare, retail, and telecommunications that deal with highly regulated, sensitive, and voluminous data -- having a complete purview of the entire data estate still proves challenging, as they require capabilities across multiple data solutions across hybrid environments. Also Read: L&T Technology Services Acquires Intelliswift to Boost AI and Digital Engineering Capabilities Octopai's automated solutions for data lineage, data discovery, data catalog, mapping, and impact analysis across complex data environments complement Cloudera's solutions and strategy. With the built-in metadata management and multi-dimensional data lineage from Octopai, Cloudera said its customers can get visibility across a myriad of data solutions so they can fuel their AI, predictive analytics, and other decision-making tools with trusted data. "The acquisition of Octopai's platform enhances Cloudera's data, analytics, and AI platform, enabling customers to have greater visibility of their data regardless of their data management provider," said Charles Sansbury, CEO of Cloudera. "By combining Octopai's metadata capabilities with Cloudera's comprehensive data, analytics, and AI platform, we're addressing the critical challenge of understanding and governing data across multi-cloud and on-premises environments. This acquisition will establish the Octopai data lineage and catalog platform as the standard for metadata management while accelerating Cloudera's mission of preparing customers for the AI era," noted Yael Ben Arie, CEO of Octopai. The transaction is expected to close by the end of November 2024. Also Read: SAS Acquires Hazy to Strengthen Synthetic Data and AI Capabilities This acquisition follows Cloudera's announcement at the EVOLVE24 conference in Paris, where the company introduced Cloudera Copilot for Cloudera AI, an AI-powered assistant designed to optimise productivity and streamline workflows for data scientists, engineers, and developers. The tool aims to simplify tasks such as code generation, data transformation, and troubleshooting, helping users focus on high-impact activities and innovation. Cloudera said its Copilot improves reproducibility across projects, ultimately helping to enable enterprises to get trusted data, analytics, and AI applications into production faster than ever. Cloudera claims it is one of the first data and analytics platform vendors to deliver an AI assistant specifically tailored for data practitioners, offering deep integration within data workflows in a secure, enterprise-grade platform that prioritises compliance and governance. "By embedding an AI-powered assistant directly into Cloudera, Cloudera Copilot helps users write high-quality, consistent code and focus on innovation more effectively and securely," the company said in a statement on November 14. Cloudera Copilot operates within an AI ecosystem, delivering robust, AI-driven coding assistance while also providing on-demand support, reinforcing Cloudera's position as a trusted data partner and the leader in secure, hybrid AI solutions, the official release said. Specifically, Cloudera Copilot features include Automated Code Generation, Data Transformation Support, Troubleshooting Assistance, and On-Demand Guidance. "Cloudera is continuously modernising our AI solutions to give our customers deeper access to data-driven insights at scale," said Dipto Chakravarty, Chief Product Officer at Cloudera. "Today, Cloudera provides one of the fastest routes to achieving trusted AI initiatives, and Cloudera Copilot further accelerates enterprise's ability to derive business value from their data via actionable insight."