Zoho Unveils Proprietary AI Stack: Zia LLM, AI Agents, and MCP Server

Zoho's AI Innovation: Zia LLM and AI Agents

Zoho, the Indian software giant, has made a significant leap into the AI arena with the announcement of its proprietary AI stack at the Zoholics India Press Conference. The company unveiled its in-house Large Language Model (LLM) called Zia, along with a suite of AI agents and a Model Context Protocol (MCP) server 1

1

2

2

.

Zia LLM: Tailored for Enterprise Needs

At the heart of Zoho's AI initiative is the Zia LLM, developed entirely in-house using NVIDIA's AI-accelerated computing platform. Unlike consumer-grade LLMs, Zia is specifically designed for enterprise use, with three distinct model sizes:

1. 1.3 billion parameters
2. 2.6 billion parameters
3. 7 billion parameters

Each model is optimized for different business applications, focusing on structured data extraction, summarization, retrieval-augmented generation (RAG), and code generation 1

1

3

3

. Zoho claims that these models benchmark competitively against comparable open-source models in the market 4

4

.

AI Agents: Enhancing Business Processes

Zoho has introduced over 25 pre-built AI agents integrated into its product suite. These agents are designed to handle various business activities, including:

• Candidate Screener: Ranks suitable job applicants based on requirements
• Deal Analyzer: Provides insights on deal win probability and next actions
• Revenue Growth Specialist: Suggests upsell and cross-sell opportunities 2

  2

  4

  4

The company has also launched AI agents specifically for Indian businesses, capable of verifying documents such as PAN cards, Voter IDs, and GST registrations 1

1

.

MCP Server: Enabling Interoperability

A key component of Zoho's AI strategy is the Model Context Protocol (MCP) server. This infrastructure allows for interoperability across applications and agents, including third-party AI tools. The MCP server currently supports over 15 Zoho tools in early access, with plans to expand 2

2

3

3

.

Focus on Efficiency and Cost Optimization

Zoho's CEO, Mani Vembu, emphasized that this AI initiative is part of the company's long-term vision to reduce software costs and optimize power consumption. By developing "right-sized" models, Zoho aims to provide specialized, business-centric AI solutions while keeping overall software costs in check 3

3

.

Additional AI Innovations

Zoho has also announced:

• Automatic Speech Recognition (ASR) models for English and Hindi, with plans to expand to 15 other Indian languages 1

  1

• Zia Agent Studio: A no-code platform for creating and publishing AI agents 2

  2

• Support for the Agent2Agent (A2A) protocol, enabling Zia Agents to interact with each other and agents on other platforms 1

  1

Business Impact and Future Plans

Zoho reported a 32% year-on-year growth in India for 2024, with its most popular products being Zoho One, CRM Plus, and Zoho People. The company plans to scale up its LLM model sizes, starting with the first set of parameter increases by the end of 2025 3

3

4

4

.

While Zoho is not open-sourcing its Zia models immediately, it is part of the long-term roadmap. The company continues to invest heavily in R&D, redirecting funds previously earmarked for semiconductor pursuits into AI and other opportunities 3

3

.

As the global AI race intensifies, Zoho's latest announcements position it as a significant player in the enterprise AI space, particularly in the Indian market. The company's focus on tailored, efficient AI solutions could potentially reshape the landscape of business software and AI adoption in the coming years.