Zoho Partners with NVIDIA to Develop AI-Driven SaaS Applications

Zoho's Strategic Partnership with NVIDIA

Zoho Corporation, a global technology company, has announced a significant partnership with NVIDIA to leverage advanced AI technology for its software-as-a-service (SaaS) applications. The collaboration aims to develop and deploy large language models (LLMs) within Zoho's extensive product portfolio, benefiting over 700,000 customers worldwide through ManageEngine and Zoho.com 1

1

Substantial Investment in AI Technology

Demonstrating its commitment to AI innovation, Zoho has invested more than $10 million in NVIDIA's AI technology and GPUs over the past year. The company plans to invest an additional $10 million in the coming year, underlining the strategic importance of this partnership 2

2

Tailored AI Solutions for Business

Ramprakash Ramamoorthy, Director of AI at Zoho Corporation, emphasized the company's focus on creating LLMs specifically designed for diverse business use cases. Unlike many existing LLMs that cater primarily to consumer applications, Zoho aims to provide contextual intelligence that assists users in making informed business decisions 1

1

Privacy-First Approach and Model Diversity

Zoho is prioritizing user privacy by designing its AI models to comply with privacy regulations from the outset. The company is developing a range of narrow, small, and medium language models in addition to LLMs, allowing for tailored solutions based on varying data sizes and use cases. Importantly, these models will not be trained on customer data, ensuring privacy remains a fundamental aspect of Zoho's AI strategy 1

1

2

Leveraging NVIDIA's AI Platform

The partnership will see Zoho accelerating its LLMs on NVIDIA's computing platform using NVIDIA Hopper GPUs. The company will utilize the NVIDIA NeMo platform to develop custom generative AI, including LLMs, multimodal AI, and both vision and speech capabilities 1

1

Related Stories

Zoho Unveils Proprietary AI Stack: Zia LLM, AI Agents, and MCP Server

Zoho Expands AI Capabilities with Zia Agents, Agent Studio, and Marketplace

Mistral AI and NVIDIA Unveil Groundbreaking Enterprise AI Model: Mistral NeMo 12B

Nvidia Launches NeMo Microservices to Boost Enterprise AI Agent Development

Performance Enhancements and Optimization

Zoho is testing NVIDIA TensorRT-LLM to optimize its LLMs for deployment, achieving significant performance improvements. The company has reported a 60% increase in throughput and a 35% reduction in latency compared to a previously used open-source framework. Additionally, Zoho is optimizing other workloads, such as speech-to-text, on NVIDIA's accelerated computing infrastructure 2

2

Impact on Zoho's Product Ecosystem

With over a decade of experience in AI technology, Zoho has already integrated AI features into more than 100 products across its ManageEngine and Zoho divisions. This new partnership is expected to further enhance the company's AI capabilities, potentially revolutionizing its SaaS offerings and providing customers with more sophisticated, context-aware business solutions 1

1

2

Future Implications for Business AI

This collaboration between Zoho and NVIDIA represents a significant step forward in the development of AI-driven business applications. By focusing on creating tailored AI solutions for specific business use cases, Zoho is positioning itself at the forefront of the next generation of enterprise software, potentially setting new standards for AI integration in SaaS products.