BharatGen's Ambitious AI Plans: From Trillion-Parameter Models to Domain-Specific Solutions

BharatGen's Ambitious AI Initiative

BharatGen, an academic consortium led by IIT Bombay, has emerged as a frontrunner in India's push for sovereign artificial intelligence capabilities. The group has secured the largest allocation of ₹988.6 crore (nearly ₹1,000 crore) under the India AI Mission, along with 13,640 H100 GPUs, positioning itself at the forefront of the country's AI development efforts 1

1

The Trillion-Parameter Model Challenge

At the heart of BharatGen's ambitious plans is the development of a trillion-parameter model. This monumental task is not just about scaling compute power but also about building the necessary infrastructure that India currently lacks in terms of data, talent, and what the consortium calls 'recipes' for sovereign AI 1

1

Rishi Bal, head of BharatGen, emphasized the significance of this goal: "We picked this ambitious goal because we really want to move the needle on what's possible to build in India today. But this is not just about the models. It's about the entire ecosystem... it's a steep ramp" 1

1

Small Language Models: A Key Focus

While the trillion-parameter model is a headline-grabbing objective, BharatGen is equally focused on developing a suite of small language models (SLMs) for various domains. These SLMs are seen as crucial for unlocking enterprise value and providing a sovereign resource base for Indian firms 2

2

The Path from Large to Small Models

BharatGen's strategy involves a two-way approach: developing large models to inform the creation of smaller, more efficient ones. Ganesh Ramakrishnan, principal investigator at BharatGen, explained, "There is a trajectory of small to large models, and vice versa. Some intermediate models will be better achieved when distilled from large models" 2

2

Related Stories

BharatGen: India Launches First Indigenous Multimodal AI Language Model

India's AI Ambitions: Government Receives 67 Proposals for Indigenous Foundational Models

India Bolsters AI Development: Eight Firms Selected for Phase 2 of IndiaAI Mission

India backs 20 sovereign AI models to strengthen domestic AI ecosystem and counter US hegemony

Building on Existing Foundations

The consortium's efforts build upon their previous work, including Param-1, a bilingual LLM with 2.9 billion parameters launched in May. This model was pretrained on high-quality data across five trillion tokens in English and Hindi, showcasing BharatGen's commitment to developing AI solutions tailored for Indian languages 2

2

A Vision for Inclusive AI

BharatGen's ultimate goal extends beyond just creating powerful models. The initiative aims to develop inclusive and efficient AI across 22 Indian languages, emphasizing the importance of linguistic diversity in AI development. This aligns with India's broader ambition to establish itself as a global player in AI while maintaining sovereignty over its AI resources 1

1

2