India's AI Landscape: Thriving in Applications, Lagging in Compute Infrastructure

India's AI Ecosystem: A Tale of Two Layers

India's artificial intelligence (AI) landscape is experiencing rapid growth, particularly in the application layer, while lagging behind in the crucial compute infrastructure. This dichotomy is shaping the investment strategies of venture capitalists and the focus areas for Indian AI startups 1

1

.

Application Layer Dominance

The application layer, which focuses on how AI tools interact with users, is witnessing significant activity in India. This aligns with the country's historical strengths in software development and IT services. Venture capitalists are heavily investing in this area, recognizing the breadth of opportunities in both horizontal and vertical applications 1

1

.

Rajan Anandan, managing director at Peak XV Partners, notes that they have invested in more than 30 companies in the AI space, primarily focusing on software development and infrastructure tooling 1

1

. This trend is echoed by other investors, with Prashanth Prakash, founding partner of Accel India, stating that the application layer dominates the AI landscape in India 1

1

.

Challenges in Compute Infrastructure

While India excels in applications, it faces significant hurdles in developing AI chips and graphic processing units (GPUs). This compute layer is crucial for processing vast amounts of data and performing complex AI workloads. However, the high capital requirements and market dominance by companies like Nvidia make it challenging for Indian startups to compete in this space 1

1

.

Abhishek Prasad, managing director of Cornerstone Ventures, emphasizes that the GPU layer is the hardest to crack in the AI ecosystem, particularly for startups, given the immense capital requirements 1

1

. This gap in compute infrastructure development presents both a challenge and an opportunity for India's AI sector.

Investment Trends and Opportunities

Despite a 26% decrease in funding amount for Indian AI startups in 2024, dropping to $747 million, the number of deals increased from 78 in 2023 to 121 in 2024 2

2

. This indicates a shift towards smaller, more focused investments in the AI space.

Investors are particularly bullish on AI startups building applications for the US market, mirroring the trend set by enterprise software companies 2

2

. Harshjit Sethi of Peak XV Partners expects to see more interesting application layer opportunities in the coming year 2

2

.

Infrastructure and Tooling: The Middle Ground

While compute infrastructure remains challenging, there's growing interest in the infrastructure and tooling layer. This includes technologies and platforms for developing, deploying, and scaling AI models. Companies like Morphing Machines, a fabless semiconductor startup, are making strides in this area 1

1

.

Arjun Rao, general partner at Speciale Invest, notes that they are strongly focused on the infrastructure and tooling layer in GenAI, recognizing the technology differentiation and talent advantages in this space 1

1

.

Government Initiative and Future Outlook

The Indian government has approved a Rs 10,372-crore allocation for the India AI Mission, focusing on building computing infrastructure through public-private partnerships 2

2

. This initiative aims to bridge the gap in India's AI ecosystem and foster innovation in critical areas.

As the AI landscape continues to evolve, Indian companies have the opportunity to gain a competitive edge by focusing on solving India-specific challenges through AI-powered applications 1

1

. While the development of AI chips may still be nascent, the future of AI in India appears promising, with a strong emphasis on application development and a growing focus on critical infrastructure and tooling.