English 箭头
Podcast Cover

[Yotta Data Services: Empowering India as a Global AI Hub via Shakti Cloud]-[Yotta CEO Sunil Gupta on Supercharging India’s Fast-Growing AI Market - Ep. 225]

NVIDIA AI Podcast · B2 · 2024-06-03

Technology
Or study on the web version

📋 Summary

Yotta Data Services: Empowering India as a Global AI Hub via Shakti Cloud

In this episode of the NVIDIA AI Podcast, host Noah Kravitz sits down with Sunil Gupta, co-founder and CEO of Yotta Data Services, to discuss the launch of Shakti Cloud—a transformative AI infrastructure project poised to position India as a premier hub for global artificial intelligence development.

Yotta’s Evolution and Vision

Operating for five years as a managed data center and cloud provider, Yotta has evolved from offering traditional co-location services to becoming the first Indian Cloud Service Provider in the NVIDIA Partner Network. Sunil Gupta highlights that Yotta’s ambition is to make India not just a massive consumer of AI, but a "garage for the world" where AI models are developed, trained, and fine-tuned for global enterprise use cases.

Shakti Cloud: A World-Class Infrastructure

Shakti Cloud is engineered as India’s fastest AI supercomputing infrastructure, designed to scale from a single GPU for startups to a massive super-pod configuration. Key technical highlights include:

  • Capacity: The infrastructure features 16,384 NVIDIA H100 GPUs for training, supported by thousands of L40s GPUs optimized for inferencing.
  • Architectural Precision: Yotta has followed NVIDIA’s reference architecture "to the T," utilizing an InfiniBand-based leaf and spine architecture to ensure performance parity with global standards.
  • Software Stack: The platform integrates the full NVIDIA AI Enterprise software stack, enabling users to manage MLOps, annotate data, and fine-tune models within a unified, self-service orchestration layer.

India’s Digital Dynamics

Gupta attributes India’s potential to become a top-tier AI market to several converging factors:

  • Digital Adoption: With 900 million internet users and 600 million smartphone users, India has an unparalleled scale of data generation.
  • Professional Talent: India boasts over 5 million IT professionals, with more than 420,000 specifically trained in AI.
  • Infrastructure Growth: The Indian data center market has surged from 200 megawatts in 2015 to nearly one gigawatt of production capacity today, built to hyperscaler-ready specifications.

Self-Service and Security in the AI Age

Recognizing that enterprise adoption relies on ease of use, Yotta has developed a homegrown self-service portal. This allows users to spin up Kubernetes or Slurm clusters on-demand. Addressing security concerns, Gupta emphasizes the importance of confidential VM features in NVIDIA H100s, which ensure that sensitive customer data remains isolated even from cloud operators. Furthermore, the platform includes robust DDoS protection and security-as-a-service offerings to mirror traditional enterprise-grade security standards.

Sustainability and Future-Proofing

As data centers grow in power consumption, Yotta is integrating sustainability into its design from the outset. Gupta notes that their data centers currently utilize over 50% green energy, with a goal of reaching 100% in the near future. By adopting advanced cooling technologies like rear-door heat exchangers and exploring immersion cooling, Yotta aims to achieve a PUE (Power Usage Effectiveness) as low as 1.0, effectively eliminating cooling-related power waste.

The Strategic Partnership with NVIDIA

Gupta describes the collaboration with NVIDIA as a "marriage of two consenting partners." By utilizing NVIDIA’s professional services to commission the cloud and validate performance benchmarks on MLPerf, Yotta provides clients with the confidence that they are accessing top-tier, globally competitive infrastructure.

Looking Ahead

While currently focused on domestic growth, Yotta’s vision extends globally. Gupta plans to expand Shakti Cloud’s footprint to other cities in India and eventually to international markets, including the Middle East and Africa, by leveraging local co-location partners while managing the AI layer from India. With the rapid evolution of the AI market, Gupta remains agile, emphasizing that the company’s strategy is not static but rather a continuous process of "unlearning old things and relearning new things" to meet the shifting demands of the global tech landscape.

🎯Key Sentences

1
So let's get right to it.
2
You've been in the news.
3
A lot to congratulate you on.
4
We are not deviating from that even for a single cloud.
5
It's like a marriage of two consenting partners.
Expand All

📝Key Phrases

1
take a plunge
2
to the T
3
grounds up
4
come in handy
5
need of the hour
Expand All

📖 Transcript

Hello and welcome to the NVIDIA AI podcast.
I'm your host, Noah Kravitz. We're recording at GTC24 in San Jose, California, and we're here to talk about the fast-growing AI market in India.
My guest is Sunil Gupta. Sunil is the co-founder, managing director, and CEO of IATA Data Services.
Yada is the first Indian Cloud Service Provider member of the NVIDIA Partner Network Program, and the company Shakti Cloud offering is India's fastest AI supercomputing infrastructure. featuring 16 exaflops of AI compute capacity supported by more than 16,000 NVIDIA H100 GPUs.
Sunil's been a busy man this week, but he's taken some time to stop by the podcast studio here at GTC to tell us all about IATA and its role. in India's fast-growing AI sector.
So let's get right to it. Sunil Gupta, thank you so much for stopping by.

ListenLeap Brings You Into Real Context Learning

🎨 Interesting Content
🌍 Real Materials
📱 Listen Anytime
Or study on the web version