Join us at the premier vendor-neutral open source conference, where developers and technologists come together to collaborate, share knowledge, and explore the latest innovations and advancements in open source technology. Learn more at https://events.linuxfoundation.org/
Decoding the Open-source Blueprint for India's Sovereign AI Future - Vincent Caldeira, Red Hat & Abhishek Kumar Singh, NxtGen Cloud Technologies
As India transitions from being the world’s largest consumer of open-source software to a leading creator of digital public infrastructure, a new mandate has emerged: Sovereign AI. To achieve true digital autonomy, Indian enterprises and public institutions must build AI ecosystems that protect data residency, reflect local context, and avoid vendor lock-in. But how do we practically build this sovereign stack?
This session provides an end-to-end technical blueprint for building enterprise-grade sovereign AI infrastructure entirely on open-source technologies. Using a homegrown, production-ready AI coding assistant as a practical case study, we will deconstruct the architectural layers required for AI independence. We will explore how to orchestrate scalable infrastructure with OpenStack, abstract complex multi-vendor GPU environments using Kubernetes, and deploy high-throughput inference for open-weight models using vLLM.
Beyond the architecture, we will discuss how Indian firms can adopt this open-source stack to implement highly secure, air-gapped environments, protect intellectual property, and empower local engineering talent to shift from consuming global AI to building it.