If vLLM already solved LLM serving, why did SGLang appear?
Bengaluru always brings a special kind of energy, and the quality of the questions you asked really kept our team on their toes. Whether we were talking about inference or digging into the specifics of Velocis, our AI cloud, those face-to-face chats were the highlight of our summit.
Thank you for being so generous with your time and for sharing the stories of what you’re building. We left the room feeling inspired by the thoughtfulness and ambition of this community.
Between sessions, the booth stayed busy. We walked people through Velocis end to end: GPU compute on bare metal, virtual machines and Kubernetes, notebooks to build in with billing that stops when you stop, dedicated inference endpoints to serve from, and the cost and access controls that usually decide whether a workload gets signed off.
A lot of whiteboarding, and a lot of good questions we did not have quick answers to.
Our Chief Revenue Officer, Xavier Kurian, took the main stage in Bengaluru to share some reflections on a challenge many of us are starting to feel: the moment our AI ambitions begin to outgrow the infrastructure we started with.
It was a conversation about the shift from the excitement of building a model to the daily reality of serving users. You train a model once. You serve it every second of every day, for everyone who shows up. Xavier’s point was that those two things cost very differently, and that most budgets were quietly built for the first one. He also made the case that running AI in production is a different job from running applications, which is why a purpose-built layer is starting to appear next to the cloud you already have, rather than replacing it.