Inference Routing Summit

Agenda

AI Frontiers

9:00 AM Welcome and introduction — David Wang and JJ, Tetrate

9:10 AM Keynote. Speaker to be announced

9:25 AM Raising the Reliability Floor of ChatGPT with Envoy Gateway —  Delyan Raychev, OpenAI

9:55 AM Google's Approach to Governing and Optimizing Agents Everywhere with Envoy — Vaibhav Katkade, Google

10:25 AM Many Models, Many Clouds, Many Chips: Matching Inference Supply to Demand — Panel with Guido Appenzeller, a16z; James Watters, VMware Broadcom; and Ian Andrews, Groq Nvidia; moderated by David Wang, Tetrate

10:55 AM Morning break

Optimizing Inference in the Enterprise

11:10 AM Keynote: What's Important About Inference in the Enterprise — Guido Appenzeller, a16z

11:25 AM From Tokens to Value: Enterprise AI Cost Governance — Milind Pathak, Hitachi

11:55 AM Governed by Default: Faster AI Adoption at Fiserv — Vinay Kumar, Fiserv

12:25 PM A Customer Lens on Sovereign AI and Private Inference — Debojyoti Dutta, Nutanix

12:55 PM Safer AI Without Filing a Ticket — John Landa, Tetrate

1:10 PM Lunch

Ecosystem and community

2:00 PM Opening remarks — Alex Salkever, Agentic AI Foundation

2:10 PM What's Next in the Ecosystem — Panel with Yan Avlasov, Google; Ignasi Barrera, Tetrate; and Johnu George, Nutanix; moderated by Alex Salkever, AAIF

2:40 PM Tools, Guardrails, Controls: Extending Agent Router — Panel with Soham Ganatra, Composio; Milind Torney, Broadcom; and Vinod Kone, StackTrace; moderated by Matt Baldwin, Tetrate

Tina Tsou, Mandar Jog, Sven Mawson, moderator: Matt Baldwin

3:10 PM Afternoon break

From Silicon to Inference

3:30 PM Inference at Scale: Smarter Routing for Cost, Quality, and Performance — Panel with Tina Tsou, Bitdeer; Mandar Jog, xAI; Sven Mawson, SambaNova

4:00 PM From Cluster to Fleet: Global Inference Routing with Dynamo and Tetrate — Malick Sachal, Nvidia; Varun Talwar, Tetrate

4:30 PM The Right Model for Every Request with Smart Routing — Ian Cairns, Nvidia; Nick DiZazzo, Tetrate

4:45 PM Closing remarks — David Wang, Tetrate

4:50 PM Drinks and networking

Request to Attend

If you're a CTO, VP of Engineering, or head of platform, AI, or infrastructure responsible for building and maintaining an AI stack in production, request access below.

The Venue

Join us at the The SVB Experience Center:A 120-seat event and networking venue operated by Silicon Valley Bank at 532 Market Street in downtown San Francisco, California.

About Tetrate

Tetrate runs AI traffic for enterprises and service providers, giving them consistent control everywhere their business operates. Its AI gateway technology translates technical AI requirements into policies the business can govern, such as cost, model capability, customer experience, resilience, and sovereignty, then enforces those policies consistently across every gateway and location the business depends on. Teams remain free to choose the models, providers, agent harnesses, guardrails, and other AI tools that fit their needs while the enterprise maintains central control.

For more information, visit www.tetrate.io.