Global AI Community — Miami: Agent Optimization: Moving Beyond "It Works"

Global AI Community — Miami: Agent Optimization: Moving Beyond "It Works"

As AI agents become more capable, success is no longer just about getting an agent to work. It's about understanding why it works, how to measure it, and how to continuously improve it.

In this community session, I'll share key learnings from the Microsoft Foundry Agent Optimization Workshop and demonstrate how observability, tracing, evaluations, optimization, and peer review can help teams build better agents with greater confidence.

We'll take a practical look at the repository, discuss real-world engineering considerations, and explore the shift toward evidence-based agent development. My goal is to help attendees discover techniques and resources they can use in their own projects while fostering discussion across the community.

Come prepared to learn, share experiences, and explore what's possible when we move beyond intuition and start engineering AI agents with measurable outcomes.

Lightning talk: Model and Database evaluation in Microsoft Foundry.

Get practical knowledge about evaluation tools inside Microsoft Foundry