Monitor, Debug, and Evaluate Agents with Mastra
Shipping an agent to production without observability is like deploying a web app without logging — you're flying blind until something breaks. In this workshop, you'll learn how to instrument your Mastra agents with real observability, then use that telemetry to actively improve agent behavior over time.
We'll start with Mastra Observability, a hosted destination purpose-built for agent telemetry. The Mastra framework already captures traces, logs, and metrics from your agent and workflow runs — Observe is where you store, search, filter, and visualize all of it. You'll see how to set it up in minutes by adding the platform exporter to your Mastra instance, then immediately start exploring a metrics dashboard covering cost, latency, token usage, and quality scores. You'll also learn how to drill into individual traces, inspect parent/child execution flows, and jump straight from an error log to the exact trace that caused it.
From there, we'll move into Mastra Studio, a visual development environment that turns observability data into action. Where Observe helps you understand what happened, Studio helps you improve what happens next. You'll see how to run scorers against traces — repeatable checks for whether agent behavior is good, safe, complete, or correct — and how to take important traces, add them to curated datasets, and run experiments that compare agent behavior before and after a change. This is how you turn one-off debugging into lasting regression coverage.
By the end of the session, you'll have a clear mental model for the full loop: capture telemetry, separate signal from noise, score what matters, and encode "good behavior" into datasets your team can build on. Whether you're tracking down an intermittent production bug or proving to stakeholders that your agent is getting better, this is the workflow that makes it possible.
Hosted by
-
Alex Booker, Developer Experience, Mastra
-
Joel Smith, Platform, Mastra
Recording and code examples will be available to everyone who registers.
