Sentry Built AI Dashboards: Monitor Your AI Agents End-to-End

Building AI applications? There's a lot more to monitor beyond errors. With tracing enabled, Sentry's built-in AI Dashboards give you deep visibility into how your agents are actually performing.

This video walks through three key dashboard views:

• AI Agents Overview: agent runs, LLM calls, duration, tokens used, tool calls, and recent traces from your agents
• AI Agent Model Details: cost breakdown by model, token usage by type, request counts, error rates, average duration, and p95 latency
• Agent Tools Detail: tool call and tool error breakdowns, helping you spot issues like a slow database query buried inside an MCP server

You'll also see how to drill from a dashboard widget straight into the trace explorer to pinpoint the root cause of errors, how to duplicate and customize dashboards to fit your needs, and how to set up monitors with alert thresholds - like getting notified if your LLM calls exceed 20 seconds.

Check out the AI Agent Dashboards in your Sentry org and let us know what you think!

AI Dashboards: https://docs.sentry.io/product/dashboards/sentry-dashboards/ai/agents/
Try Sentry for free: https://sentry.io/welcome
Docs: https://docs.sentry.io