GitHub Copilot Monitoring & Observability with OpenTelemetry
Learn how to implement end to end monitoring and observability for GitHub Copilot Chat using OpenTelemetry and SigNoz.
In this video, we walk through enabling the OpenTelemetry exporter built into the Copilot Chat extension in VS Code, collecting a trace for every agent turn, and visualizing everything in SigNoz to gain real time visibility into model calls, tool executions, token usage, prompt cache savings, latency, and failures. Copilot Chat ships its own OTLP exporter, so there is no instrumentation library to install and no collector to run.
Whether you're rolling Copilot out across an engineering team, tracking token spend and cache hit rate, measuring the latency developers actually feel, or auditing which built in tools and MCP servers the agent reaches for, observability is essential for understanding how your coding agent behaves in real world environments. You'll learn how to move beyond basic logging and adopt production grade observability practices that help you debug faster, optimize performance, reduce costs, and confidently operate GitHub Copilot at scale.
We also cover the prebuilt GitHub Copilot Dashboard in SigNoz, which provides out of the box visibility into token usage and prompt cache hit rate, per model call volume and latency, time to first chunk, tool activity across built in and MCP tools, background agent work, error rates, and overall application health.
What You'll Learn:
How to monitor GitHub Copilot Chat with OpenTelemetry
How to trace agent turns, model calls, and tool executions
How to track token usage, prompt cache hit rate, and time to first chunk
How to visualize GitHub Copilot telemetry in SigNoz
Useful Resources:
GitHub Copilot Monitoring Documentation
https://signoz.io/docs/github-copilot-monitoring/
GitHub Copilot Dashboard Documentation
https://signoz.io/docs/dashboards/dashboard-templates/github-copilot-dashboard/
SigNoz LLM Observability Documentation
https://signoz.io/docs/llm-observability/
More About SigNoz:
SigNoz is an open source observability platform built on OpenTelemetry. It helps developers monitor applications, troubleshoot production issues, and gain visibility across metrics, logs, and traces from a single platform.
SigNoz can be used to monitor AI applications, coding agents, AI assistants, LLM workloads, microservices, Kubernetes environments, and distributed systems.
SigNoz Website
https://signoz.io
GitHub Repository
https://github.com/SigNoz/signoz
Join our Slack Community
https://signoz.io/slack
If you have questions, feedback, or documentation requests, feel free to open a GitHub issue or join our Slack community.
#GitHubCopilot #Copilot #OpenTelemetry #Observability #LLMObservability #CodingAgents #AIAgents #AgentMonitoring #SigNoz #DistributedTracing #AIEngineering #Monitoring #OpenSource #DeveloperTools #SoftwareEngineering #LLMOps #AIInfrastructure