Operations | Monitoring | ITSM | DevOps | Cloud

How to monitor HashiCorp Vault, Consul and Nomad with Prometheus: telemetry config, scrape setup, auth, and the key metrics and thresholds to alert on. Sejal Pandey works on content and growth at Last9, writing about observability, reliability, and SRE practices.

It's 3am and a complaint has made its way to you: customers can't see product reviews. Nothing has crashed, and no alert points anywhere useful. Somewhere in your stack one service is failing, and the one showing the error is probably not it. Before you can fix anything you have to find it, and that search is most of your night. Now imagine you open the laptop, type one sentence and go grab a coffee. By the time you’re back, the root cause is ready, evidence attached. Your job is to check it.

This September, we hosted a few of our customers at the ilert headquarters in Cologne. The plan was to share where we're heading, have real-life conversations, and give them more room to ask us questions and share their thoughts. ‍ One part of the day was a discussion about on-call culture with some of the greatest minds in SRE (source: they chose ilert as their incident management tool). We asked our customers: what are your top practices for on-call?

Service mesh observability guide: the metrics Istio, Linkerd and Envoy proxies emit, what ambient mode changes, and why tracing still needs app changes. Sejal Pandey works on content and growth at Last9, writing about observability, reliability, and SRE practices.

MCP server monitoring guide: spans, metrics and logs to record for tool calls, why failed tools look healthy, and how to trace requests from client to server. Sejal Pandey works on content and growth at Last9, writing about observability, reliability, and SRE practices.

CI/CD observability guide: the OpenTelemetry CI/CD conventions, tracing GitHub Actions and Jenkins runs, queue time, failure vs error, and deploy markers. Sejal Pandey works on content and growth at Last9, writing about observability, reliability, and SRE practices.

Set up the Prometheus Blackbox Exporter: install it, write HTTP, TCP, DNS and ICMP modules, relabel scrape targets, and alert on probe_success and SSL expiry. Sejal Pandey works on content and growth at Last9, writing about observability, reliability, and SRE practices.

RAG pipeline observability guide: the spans, attributes and metrics to record for embedding, retrieval, reranking and generation, plus evals for bad answers. Sejal Pandey works on content and growth at Last9, writing about observability, reliability, and SRE practices.

Today, we’re introducing Scout 1.0, Datadog’s first AI model specialized for investigating production issues. Scout powers Bits Investigation, our AI SRE. We trained Scout to reduce inference cost so that investigations are cheap enough to run an order of magnitude more often and earlier in an incident’s lifecycle. Key highlights include: Close dialog.