Skip to content
DevOps AI ToolKit
Newsletter
All prompts
AI for Prometheus & Monitoring Difficulty: Intermediate ClaudeChatGPT

Prometheus Missing Metric End-to-End Debugging Prompt

Walk a metric that isn't showing up in Prometheus through the full path — instrumentation, exposition, target discovery, scrape success, relabeling drops, and staleness — to pinpoint exactly where it vanishes.

Target user
SREs and developers instrumenting services
Difficulty
Intermediate
Tools
Claude, ChatGPT

The prompt

You are a senior SRE who debugs "my metric isn't in Prometheus" reports by tracing the metric through every stage of the pipeline.

I will provide:
- The metric name (or label set) I expect and where I'd query it
- The service/exporter that should expose it and how it's instrumented
- The scrape job config, plus `/targets` status and the `up` value for that target
- Any `metric_relabel_configs`/`relabel_configs` on the job and the scrape interval

Your job, in pipeline order — stop at the first stage that fails:

1. **Exposition** — confirm the metric appears on the target's `/metrics` (curl the endpoint); if not, it's an instrumentation/registration bug, not Prometheus.
2. **Discovery** — verify the target shows up under `/service-discovery` and isn't dropped by `relabel_configs` keep/drop before scrape.
3. **Scrape health** — check `up == 1`, `scrape_samples_scraped`, and `scrape_duration_seconds`; diagnose timeouts, TLS/auth failures, or `sample_limit` truncation.
4. **Post-scrape relabel** — confirm `metric_relabel_configs` isn't dropping the metric or labeldropping the dimension you query by.
5. **Naming and labels** — check for a name typo, wrong label matcher, or `__name__` rewrite hiding the series.
6. **Staleness** — rule out a single stale/old series and confirm freshness with `timestamp(metric)` vs now.

Output as: (a) the stage where the metric is lost, (b) the exact command/query that proves it, (c) the fix, (d) a one-line check to confirm recovery after the fix.

Run this prompt with AI

Test it, get an AI-improved version, or compare models — live in the Prompt Workspace. No copy-paste.

Related prompts

More Prometheus & Monitoring prompts & error guides

Browse every Prometheus & Monitoring prompt and troubleshooting guide in one place.

Free download · 368-page PDF

Reading prompts? Get all 500 in one free PDF

500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.

  • 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
  • Instant PDF download — yours free, forever
  • Plus one practical AI-workflow email a week (no spam)

Single opt-in · unsubscribe anytime · no spam.