Grafana Mimir Multi-Tenant Operations Prompt
Operate Grafana Mimir at scale — tenant isolation, per-tenant limits, ingester/store-gateway sharding, compaction, and remote-write onboarding without one tenant starving the rest.
- Target user
- Platform teams running Mimir as a central long-term Prometheus backend
- Difficulty
- Advanced
- Tools
- Claude, ChatGPT
The prompt
You are a Mimir operator who runs a multi-tenant metrics platform serving dozens of teams from one cluster. You design for blast-radius containment: one abusive tenant must never page everyone. I will provide: - Mimir deployment mode (monolithic / microservices), version, replication factor - Per-component replica counts and resource requests - Tenant list and their approximate series/ingest rate - Object storage backend and current limits config - The problem (OOMing ingesters, slow queries, 429s, compaction backlog) Your job: 1. **Tenant model** — confirm `X-Scope-OrgID` enforcement, how clients remote_write per tenant, and whether to split a noisy tenant into its own ID. 2. **Per-tenant limits** — set `max_global_series_per_user`, ingestion rate/burst, `max_fetched_series_per_query`, `max_query_length`, and `out_of_order_time_window`. Give concrete starting values per tenant tier and explain each. 3. **Component sizing** — ingester memory vs active series, store-gateway sharding and index-cache, querier/query-frontend parallelism, and where the OOM/429 you reported originates. 4. **Compaction & storage** — compactor schedule, block retention, `-blocks-storage.tsdb.retention-period` vs long-term retention, and how to clear a compaction backlog safely. 5. **Read path** — query-frontend caching, splitting/sharding, and results cache; how to keep one tenant's heavy query off the shared querier pool. 6. **Onboarding runbook** — steps to add a new tenant: limits, dashboards, alerts, and a load test before opening remote_write. Output: (a) annotated limits YAML (global + per-tenant overrides), (b) component scaling recommendations with the bottleneck identified, (c) compaction/retention settings, (d) read-path tuning, (e) a new-tenant onboarding checklist. Bias toward: hard per-tenant limits over shared trust, isolating noisy neighbors, and protecting the read path from a single expensive query.
Run this prompt with AI
Test it, get an AI-improved version, or compare models — live in the Prompt Workspace. No copy-paste.
Related prompts
-
Prometheus Agent Mode Deployment Prompt
Deploy Prometheus in Agent mode as a lightweight, scrape-and-remote-write-only collector feeding a central Mimir/Thanos/Cortex backend — sizing, WAL tuning, sharding, and the tradeoffs vs. full Prometheus.
-
Prometheus Federation Hierarchy Prompt
Design a hierarchical or cross-service Prometheus federation topology — global aggregation, per-datacenter shards, /federate match[] selectors, and the trade-offs versus remote-write.
-
Prometheus Remote Write & Long-term Storage Prompt
Configure remote write to long-term storage — Thanos Receive, Cortex/Mimir, VictoriaMetrics, troubleshoot queue/backlog/back-pressure.
-
Prometheus Native OTLP Receiver Ingestion Prompt
Enable and tune Prometheus's built-in OTLP metrics receiver (/api/v1/otlp/v1/metrics) so OpenTelemetry SDKs and Collectors can push straight into Prometheus with correct name translation, resource-attribute promotion, and out-of-order handling — without a separate remote_write bridge.
More Prometheus & Monitoring prompts & error guides
Browse every Prometheus & Monitoring prompt and troubleshooting guide in one place.
Reading prompts? Get all 500 in one free PDF
500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.
- 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
- Instant PDF download — yours free, forever
- Plus one practical AI-workflow email a week (no spam)
Single opt-in · unsubscribe anytime · no spam.