OpenTelemetry Collector Routing & Multi-Backend Fan-out Prompt
Design a routing-connector-based OpenTelemetry Collector topology that fans telemetry out to multiple backends or tenants by attribute — with per-route processors, failover, and cost tiers — without duplicating data or dropping unmatched signals.
- Target user
- Platform and observability engineers running multi-backend or multi-tenant Collectors
- Difficulty
- Advanced
- Tools
- Claude, ChatGPT, Cursor
The prompt
You are a senior observability engineer who designs OpenTelemetry Collector topologies that route telemetry to multiple backends and tenants reliably. I will provide: - The backends/tenants involved and the rule that decides where each signal goes (resource attribute, tenant header, environment, signal type, sampling tier) - Ingest volume per signal and the Collector version/distro and deployment mode - Backend-specific needs: auth/protocol, rate limits, cost tier (hot vs cheap/cold), and per-tenant isolation requirements - Current config and pain (data going to the wrong place, duplication, dropped-on-no-match, one slow backend stalling others) Your job: 1. **Routing key** — choose the routing dimension (OTTL condition on a resource/span attribute, `X-Tenant` header via headers_setter, or signal type) and specify how it is validated/normalized before routing so it can't be spoofed or missing. 2. **Connector wiring** — configure the routing connector with explicit `table` entries and a `default_pipelines` catch-all, wiring each route to its own pipeline. Show the full pipeline graph (receiver → routing connector → per-route pipelines → exporters). 3. **Per-route processing** — apply route-specific processors (redaction for one tenant, different sampling/aggregation per cost tier, attribute enrichment) without leaking one route's transforms into another. 4. **Fan-out vs route** — distinguish where you want the SAME data sent to multiple backends (fan-out via multiple exporters / forward connector) versus mutually-exclusive routing, and prevent accidental duplication or accidental drop. 5. **Isolation & failure** — ensure one slow or failing backend (via per-exporter sending_queue, retry_on_failure, timeout, and failover_connector where appropriate) cannot apply backpressure to unrelated routes. 6. **Multi-tenancy** — enforce per-tenant limits and prevent cross-tenant leakage; note where a gateway-per-tenant beats shared routing. 7. **Validation** — describe how to prove each routing rule works (synthetic signals per key, checking each lands only in its backend) and how to alert on the catch-all/default route filling up (a sign of a misrouted or new key). Output as: (a) annotated Collector YAML with the routing connector and all per-route pipelines, (b) the routing-rule table (key → destination → processors), (c) the isolation/failover design, (d) a per-route validation checklist, (e) alerts on default-route volume and per-backend export failures. Flag any rule where an unmatched or spoofable key would drop or misroute a tenant's telemetry, and give the safe fix.
Run this prompt with AI
Test it, get an AI-improved version, or compare models — live in the Prompt Workspace. No copy-paste.
Related prompts
-
OpenTelemetry Collector Pipeline Design Prompt
Design a production OpenTelemetry Collector configuration with well-ordered receiver, processor, and exporter pipelines for traces, metrics, and logs, tuned for reliability and backpressure.
-
OpenTelemetry Collector Security Hardening Prompt
Harden an OpenTelemetry Collector deployment: enable mTLS on OTLP receivers and exporters, add authentication, redact PII with the transform/redaction processors, and lock down the container so telemetry can't be spoofed, sniffed, or leaked.
-
OpenTelemetry Collector Gateway Scaling & HA Prompt
Design a horizontally scalable, highly available OpenTelemetry Collector gateway tier — autoscaling, load balancing, queue persistence, and zero-loss rolling upgrades — so telemetry survives replica churn and traffic spikes.
-
OpenTelemetry Pipeline Self-Observability and Debugging Prompt
Make an OpenTelemetry Collector observable to itself: enable internal telemetry, expose queue and drop metrics, add the debug exporter and zpages, and build a diagnostic runbook to find where spans or metrics vanish between app and backend.
More OpenTelemetry prompts & error guides
Browse every OpenTelemetry prompt and troubleshooting guide in one place.
Reading prompts? Get all 500 in one free PDF
500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.
- 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
- Instant PDF download — yours free, forever
- Plus one practical AI-workflow email a week (no spam)
Single opt-in · unsubscribe anytime · no spam.