OpenTelemetry Collector Kubernetes Deployment Prompt
Design a Kubernetes deployment topology for the OpenTelemetry Collector using the Operator: choose agent DaemonSet plus gateway Deployment, size resources, wire the target allocator for Prometheus scraping, and set up rollout without dropping telemetry.
- Target user
- Platform and SRE teams running the Collector at scale on Kubernetes
- Difficulty
- Advanced
- Tools
- Claude, ChatGPT, Cursor
The prompt
You are a senior platform engineer who runs the OpenTelemetry Collector fleet on Kubernetes reliably. I will provide: - Cluster size (nodes, pods), signals in use (traces/metrics/logs), and volume - Whether the OpenTelemetry Operator is installed - Sources (app OTLP, Prometheus scrape targets, container logs) and destinations - SLOs for telemetry delivery and any current pain (drops, cost, node pressure) Your job: 1. **Topology** — decide the tier layout: node-local agent (DaemonSet) for collection and host/k8s enrichment, plus a gateway (Deployment) for batching, sampling, and export. State what runs where and why. 2. **Operator CRs** — express each tier as an OpenTelemetryCollector CR (mode: daemonset / deployment / statefulset), with pipelines, k8sattributes processor, and resource detection. 3. **Prometheus scraping** — if scraping, enable the target allocator so scrape targets are sharded across Collector replicas; show the config and explain the sharding. 4. **Trace-aware routing** — insert a loadbalancing exporter tier by traceID ahead of any tail sampling or spanmetrics, so processing sees whole traces. 5. **Sizing** — set requests/limits, memory_limiter, batch, and HPA/replica counts against my volume, and explain the memory_limiter-to-limit relationship. 6. **Zero-loss rollout** — configure persistent sending queue (file storage), terminationGracePeriodSeconds, preStop drain, and PodDisruptionBudget so deploys and node drains do not drop data. 7. **Self-observability** — expose the Collector's own metrics and set alerts on queue length, refused/dropped spans, and exporter failures. Output as: (a) the tiered topology diagram in text, (b) the OpenTelemetryCollector CRs, (c) target allocator config if used, (d) sizing and HPA settings with rationale, (e) a rollout-safety checklist. Flag any tier boundary where trace integrity or in-flight data would be lost.
Run this prompt with AI
Test it, get an AI-improved version, or compare models — live in the Prompt Workspace. No copy-paste.
Related prompts
-
OpenTelemetry Collector Gateway Scaling & HA Prompt
Design a horizontally scalable, highly available OpenTelemetry Collector gateway tier — autoscaling, load balancing, queue persistence, and zero-loss rolling upgrades — so telemetry survives replica churn and traffic spikes.
-
OpenTelemetry Collector Routing & Multi-Backend Fan-out Prompt
Design a routing-connector-based OpenTelemetry Collector topology that fans telemetry out to multiple backends or tenants by attribute — with per-route processors, failover, and cost tiers — without duplicating data or dropping unmatched signals.
-
OpenTelemetry Auto-Instrumentation Rollout Prompt
Plan a safe, incremental rollout of OpenTelemetry auto-instrumentation across polyglot services, including the Operator injection model, version pinning, and where manual spans must supplement the agents.
-
OpenTelemetry Collector Batching & Memory Limiter Tuning Prompt
Tune the OpenTelemetry Collector's batch and memory_limiter processors plus exporter queues to maximize throughput and avoid OOMs, backpressure stalls, and dropped telemetry under bursty load.
More OpenTelemetry prompts & error guides
Browse every OpenTelemetry prompt and troubleshooting guide in one place.
Reading prompts? Get all 500 in one free PDF
500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.
- 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
- Instant PDF download — yours free, forever
- Plus one practical AI-workflow email a week (no spam)
Single opt-in · unsubscribe anytime · no spam.