RabbitMQ Heartbeat & Connection Churn Triage Prompt
Diagnose missed-heartbeat disconnects, connection/channel churn, and 'connection_closed_abruptly' noise by correlating client timeouts, proxy idle limits, and broker heartbeat settings.
- Target user
- Platform and messaging engineers
- Difficulty
- Advanced
- Tools
- Claude, ChatGPT
The prompt
You are a senior RabbitMQ engineer who diagnoses connection churn and missed-heartbeat disconnects without changing application code first. I will provide: - Broker log excerpts (`missed heartbeats from client`, `connection_closed_abruptly`, `client unexpectedly closed TCP connection`) - Output of `rabbitmqctl list_connections name peer_host state channels timeout user` and `rabbitmqctl list_channels` - Negotiated heartbeat (`rabbitmqctl environment | grep heartbeat` or management UI), client library + version, and any L4/L7 proxy (HAProxy/ELB/Envoy) idle-timeout settings - Connection open/close rate from metrics if available Your job: 1. **Classify the churn** — distinguish server-initiated heartbeat timeouts, client-initiated reconnect storms, proxy idle reaping, and TCP RST/firewall drops, citing the exact log lines that prove each. 2. **Reconcile timeouts** — compare the negotiated heartbeat (and 2-miss disconnect window) against proxy/idle timeouts and OS keepalive; flag where the proxy reaps before heartbeats fire. 3. **Spot blocked event loops** — explain how a busy or GC-paused single-threaded consumer misses heartbeats even on a healthy network, and how to confirm. 4. **Recommend settings** — propose a sane heartbeat value, `tcp_listen_options` keepalive, and proxy timeout alignment; warn against heartbeat 0 in proxied paths. 5. **Fix reconnect storms** — recommend connection pooling, jittered backoff, and avoiding per-message connections. 6. **Verify** — list the log lines, connection-rate metric, and `list_connections` checks that confirm churn stopped. Output: (a) root-cause classification with evidence, (b) timeout reconciliation table, (c) prioritized changes, (d) verification checks. This is advisory; do not restart nodes or drop connections in production without owner sign-off and a maintenance window.
Run this prompt with AI
Test it, get an AI-improved version, or compare models — live in the Prompt Workspace. No copy-paste.
Related prompts
-
RabbitMQ Connection & Channel Leak Debugging Prompt
Track down why RabbitMQ connection or channel counts keep climbing until the broker hits limits, and find the client code that opens but never closes them.
-
RabbitMQ Client Connection & Channel Pooling Design Prompt
Design correct client-side connection and channel pooling for RabbitMQ so an app reuses long-lived connections, isolates publishing from consuming, and never leaks channels under load.
-
RabbitMQ Log Triage & Root-Cause Analysis Prompt
Turn raw RabbitMQ broker logs into a ranked incident timeline, correlating connection drops, alarms, partitions, and crashes into a single root cause with next actions.
-
RabbitMQ Poison Message & Redelivery Loop Triage Prompt
Diagnose endless requeue/redelivery loops caused by poison messages, nack-without-DLX, and missing delivery-limit handling so a single bad message stops poisoning a consumer group.
More RabbitMQ prompts & error guides
Browse every RabbitMQ prompt and troubleshooting guide in one place.
Reading prompts? Get all 500 in one free PDF
500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.
- 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
- Instant PDF download — yours free, forever
- Plus one practical AI-workflow email a week (no spam)
Single opt-in · unsubscribe anytime · no spam.