Kolla-Ansible Central Logging (Fluentd → OpenSearch) Design Prompt
Design and troubleshoot the Kolla-Ansible central logging pipeline — Fluentd collectors, OpenSearch storage, and OpenSearch Dashboards — including index lifecycle, retention sizing, multiline parsing, and recovering a red cluster that has stopped ingesting control-plane logs.
- Target user
- Operators running containerized OpenStack via Kolla-Ansible
- Difficulty
- Advanced
- Tools
- Claude, ChatGPT, Cursor
The prompt
You are a senior OpenStack operator who has run Kolla-Ansible central logging (`enable_central_logging: "yes"`) at scale, where Fluentd ships every container's logs from `/var/log/kolla` into OpenSearch and operators triage across services in OpenSearch Dashboards. You understand that a mis-sized or unmanaged logging stack becomes an outage of its own when OpenSearch fills disk and flips read-only. I will provide: - Cluster size (control/network/compute/storage node counts) and enabled OpenStack services - Current `globals.yml` logging settings (`enable_central_logging`, `elasticsearch_*` / `opensearch_*` vars, retention/curator settings) - Per-day log volume estimate or `flog`/actual index sizes - OpenSearch node count, heap, and data-disk capacity - The problem symptom (e.g., no new logs, red cluster, disk full, slow Dashboards) Your job: 1. **Pipeline map** — lay out the exact path: container stdout/file → `/var/log/kolla/<service>` → Fluentd (`fluentd` container) → OpenSearch (`opensearch` container) → `opensearch-dashboards`. Name the Kolla container and config-override path for each hop (`/etc/kolla/config/fluentd/`). 2. **Sizing** — compute daily ingest (GB/day), required primary shard count, replica strategy for the given node count, and total disk with headroom below the OpenSearch flood-stage watermark (default 95%). State when a single-node OpenSearch is unsafe. 3. **Retention / ILM** — design index lifecycle (rollover by size/age, delete after N days) using OpenSearch ISM policies or Kolla's curator settings. Give concrete policy JSON. 4. **Parsing** — configure multiline handling for Python tracebacks and oslo.log so a single traceback is one document, not 40; add custom Fluentd filters via config override without forking Kolla. 5. **Failure recovery** — for the symptom I gave, provide the diagnostic sequence (cluster health, watermarks, read-only index blocks, Fluentd buffer overflow) and the exact recovery commands, including clearing a `read_only_allow_delete` block after freeing disk. 6. **Hardening** — enable TLS/auth on OpenSearch, restrict who can reach the Dashboards VIP, and alert on logging-stack health so a logging outage is visible. Output as: (a) annotated pipeline diagram in text, (b) sizing table with the math shown, (c) ISM/curator policy JSON, (d) Fluentd multiline config-override snippet, (e) a copy-paste recovery runbook for the stated symptom, (f) monitoring/alert checklist. Use `<vip>` and `<opensearch-host>` as placeholders, never real hostnames. Bias toward bounding retention and disk first: an unbounded logging index will take the control plane down before it ever helps you debug.
Run this prompt with AI
Test it, get an AI-improved version, or compare models — live in the Prompt Workspace. No copy-paste.
Related prompts
-
Kolla-Ansible passwords.yml Vault Rotation Runbook Prompt
Plan and execute a safe rotation of Kolla-Ansible service credentials in passwords.yml — RabbitMQ, database, Keystone, and service users — across a running deployment without a full outage or leaving services on stale secrets.
-
Kolla-Ansible Custom Container Image Build & Source Override Prompt
Build, customize, and pin Kolla container images with kolla-build — source vs. binary install type, template-override blocks for extra packages/patches/plugins, local-registry push, and a reproducible tag strategy so custom images survive upgrades and never drift against a moving latest tag.
-
Kolla-Ansible Prometheus + Grafana Monitoring Stack Design Prompt
Design, size, and troubleshoot the Kolla-Ansible in-cluster monitoring stack — Prometheus, node/cAdvisor/mysqld/rabbitmq/openstack exporters, Alertmanager, and Grafana — including scrape targets, retention vs. TSDB disk, alert rules for control-plane health, and fixing targets that show as down.
-
OpenStack Keepalived/HAProxy VIP Failover Design Prompt
Design and validate the Keepalived VRRP + HAProxy control-plane VIP in a Kolla-Ansible OpenStack cloud — clean failover, no split-VIP, correct backend health checks — so API traffic survives losing a controller without dropped or mis-routed requests.
More OpenStack prompts & error guides
Browse every OpenStack prompt and troubleshooting guide in one place.
Reading prompts? Get all 500 in one free PDF
500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.
- 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
- Instant PDF download — yours free, forever
- Plus one practical AI-workflow email a week (no spam)
Single opt-in · unsubscribe anytime · no spam.