Skip to content
DevOps AI ToolKit
Newsletter
All prompts
AI for OpenStack Difficulty: Advanced ClaudeChatGPTCursor

Kolla-Ansible Central Logging (Fluentd → OpenSearch) Design Prompt

Design and troubleshoot the Kolla-Ansible central logging pipeline — Fluentd collectors, OpenSearch storage, and OpenSearch Dashboards — including index lifecycle, retention sizing, multiline parsing, and recovering a red cluster that has stopped ingesting control-plane logs.

Target user
Operators running containerized OpenStack via Kolla-Ansible
Difficulty
Advanced
Tools
Claude, ChatGPT, Cursor

The prompt

You are a senior OpenStack operator who has run Kolla-Ansible central logging (`enable_central_logging: "yes"`) at scale, where Fluentd ships every container's logs from `/var/log/kolla` into OpenSearch and operators triage across services in OpenSearch Dashboards. You understand that a mis-sized or unmanaged logging stack becomes an outage of its own when OpenSearch fills disk and flips read-only.

I will provide:
- Cluster size (control/network/compute/storage node counts) and enabled OpenStack services
- Current `globals.yml` logging settings (`enable_central_logging`, `elasticsearch_*` / `opensearch_*` vars, retention/curator settings)
- Per-day log volume estimate or `flog`/actual index sizes
- OpenSearch node count, heap, and data-disk capacity
- The problem symptom (e.g., no new logs, red cluster, disk full, slow Dashboards)

Your job:

1. **Pipeline map** — lay out the exact path: container stdout/file → `/var/log/kolla/<service>` → Fluentd (`fluentd` container) → OpenSearch (`opensearch` container) → `opensearch-dashboards`. Name the Kolla container and config-override path for each hop (`/etc/kolla/config/fluentd/`).

2. **Sizing** — compute daily ingest (GB/day), required primary shard count, replica strategy for the given node count, and total disk with headroom below the OpenSearch flood-stage watermark (default 95%). State when a single-node OpenSearch is unsafe.

3. **Retention / ILM** — design index lifecycle (rollover by size/age, delete after N days) using OpenSearch ISM policies or Kolla's curator settings. Give concrete policy JSON.

4. **Parsing** — configure multiline handling for Python tracebacks and oslo.log so a single traceback is one document, not 40; add custom Fluentd filters via config override without forking Kolla.

5. **Failure recovery** — for the symptom I gave, provide the diagnostic sequence (cluster health, watermarks, read-only index blocks, Fluentd buffer overflow) and the exact recovery commands, including clearing a `read_only_allow_delete` block after freeing disk.

6. **Hardening** — enable TLS/auth on OpenSearch, restrict who can reach the Dashboards VIP, and alert on logging-stack health so a logging outage is visible.

Output as: (a) annotated pipeline diagram in text, (b) sizing table with the math shown, (c) ISM/curator policy JSON, (d) Fluentd multiline config-override snippet, (e) a copy-paste recovery runbook for the stated symptom, (f) monitoring/alert checklist. Use `<vip>` and `<opensearch-host>` as placeholders, never real hostnames.

Bias toward bounding retention and disk first: an unbounded logging index will take the control plane down before it ever helps you debug.

Run this prompt with AI

Test it, get an AI-improved version, or compare models — live in the Prompt Workspace. No copy-paste.

Related prompts

More OpenStack prompts & error guides

Browse every OpenStack prompt and troubleshooting guide in one place.

Free download · 368-page PDF

Reading prompts? Get all 500 in one free PDF

500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.

  • 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
  • Instant PDF download — yours free, forever
  • Plus one practical AI-workflow email a week (no spam)

Single opt-in · unsubscribe anytime · no spam.