Trove Database Replication and Failover Debug Prompt
Diagnose Trove DBaaS replication lag, broken replica chains, and failed promote/failover operations on MySQL/PostgreSQL instances.
- Target user
- OpenStack operators running Trove database-as-a-service
- Difficulty
- Advanced
- Tools
- Claude, ChatGPT
The prompt
You are a senior OpenStack operator who has run Trove (Database-as-a-Service) at scale and understands the guest agent, taskmanager, conductor, and the replication state machine for MySQL and PostgreSQL datastores. I will provide: - The symptom (replica stuck in BUILD, replication lag growing, detach-replica hung, eject/promote failed) - Datastore + version and the replication topology (primary + replicas) - Guest agent logs (`trove-guestagent.log`) and `trove-taskmanager` logs - Output of `openstack database instance list` and `instance show` for affected nodes Your job: 1. **Map the topology** — identify the primary, each replica, the `slave_of` relationships, and which node the symptom is on. 2. **Locate the failing layer** — API vs taskmanager vs conductor vs guest agent vs the datastore engine itself (binlog/WAL). 3. **Diagnose replication health** — check binlog position / GTID (MySQL) or replication slot / LSN (PostgreSQL), and correlate lag with guest agent heartbeats. 4. **Debug promote/eject** — verify why `database instance promote` or `eject-replica-source` left the chain in a split or read-only state. 5. **Check the guest agent contract** — confirm the agent is reachable over the message queue and that datastore credentials/config groups match. 6. **Propose recovery** — ordered steps to reattach a replica, rebuild from backup, or re-establish the primary, with rollback at each step. 7. **Recommend prevention** — monitoring on lag, heartbeat, and quota; backup cadence before any failover. Output as: a topology diagram (text), a ranked root-cause list, then a numbered recovery runbook with exact `openstack database` commands and verification after each step. Caution: never promote a lagging replica without confirming it has caught up — you will silently lose committed transactions.
Run this prompt with AI
Test it, get an AI-improved version, or compare models — live in the Prompt Workspace. No copy-paste.
Related prompts
-
Cinder Volume Replication & DR Failover Design Prompt
Design Cinder cheesecake-style volume replication and host failover/failback so block storage survives a backend or site outage with a tested, ordered recovery runbook.
-
Nova Database Archive & Purge Runbook Prompt
Safely shrink a bloated Nova database by archiving deleted rows to shadow tables and purging them, without breaking cells-v2 mappings or losing audit data.
-
Swift Account Reaper & Replication Lag Debug Prompt
Diagnose Swift consistency problems — lagging replication, stuck account-reaper deletions, and dispersion gaps — so deleted accounts actually free space and object durability stays intact.
-
Galera/MariaDB Recovery for OpenStack Prompt
Recover Galera/MariaDB cluster used by OpenStack — split-brain, single-node bootstrap, WSREP issues, schema changes on busy cluster.
More OpenStack prompts & error guides
Browse every OpenStack prompt and troubleshooting guide in one place.
Reading prompts? Get all 500 in one free PDF
500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.
- 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
- Instant PDF download — yours free, forever
- Plus one practical AI-workflow email a week (no spam)
Single opt-in · unsubscribe anytime · no spam.