Skip to content
CloudOps
Newsletter
All guides
Post Mortems with AI By James Joyner IV · · 9 min read

Turning a Postmortem Into Action Items With AI (That Actually Get Done)

Most postmortems generate action items that quietly die. Here's how to use AI to extract sharp, ownable, trackable follow-ups that actually get done.

  • #incident-response
  • #ai
  • #postmortem
  • #action-items
  • #sre

I once audited a year of our postmortems and counted the action items. There were 140. The number that had actually shipped was 31. The rest had decayed into that special graveyard of good intentions: “improve monitoring,” “add a runbook,” “investigate the root cause further.” Vague, unowned, undated, and therefore dead on arrival.

The painful part is that the analysis in those postmortems was usually solid. We understood what went wrong. We just couldn’t convert understanding into follow-through. AI turns out to be genuinely useful for that conversion — extracting concrete, ownable work from the prose — provided you keep it honest about what was actually agreed.

Why action items rot

Action items die for predictable reasons:

  • They’re not specific. “Improve monitoring” can’t be done because it can’t be finished. There’s no state where it’s true.
  • They have no owner. A task owned by “the team” is owned by no one.
  • They have no due date or priority, so they always lose to whatever’s on fire today.
  • They’re buried in a document nobody opens after the meeting.

These are mechanical failures, and mechanical failures are exactly where AI helps — not by deciding what to do, but by relentlessly enforcing the structure that makes follow-through possible.

Extracting the candidates from the postmortem

After the retro, I feed the postmortem (or the retro notes) to an assistant with a prompt like: “Extract every proposed follow-up action from this postmortem. For each, output: a one-sentence specific action phrased so it has a clear ‘done’ state, the problem it addresses, and a suggested category (prevent recurrence, reduce detection time, reduce mitigation time, process). Do not invent actions that aren’t supported by the text. Flag any action that’s too vague to be actionable and rewrite it as a concrete version.”

That last instruction is the magic. The model is excellent at spotting “improve monitoring” and proposing “add a P99 latency alert on the checkout service at 400ms, paging the orders team” — a version with an actual finish line. It’s converting your good intentions into work.

Pro Tip: Ask the model to tag each action by whether it reduces the chance of recurrence, the time to detect, or the time to mitigate. Teams over-index on “stop it happening again” and under-invest in “notice and fix it faster next time.” Seeing the distribution makes the imbalance obvious and the conversation honest.

The line: AI proposes structure, humans assign and commit

This is critical and easy to get wrong. The model can take “we should add a runbook” and reshape it into a crisp, finishable task. What it absolutely cannot do is decide that the task is worth doing, who owns it, when it’s due, or whether it beats the other forty things competing for the same engineer’s week.

Those are commitments, and commitments require a human to actually agree. I’ve seen teams paste an AI-generated action list straight into the tracker and walk away — and three weeks later nobody’s touched it, because nobody ever agreed to it. The list looked official, but no human had said “yes, I’ll do this by Friday.” Ownership is a social act. The model drafts the work; humans own it.

So my workflow is: AI extracts and sharpens the candidate list, then we go through it live, in the room, and for each item a named person either takes it with a date or we explicitly kill it. Killing items is fine — better than a tracker full of zombies. The point is a human decision on every line.

Sizing and prioritizing without overpromising

AI is also useful for a rough first cut at effort and risk: “Which of these are small/medium/large? Which directly address the contributing factors versus which are nice-to-haves?” This gives the prioritization conversation a starting frame. But treat it as a frame, not a verdict — the model doesn’t know that the “small” config change touches a system everyone’s afraid to deploy on a Friday. You do.

Getting them into the system of record

The extraction is only worth it if the items land somewhere they’ll be tracked and reviewed. The principle that makes action items survive is the same one covered in depth across the incident-response category: a single owner, a date, and a recurring review. AI removes the friction of writing them well; your process has to provide the following up.

A nice touch is having the assistant draft the tracker tickets themselves — title, description, acceptance criteria — from the agreed list, so the busywork of ticket creation doesn’t become its own reason for items to slip. The free AI Incident Response Assistant supports this draft-then-commit flow, and keeping a standard extraction prompt in your prompt workspace keeps the output consistent across retros.

The recurring review is still human work

Last point, because it’s where everything lives or dies: action items need a recurring forum where a human asks “what’s the status?” out loud. AI can generate a status summary by reading the tracker, which makes that meeting faster. But the accountability — the slightly uncomfortable moment of “this is two weeks overdue, what’s blocking it?” — is irreducibly human. The model can make your follow-ups well-formed and trackable. Whether they actually get done is still about whether your team treats them as real commitments. AI just removes every excuse rooted in “writing them out was too much work.”

For more on closing the loop and reusable prompts, see the prompt library.

Free download · 368-page PDF

Download the Free 500-Prompt DevOps AI Toolkit

500 battle-tested, copy-paste AI prompts engineered by a senior systems engineer — every one with fill-in placeholders and safety/back-out notes. Drop your email and it's yours.

  • 500 prompts: Linux · Kubernetes · Terraform · OpenStack · GitLab · Docker · Monitoring · Incident Response
  • Instant PDF download — yours free, forever
  • Plus one practical AI-workflow email a week (no spam)

Single opt-in · unsubscribe anytime · no spam.