Post-mortem · Use case

“What really happened on that project?”

Post-mortem questions ask what we set out to do, what happened, what went well, what got in the way and what we change next time. In the meeting, the loud voices fill the hour. Ask everyone first, one at a time, and the quiet person's answer is on the table before anyone speaks.

The answer

The launch slipped when the API date moved and nobody said so out loud; the status stayed green for three more weeks.

An example of the line the Agent Results Brief leads with.
01 · The questions

Post-mortem questions Spoke asks, before the meeting

Under every question is the follow-up Spoke asks when the first answer is vague. That second question is where the real answer usually is.

What we set out to do

When to ask: first, so everyone answers against the same goal
  1. What did we set out to do with this project, in your own words?

    If the answer is vague, Spoke asks

    Halfway through, how would you have known whether we were on track for that?

  2. What did you personally expect to be true on launch day?

    If the answer is vague, Spoke asks

    Which of those things turned out differently?

  3. Who was this project for, as you understood it?

    If the answer is vague, Spoke asks

    What did that person need from it most?

What happened

When to ask: before anyone judges it; the timeline first
  1. Walk me through the project from your seat. What happened, in order?

    If the answer is vague, Spoke asks

    Which step took longer than the plan said it would?

  2. When did you first sense the plan and the reality had drifted apart?

    If the answer is vague, Spoke asks

    What did you see that day that told you?

  3. What changed between the plan and what shipped?

    If the answer is vague, Spoke asks

    When did you find out about that change?

  4. What was the hardest week of the project for you?

    If the answer is vague, Spoke asks

    What made that week harder than the others?

What went well

When to ask: always, so the next plan keeps what worked
  1. What went better than you expected?

    If the answer is vague, Spoke asks

    What made it go that way?

  2. What would you keep exactly as it was next time?

    If the answer is vague, Spoke asks

    What would we lose if we dropped it?

  3. Where did the team recover well from something going wrong?

    If the answer is vague, Spoke asks

    What did someone do that made the recovery work?

  4. Which decision are you glad we made?

    If the answer is vague, Spoke asks

    What would have happened if we'd gone the other way?

What got in the way

When to ask: the middle of the interview, once the timeline is down
  1. What got in the way most?

    If the answer is vague, Spoke asks

    Think of the last time it got in the way. What were you trying to do?

  2. Where did you spend time the plan hadn't counted on?

    If the answer is vague, Spoke asks

    What did you put down to make room for it?

  3. What did you need earlier than you got it?

    If the answer is vague, Spoke asks

    What did you do while you waited?

  4. What, if anything, did you hold back from saying at the time?

    If the answer is vague, Spoke asks

    What would have made it easier to say?

  5. Which decision took the longest to get made?

    If the answer is vague, Spoke asks

    What was it waiting on?

Root causes

When to ask: after the symptoms, so people connect them
  1. What made the biggest problem possible in the first place?

    If the answer is vague, Spoke asks

    What would have had to be true for it not to happen?

  2. What did we assume at the start that turned out to be wrong?

    If the answer is vague, Spoke asks

    When could we have checked that assumption?

  3. Which of the things that went wrong were connected?

    If the answer is vague, Spoke asks

    What's the thread that runs through them?

  4. If the same problem showed up again, what would be the earliest sign?

    If the answer is vague, Spoke asks

    Who would be the first to see that sign?

What we change next time

When to ask: last, so the answer is a plan, not a complaint
  1. What's the one thing you'd change before we run a project like this again?

    If the answer is vague, Spoke asks

    What would that change look like in the first week?

  2. What should we stop doing?

    If the answer is vague, Spoke asks

    What would you do with the time that frees up?

  3. What would you tell the next team on their first day?

    If the answer is vague, Spoke asks

    What makes that the thing they most need to hear?

  4. What would you bet we do again next time?

    If the answer is vague, Spoke asks

    What would it take to catch it early next time?

Incident post-mortem: timeline, detection, response

When to ask: after an outage or incident; blameless, about what was known at the time
  1. Walk me through the incident as you experienced it. What happened first?

    If the answer is vague, Spoke asks

    What was the first thing you saw that told you something was wrong?

  2. How did we find out about the incident?

    If the answer is vague, Spoke asks

    What would have told us sooner?

  3. What did you have to go looking for during the response?

    If the answer is vague, Spoke asks

    Where did you eventually find it?

  4. What did the system do that surprised you?

    If the answer is vague, Spoke asks

    What did you expect it to do instead?

  5. What made sense to do at the time that looks different now?

    If the answer is vague, Spoke asks

    What did you know at that moment that led you there?

  6. What slowed the fix once you knew what was wrong?

    If the answer is vague, Spoke asks

    What were you waiting on at that point?

Send these questions Spoke asks each person on their own and follows up on every vague answer.
02 · The interview

How the interview goes.

Every person gets interviewed, not surveyed. Spoke asks, listens, and follows up on what that person actually said. Here's an example.

Spoke
10 min
Think back over the launch. When did you first sense the plan and the reality had drifted apart?
Around week six, I guess. It was obvious to everyone by then.
What did you see that week that made it obvious?
The demo. Half the screens were mocked and the status deck still said green. Everyone in the room knew and nobody said it.
What would have made it easier to be the one who said it?
03 · The answer

What the answer looks like.

Read the answer, not the transcripts: themes ranked by how many people raised them, the quotes behind each, and the places where two groups disagree.

Agent Results Brief Final
Summary

The launch slipped by three weeks. Most people trace it to the API date moving without anyone announcing it: the ticket changed, the plan didn't, and people found out from broken branches rather than from a message. Status stayed green because nobody wanted to be first to say it, or nobody had the full picture; the team is split on which. What went well: the rollback on launch day was fast because one person had rehearsed it. What to change: say every date change out loud in one place, check plan against reality weekly, and rehearse the rollback before every launch.

On why the status stayed green, two groups disagree.
Nobody wanted to be first to say it · 8
Nobody had the full picture · 6
What to change before the next launch
1Any date change gets posted in one channel the day it happens, by whoever makes it.
2A ten-minute plan-versus-reality check every week, with one question: what has moved?
3Rehearse the rollback before every launch, with a second person who can run it.
What people said · The API date moved and nobody said so
“The ticket changed. The plan didn't.”
“I found out when my branch broke.”
“Everyone knew by Wednesday. The deck was still green on Friday.”
Themes · 19 responses
The API date moved and nobody said so14
Scope grew after the plan was set9
Rollback rehearsal saved launch day8
Status stayed green too long6
Sentiment
27% positive44% mixed29% negative

An example Agent Results Brief. The counts, themes and quotes are illustrative, not from a real survey.

How to use these questions

Ask before the meeting, read the themes, run the meeting from them

The post-mortem meeting is where the loud voices win and the person who was on call at 3 a.m. says nothing. Move the asking to before the meeting.

  1. Ask everyone first, one at a timeSend one link a few days before the meeting. Spoke interviews each person on their own, in the browser, within the 5, 10 or 15-minute budget you set, and follows up when an answer is vague. On paid plans you can make the responses anonymous, which is what makes “what didn't you feel able to say?” answerable.
  2. Read the themes, not the transcriptsThe Agent Results Brief ranks what people raised by how many raised it, shows the quotes behind each, and names where two groups disagree. That last part is the meeting's agenda: the disagreement is what the room needs to talk through.
  3. Run the meeting from the themesOpen with what went well, then the top two things that got in the way, then the disagreement. Everyone has already answered, so the quiet person's point is on the table without them having to fight for the floor. End with three changes, each with a name and a date. Running a sprint retro instead? See the engineering retro questions.
The follow-up

What “communication was bad” actually meant

The first answer in a post-mortem is a category: communication, scope, resources. The follow-up turns it into the specific handoff, decision or hour. Examples, not real respondents.

Example · Product launch · three days before the meeting · anonymous
QuestionWhat got in the way most?
First answerCommunication, mostly. People weren't on the same page.
Spoke follows upThink of the last time it got in the way. What were you trying to do?
Real answerGet the launch email signed off. Three people had to approve it and each asked for a change the previous one had already rejected. It went round four times in eight days and shipped the morning of launch.
What it uncovered

Not communication in general: an approval loop with no final say. The fix is one owner for the email, not another status meeting.

Example · Marketing campaign · the week after it ended
QuestionWhat went better than you expected?
First answerThe launch email did well, honestly.
Spoke follows upWhat made it go that way?
Real answerWe sent a plain-text draft to twenty customers a week early and rewrote the first line from what they replied. The version we sent was theirs, not ours.
What it uncovered

A small habit worth keeping: test the copy on real customers first. Without the follow-up the meeting hears “the email did well” and moves on.

Example · Incident post-mortem · the morning after · anonymous
QuestionHow did we find out about the incident?
First answerA customer told us. It was late.
Spoke follows upWhat would have told us sooner?
Real answerThe queue depth. It had been climbing for forty minutes before the first ticket, and there's a graph for it. Nobody's paged on it because the alert was turned off during the migration and never turned back on.
What it uncovered

Detection failed for a specific, fixable reason: an alert silenced for a migration and never restored. Blameless framing got the person who silenced it to say so.

Which one do you need?

Post-mortem vs retrospective vs pre-mortem

The words get mixed up. They differ in when you ask and what you're asking for.

Post-mortemRetrospectivePre-mortem
WhenAfter a project, launch, campaign or incident endsAt the end of every sprint or cycle, while the work continuesBefore the work starts, once there's a plan
The questionWhat happened, why, and what do we change?What should we keep, stop and try next sprint?Imagine it failed. What went wrong?
ScopeThe whole project, start to finish, including the decisions made before anyone wrote codeThe last two or three weeks of workThe plan and its assumptions
Who answersEveryone who touched the project, including people outside the team who depended on itThe team that did the sprintThe people about to do the work
The outputA written record: timeline, root causes, and changes with an owner and a dateA short list of experiments for the next sprintRisks ranked, with the earliest sign of each
Where to askUse the questions on this page; interview everyone before the meetingA retro board, then the engineering questions for the notes the board left vagueThe root-cause set above, in the future tense: what would make this fail?

Retro boards on ScatterSpoke are free with no limits. Which questions to ask after a sprint, rather than after a project, is on the engineering use case; how to write a probe that gets past the first answer is in follow-up questions.

Blameless wording

How to ask so people tell you what happened

A blameless post-mortem assumes everyone did the reasonable thing with what they knew at the time. The wording of the question decides whether people defend themselves or explain.

01

Ask what was known, not who was wrong

The useful question is what the person knew and saw at the moment they decided. That's where the missing alert, the stale ticket and the unread comment show up.

  • Instead of: Who approved the change?
  • Ask: What did you know at that moment that led you there?
02

Ask about the system before the person

When a person made a mistake, the system let them. Ask what the system did, what it should have done, and what would have caught it.

  • Instead of: Why didn't you test it?
  • Ask: What would have caught this before it shipped?
03

Ask about the last time, not the pattern

“Communication was bad” is a verdict. “The last time it got in the way” is a story with a handoff in it, and you can fix a handoff.

  • Instead of: Why is communication always bad here?
  • Ask: Think of the last time it got in the way. What were you trying to do?
04

Ask what went well, on purpose

If the post-mortem only collects failures, people learn to hide them. Ask what to keep, and who did something that made a recovery work.

  • Instead of: What else went wrong?
  • Ask: Where did the team recover well from something going wrong?
04 · How to run it

Three steps, ten minutes.

  1. Write or pick the questionStart from “What really happened on that project?” or say it your own way. Spoke drafts the goal, the audience and the follow-ups; you edit any of it.
  2. Send the linkShare one link however you reach people. They answer in the browser; you set the time: 5, 10 or 15 minutes (10 by default).
  3. Read the answerThemes ranked by how many people raised them, the quotes behind each, and what to do first. Every transcript is there too.
Send these questions

What do you want to learn, and who's answering?

What really happened on the launch, and what do we change before the next one.

Want me to keep the incident questions separate from the project ones, or run them together?

Live survey spec
Goal
What to change before the next project, from everyone who worked on this one, before the post-mortem meeting.
Audience
Everyone who worked on the launch, anonymous, before Thursday's meeting
Topics
What got in the way
What we change next time
Who asks this

People who need the answer.

Project and program managers
Get the timeline from every seat before the meeting, not the loudest one's version during it.
Engineering leads and incident commanders
Run a blameless incident review where the person who silenced the alert can say so.
Marketing and launch leads
Find out what the campaign's quiet contributors would keep and what they'd stop.
Founders and heads of product
Find out which assumptions in the plan nobody checked.
FAQ

Questions about this one.

What questions should you ask in a post-mortem?

Work through the shape of the project: what we set out to do, what happened (the timeline before any judgment), what went well, what got in the way, root causes, and what we change next time. Ask each as an open question and follow up on the first vague answer: when “communication was bad” is all you get, ask what would have had to be true for it not to happen.

What is the purpose of a post-mortem?

To turn one project into a written record the next one can use: what happened, why, and what changes, from everyone who worked on it, not just the people who spoke in the meeting.

What is the difference between a post-mortem and a retrospective?

A post-mortem looks at a whole project, launch, campaign or incident after it ends and produces a written record: timeline, root causes, changes with an owner. A retrospective is a recurring look at the last sprint or cycle while the work continues, and produces a short list of things to try next. Sprint retro questions are on the engineering use case; retro boards are free.

How do you run a blameless post-mortem?

Start from the assumption that everyone did the reasonable thing with what they knew at the time. Ask what people knew and saw when they decided, what the system did and should have done, and what would have caught the problem earlier. Ask everyone before the meeting, one at a time, so nobody has to say a hard thing in front of the room first. On paid plans you can make the responses anonymous.

When should you hold a post-mortem?

Within a week or two of the project ending or the incident closing, while people still remember the order of events. Send the questions a few days before the meeting so the meeting starts from the themes rather than from a blank whiteboard.

How do you write a post-mortem report?

Lead with the one-line answer, then the timeline, what went well, what got in the way with how many people raised each, the root causes, where people disagreed, and the changes with an owner and a date. The Agent Results Brief gives you the themes, the counts, the quotes and the disagreement; every interview is there as a transcript, and you can export the survey data as CSV.

Related

Ask your first question.

Free to start. No card. Your first ten agent surveys are on us.