Community · Use case

“Why did members go quiet after month two?”

Community survey questions usually reach the members who are still posting. These are for the ones who went quiet: why they joined, what changed, and what would bring them back.

The answer

Members leave when their first ask goes unanswered. It's onboarding, not content.

An example of the line the Agent Results Brief leads with.
01 · The questions

Community survey questions Spoke asks, and what it asks next

Under every question is the follow-up Spoke asks when the first answer is vague. That second question is where the real answer usually is.

Why they joined

When to ask: every member, first
  1. What did you hope to find here when you joined?

    If the answer is vague, Spoke asks

    What's one thing you hoped someone here would help you with?

  2. What happened the first time you asked something here?

    If the answer is vague, Spoke asks

    What did you do after that?

  3. What had you heard about this community before you joined?

    If the answer is vague, Spoke asks

    What made it sound worth joining?

Going quiet

When to ask: they haven't posted in a month or more
  1. When did it stop feeling worth your time?

    If the answer is vague, Spoke asks

    What was happening that week?

  2. Who did you end up talking to here?

    If the answer is vague, Spoke asks

    What would have made it easier to start a conversation?

  3. What takes the time you used to spend here?

    If the answer is vague, Spoke asks

    What does that give you that this community doesn't?

  4. How easy is it to find the conversations that matter to you?

    If the answer is vague, Spoke asks

    Where did you last look for one and give up?

What they'd come back for

When to ask: last, once they've said what changed
  1. What would bring you back this week?

    If the answer is vague, Spoke asks

    If that existed tomorrow, what's the first thing you'd do with it?

  2. What kind of post would make you stop scrolling?

    If the answer is vague, Spoke asks

    What was the last one like that you saw here?

  3. Who here would you want to hear from more?

    If the answer is vague, Spoke asks

    What do they share that others don't?

What's working

When to ask: every member, quiet or active
  1. What's the most useful thing you've gotten from this community?

    If the answer is vague, Spoke asks

    When did that happen?

  2. Who here has helped you most?

    If the answer is vague, Spoke asks

    What did they do?

  3. What should we never change?

    If the answer is vague, Spoke asks

    When did it matter most to you?

Send these questions Spoke asks each person on their own and follows up on every vague answer.
02 · The interview

How the interview goes.

Every person gets interviewed, not surveyed. Spoke asks, listens, and follows up on what that person actually said. Here's an example.

Spoke
5 min
When you first joined, what were you hoping to find here?
People doing the same job as me. I asked a question my first week and nobody answered.
Nobody answered. What did you do after that?
I lurked for a bit. The content was fine, it just didn't feel like anyone was there for me.
If someone had replied to that first question within a day, what would you have done next?
03 · The answer

What the answer looks like.

Read the answer, not the transcripts: themes ranked by how many people raised them, the quotes behind each, and the places where two groups disagree.

Agent Results Brief Final
Summary

Members are not leaving because of the content. They leave when their first question goes unanswered, and most describe the same first week: post, wait, lurk, go quiet. The active cohort almost always got a reply from a specific person.

On what would bring them back, two groups want different things.
A person who welcomes me · 203
Better content · 61
What to change for new members
1Assign every new member a named greeter who replies within a day.
2Route first questions to a small answerers rota, not the whole group.
3Collapse the channel list to the three people actually use.
What people said · First ask unanswered
“Asked once, nobody replied, never asked again.”
“I couldn't tell if anyone was there.”
“The content was fine. It didn't feel like mine.”
Themes · 486 responses
First ask unanswered291
Nobody to talk to172
Too many channels118
Content off-topic44
Sentiment
22% positive47% mixed31% negative

An example Agent Results Brief. The counts, themes and quotes are illustrative, not from a real survey.

The follow-up

What “I just got busy” usually means

Quiet members are polite about it. The first answer is often “busy” or “not much.” One follow-up is usually enough to find the thing that changed. Examples, not real respondents.

Example · Member for five months, last post in spring
QuestionWhen did it stop feeling worth your time?
First answerHonestly, I just got busy.
Spoke follows upWhat was happening that week?
Real answerThe big channel reshuffle. My group got merged into a general channel with a few hundred people, and I couldn't find anyone I knew in it.
What it uncovered

Not busy: a reorganization that dissolved the small group they came for.

Example · Joined for the monthly calls
QuestionWhat takes the time you used to spend here?
First answerOther stuff. Nothing specific.
Spoke follows upWhat does that give you that this community doesn't?
Real answerA smaller group chat with four people from the calls. We moved there because the calls kept landing at 6am my time.
What it uncovered

The members didn't leave each other. The call time pushed them somewhere else.

Example · Active member, posts weekly
QuestionWhat's the most useful thing you've gotten from this community?
First answerLots of good advice.
Spoke follows upWhen did that happen?
Real answerLast month someone walked me through their pricing page line by line in a thread. I changed mine the next day.
What it uncovered

What keeps people: detailed, one-to-one help in threads. Worth protecting in any reshuffle.

04 · How to run it

Three steps, ten minutes.

  1. Write or pick the questionStart from “Why did members go quiet after month two?” or say it your own way. Spoke drafts the goal, the audience and the follow-ups; you edit any of it.
  2. Send the linkShare one link however you reach people. They answer in the browser; you set the time: 5, 10 or 15 minutes (10 by default).
  3. Read the answerThemes ranked by how many people raised them, the quotes behind each, and what to do first. Every transcript is there too.
Send these questions

What do you want to learn, and who's answering?

Why members who joined this year stopped posting, and what would bring them back.

Drafted. I'll interview the quiet cohort and the active one so you can compare. Add a question about pricing, or keep it to the experience?

Live survey spec
Goal
What changed between joining and going quiet, from the people it happened to.
Audience
Members who joined this year and haven't posted in a month
Topics
First week
What they came for
Who asks this

People who need the answer.

Community managers
Hear from the members who went quiet, not just the ones still posting.
Developer relations
Find out what people came for and where the first week failed them.
Membership and association leads
Turn a renewal number into the reasons behind it.
Course and cohort leads
Ask every participant what changed halfway through.
FAQ

Questions about this one.

What questions should I ask in a community survey?

Ask why members joined, what happened the first time they asked something, and what would bring them back. Add a question about what's working, so you know what to protect.

How many questions should a community survey have?

Three to five is plenty. Pick one or two from each group above, and let Spoke's follow-ups fill in the detail. You can cap each interview at 5, 10 or 15 minutes.

Will quiet members respond?

A short interview about their own experience asks less of them than a long form, and you can turn on reminders for people who haven't answered yet.

Can I compare the quiet members with active ones?

Yes. Send the same questions to both groups and compare the answers. The questions under “What's working” fit active members best.

Does it work for Slack or Discord communities?

Interviews happen in the browser from a link, so you can share it anywhere your members already are.

Related

Ask your first question.

Free to start. No card. Your first ten agent surveys are on us.