Marketing · Use case

“Why did they click but not sign up?”

Analytics shows where people dropped off. These questions ask the people who clicked and left what they expected, what stopped them, and what they did next.

The answer

The ad promised a free guide. The page asked for a credit card.

An example of the line the Agent Results Brief leads with.
01 · The questions

The questions Spoke asks people who clicked and left

Under every question is the follow-up Spoke asks when the first answer is vague. That second question is where the real answer usually is.

What they expected

When to ask: first, while the click is fresh
  1. What did you expect to see when you clicked?

    If the answer is vague, Spoke asks

    Which words in the ad gave you that idea?

  2. How did the page compare with what the ad said?

    If the answer is vague, Spoke asks

    Where did it first feel different?

  3. What were you hoping to get done when you clicked?

    If the answer is vague, Spoke asks

    What made that worth looking into that day?

  4. What did you think we'd ask of you in return?

    If the answer is vague, Spoke asks

    Where did that idea come from?

What stopped them

When to ask: the main part, for everyone who left
  1. What stopped you from signing up?

    If the answer is vague, Spoke asks

    What was on the screen at that moment?

  2. Which words on the page made you hesitate?

    If the answer is vague, Spoke asks

    What did you think those words meant?

  3. What would have made it a yes?

    If the answer is vague, Spoke asks

    Where on the page would you have needed to see that?

  4. Who else would need to say yes?

    If the answer is vague, Spoke asks

    What would they need to see before they'd agree?

  5. What were you still unsure about when you left?

    If the answer is vague, Spoke asks

    What would have answered it?

What they did next

When to ask: last
  1. What did you do right after you left the page?

    If the answer is vague, Spoke asks

    What are you using for that now?

  2. Where else did you look?

    If the answer is vague, Spoke asks

    What did that page show you first?

  3. What would bring you back to the page?

    If the answer is vague, Spoke asks

    What would you want to see first when you land?

  4. What would you tell a friend who saw the same ad?

    If the answer is vague, Spoke asks

    What would you tell them to check first?

Send these questions Spoke asks each person on their own and follows up on every vague answer.
02 · The interview

How the interview goes.

Every person gets interviewed, not surveyed. Spoke asks, listens, and follows up on what that person actually said. Here's an example.

Spoke
5 min
You clicked through from the ad. What were you expecting to see on the other side?
The guide. The ad said free guide, and the page asked for a card before I could see anything.
A card before the guide. What did you do then?
Left. I figured the free part was a bait and switch.
If the guide had opened first and the card came later, what would you have done?
03 · The answer

What the answer looks like.

Read the answer, not the transcripts: themes ranked by how many people raised them, the quotes behind each, and the places where two groups disagree.

Agent Results Brief Final
Summary

The campaign works; the landing page breaks the promise. Most people expected to see the guide immediately and met a payment form first. A smaller group did not trust the word free once a card was involved.

On what would make it a yes, two groups disagree.
Show the guide first · 141
Drop the card entirely · 88
What to change on the page
1Open the guide on click; ask for a card only when they want more.
2Match the page headline to the ad's exact promise.
3Say what free includes, in one line, above the fold.
What people said · Card before the guide
“Free guide, then a card form. No.”
“I wanted to see it before I trusted it.”
“The ad and the page felt like two companies.”
Themes · 342 responses
Card before the guide208
Didn't trust 'free'123
Page didn't match the ad82
Wrong audience31
Sentiment
18% positive39% mixed43% negative

An example Agent Results Brief. The counts, themes and quotes are illustrative, not from a real survey.

The follow-up

What “just browsing” usually means

People who leave a page rarely say why unprompted, and the first answer is often “just looking.” One follow-up is usually enough to find the line on the page that lost them. Examples, not real respondents.

Example · Clicked a pricing ad, left from the pricing page
QuestionWhat stopped you from signing up?
First answerNothing really, I was just browsing.
Spoke follows upWhat was on the screen at that moment?
Real answerThe price said “per seat.” I didn't know if that meant me alone or everyone who'd see the reports, and I wasn't going to guess.
What it uncovered

Not price: one unclear word that made the cost impossible to estimate.

Example · Signed up for the waitlist, never activated
QuestionWho else would need to say yes?
First answerProbably my boss, eventually.
Spoke follows upWhat would they need to see before they'd agree?
Real answerSomething to forward. The page was all product tour. My boss wants one paragraph on what it costs and what it replaces.
What it uncovered

The visitor was sold. The page gave them nothing to hand to the person who signs off.

Example · Clicked a video ad
QuestionHow did the page compare with what the ad said?
First answerAbout the same, I guess.
Spoke follows upWhere did it first feel different?
Real answerThe ad showed it on a phone. The page opened with a desktop screenshot and a line about integrations, and I figured it wasn't for someone like me.
What it uncovered

The ad found mobile users; the page spoke to someone else.

04 · How to run it

Three steps, ten minutes.

  1. Write or pick the questionStart from “Why did they click but not sign up?” or say it your own way. Spoke drafts the goal, the audience and the follow-ups; you edit any of it.
  2. Send the linkShare one link however you reach people. They answer in the browser; you set the time: 5, 10 or 15 minutes (10 by default).
  3. Read the answerThemes ranked by how many people raised them, the quotes behind each, and what to do first. Every transcript is there too.
Send these questions

What do you want to learn, and who's answering?

Why people who clicked the free-guide campaign didn't sign up, and what they expected.

Drafted the spec. Want me to ask what they did next, or keep it to the page itself?

Live survey spec
Goal
What visitors expected from the campaign and where the page lost them.
Audience
Everyone who clicked the campaign and left without signing up
Topics
What the ad promised
The moment they left
Who asks this

People who need the answer.

Growth and demand gen
Find out what the ad promised in the visitor's head, not the copy doc.
Product marketers
Hear which words made people hesitate before you rewrite the page.
Lifecycle and CRM
Ask the people who bounced what would bring them back.
Founders running their own campaigns
Get the reason behind the drop-off without a research budget.
FAQ

Questions about this one.

What should I ask people who didn't sign up?

Start with what they expected when they clicked and how the page compared with the ad. Then ask what stopped them and what they did next.

How do I reach people who bounced?

Anyone you can email or message can be interviewed: leads who signed up but didn't convert, ad respondents, people from a waitlist. Send one link, or email invitations with reminders.

Is this better than a session recording?

Different. A recording shows what happened. An interview tells you what the person expected and why they left, and it follows up when the first answer is vague.

Can I test copy with it?

Yes. Ask which words made people hesitate, and the answer shows the phrases people quote back most.

Related

Ask your first question.

Free to start. No card. Your first ten agent surveys are on us.