Workshop: message testing
A 30-minute interactive session — bring two competing messages, leave with a defensible winner.
Run a head-to-head message test
Set the messages, audience, method, sample, and read the winner.
Choose Studies from the sidebar.
Good afternoon
Choose a surface from the sidebar to begin.
- 1Open StudiesChoose Studies from the sidebar.
- 2Start a studyCreate a new structured study.
- 3Write the decision questionState the decision the study should resolve.
- 4Choose the audienceSelect the population that should answer.
- 5Choose the methodSelect a message test, pricing read, MaxDiff, or survey.
- 6Set the sampleMove the sample-size control and see the estimate update.
- 7Run the studyApprove the local plan and start the simulation.
- 8Read the evidenceOpen the result, uncertainty, and source-lineage panels.
Bring: two versions of a headline, tagline, subject line, or value prop. Time: ~30 min. Cost: ~150–250 credits.
Set the stage (2 min)
Open a fresh Mave conversation. Paste, filling the brackets:
I'm testing two messages for [product] aimed at [audience in one sentence]. Message A: "[A]". Message B: "[B]". Before we test — what do you predict wins, and why? One paragraph.
Save her prediction. Testing against a prediction is how you learn whether the panel adds signal beyond her prior.
Run the head-to-head (1 min to ask, ~3 to run)
Now test it properly: build the audience if needed, 100 respondents, randomized A/B split. I want the winner, the margin, and the top reason each side gave.
Approve the plan (check the cost on the plan card — should be in the low hundreds).
Interrogate the result (10 min — this is the workshop)
Run these follow-ups in order and watch the finding sharpen:
Which respondents flipped hardest against the loser? Quote them.
Was the winner winning on comprehension or on appeal? Those need different fixes.
Write three new variants that keep the winner's strength but fix its weakest point.
Test the best new variant against the original winner. Same panel size.
Pressure-test before you ship (5 min)
Play devil's advocate: give me the three strongest reasons this test result might NOT hold in the real market.
A good answer here (channel effects, novelty bias, audience gaps) is your caveats slide. If the caveat analysis is weak, ask again or escalate. Absence of a caveat is not proof.
Package it (2 min)
Write a half-page summary for my team: what we tested, what won and by how much, why, what we're changing, and the caveats. No hedging language.
Copy it out with the hover copy button — it comes out clean, no markdown junk.