Executive Summary
A plain-English card at the top of every results page that tells you, in one line, whether to ship the change, keep testing, or stop — and why.
Browse docs
Executive Summary
A card at the top of every results page that reads the test for you and says, in one line, what to do next — Ship, Continue running, Inconclusive, or Stop test — with the reason and a suggested next step.
Numbers are great, but most people just want to know one thing: should I make this change or not? The Executive summary answers exactly that. It sits at the very top of the results page, reads your main goal for you, and gives a plain-English recommendation with a short reason — no stats knowledge needed.
It also shows up on shared report links, so when you send results to a manager or client they see the same clear takeaway you do. It only gives advice: it never starts, stops, or edits your test — you always make the final call.
The four recommendations
A version clearly won. Roll it out, then keep an eye on your other numbers.
Something is leading, but it hasn’t proven itself yet. Keep collecting data.
The test ended without a clear winner. Usually a sign to try a bolder idea next.
The version you’re testing is doing worse than your current one. Stop and keep what you have.
What else the card shows
- Estimated uplift — how much better (or worse) the leading version is doing than your original, as a percentage.
- Score — the same headline confidence score as the rest of the page (“Significance” or “Chance to Beat Original”), and whether it's above or below the line it needs to clear.
- Incremental revenue / yr — for tests with a revenue goal, a rough projection of the extra money per year if you ship the winner. (Tests without a revenue goal show the visitor count here instead.)
- A next-step tip — one concrete suggestion, like “keep the test running until it reaches its decision threshold” or “promote the winning experience.”
How to use it well
Read it with the Experiment health card. The Executive summary tells you what to do; the Experiment health card tells you whether you can trust it yet. A confident recommendation plus a clean health card is the strongest green light to act.
It speaks for your primary goal. The recommendation is based on the single most important outcome you picked. Before you ship, still glance at your secondary goals in the detailed results — a winner on one goal can sometimes cost you on another.
Treat revenue projections as a guide. The yearly revenue figure is an estimate based on what's happened so far; real results depend on your traffic staying similar. Use it to weigh a decision, not as a guarantee.
Frequently asked questions
Quick answers to the questions teams ask most about this part of Otter A/B.