Glossary
Incrementality
The share of conversions that a marketing activity caused, compared with what would have happened without it. Holdout tests and geo experiments measure it.
Also called: incremental lift, causal measurement
Attribution divides credit among the touchpoints a converter happened to encounter. Incrementality asks a harder question: would this person have bought anyway?
The distinction is not academic, because the two routinely disagree in a specific and expensive direction. Branded search is the classic case. It attributes beautifully — people search your name, click the ad, buy — and a large share of those people were going to reach you regardless. The report says the campaign works. Turning it off is how you find out whether it did.
Retargeting has the same shape. You are advertising to people who already visited, already added to cart, already decided. They convert at flattering rates and some meaningful portion needed no advertising at all.
How you actually measure it. You need a group that did not see the ads. Geographic holdouts, where some regions get the campaign and comparable ones do not. Audience holdouts, where a random slice is excluded. Or a clean on-off test with enough time either side to separate the effect from normal variation. Some platforms offer built-in lift studies, which are convenient and are marked by the party selling the advertising — worth knowing when you read the result.
Why nobody does it. It requires deliberately not advertising to people, which feels like burning money, and it produces a number smaller than the one in the platform dashboard. The awkwardness is the point: the gap between attributed and incremental is the actual finding.
Do not confuse with
Close enough to get mixed up, different enough that the mix-up costs something.
- Holdout test An experiment that keeps a comparable group from seeing your ads and compares its results with the group that did. The difference estimates what the ads caused.
- Last-click attribution A model that gives all credit for a conversion to the final click before it. It is the most common model and gives no credit to earlier ads in the journey.
- Modeled conversions Conversions a platform estimates with statistical models where consent choices, tracking prevention or privacy limits stop it from observing them directly.
- Statistical significance How likely a difference this large would be if there were no real effect. A significant result can still be a small effect, so report the effect size too.