materiality
Stop Making Ad Decisions on Spend That Is Too Small to Judge
A metric on a sliver of budget is noise, not signal. Here is the materiality rule that separates real reads from luck.
By the AdBrain team2 min read
The fastest way to lose money on Meta ads is to make confident decisions on numbers too small to mean anything. A 4.0 ROAS on nine dollars is not a winner; a 0.5 on eleven dollars is not a loser. Both are noise wearing the costume of signal. The habit that separates steady buyers from thrashing ones is refusing to judge a metric until enough has happened behind it.
Why small samples lie
Advertising outcomes are lumpy. Purchases and even clicks arrive irregularly, so on a small sample a single event swings the whole metric: one extra sale can push a low-spend ad from below target to double target overnight, though nothing about the ad changed. This is not a Meta quirk; it is how ratios behave when the denominator is small. The metric is not wrong, it is early, and treating an early number as a verdict is the error.
Meta draws its own materiality line
You do not have to invent the threshold from scratch, because Meta's delivery system runs on one. An ad set is flagged "learning limited" when it is "unlikely to receive about 50 optimization events" in the week after its last significant edit (Meta Business Help) which is Meta saying, plainly, that below roughly 50 events it does not consider performance stable either. Meta also advises that a daily budget be "at least 10 times the average cost of your optimization event" (Meta Business Help); starve a metric below that and it will never gather enough to read.
Two questions before any reaction
1. Is there enough volume for the number to be stable? Enough events, clicks, or impressions for the read you are making.
2. Is the spend large enough that the outcome moves the account? A perfect or terrible result on one percent of budget rarely deserves a change to the other ninety-nine.
If either answer is no, do nothing yet. Set the threshold in advance, per objective, and decide it before you look, so the number cannot tempt you.
Waiting is an action
Below your line, the right moves are: let it run, avoid edits that reset the learning phase, and consolidate budget so tests reach materiality faster. Ten ad sets at two dollars a day will never gather enough to read; the same money on three will. If you are structuring budgets to reach signal sooner, CBO vs ABO is the companion read.
Materiality is the gate in front of every other decision. You cannot judge when to kill or scale without it, and you cannot diagnose why results dropped without first ruling out that the drop was a thin sample reverting to normal. Wait for the number to earn your reaction, and you will make fewer, better calls. This is the check AdBrain runs first, flagging when a metric sits on too little spend to trust, so a bad day never triggers a bad decision.
Written by the AdBrain team from established Meta and Google media-buying practice, AI-assisted and reviewed for accuracy. We do not invent statistics, results, or case studies; figures are sourced to the platforms' own documentation where cited.