A Creative Testing Framework That Tells You Which Ad Wins
Most ad accounts test creatives, but few learn from the tests: several things change at once, the budget runs out before a result, or the winner is picked on the first good day. This creative testing framework fixes those three problems, with a calculator for the budget each test needs.
Updated
The short answer
A creative testing framework is a repeatable way to test ads: write a hypothesis, change one variable, give each variant enough budget to collect a set number of conversions, read the results on the same dates, then scale the winner and test again. Test the hook first, then the angle, then the format.
The budget for a test is simple arithmetic: number of ads × conversions per ad × your cost per conversion. The calculator below works it out, with the number of days it takes.
The 5-step creative testing framework
Write a hypothesis
One sentence you can prove wrong: “A problem hook will beat a result hook for this product.” It decides what you change and what you measure.
Change one variable
Only the hook, or only the angle, or only the format. Keep the audience, budget, placement and the rest of the ad the same, or you will not know what made the difference.
Set the budget before launch
Decide how many conversions each ad needs before you judge it, multiply by your cost per conversion and the number of ads, and commit to that budget.
Read the result on the same terms
Compare the ads over the same dates and placements. Look at hook rate for the opening, then at cost per result for the whole ad.
Scale or iterate
Move budget to the winner and write down why it won. If nothing wins, the lesson goes into the next hypothesis.
Variants, one change each
Before you judge each ad
Your recent CPA
For all the ads together
Test budget
$1,500
- Per ad
- $500
- Days at your daily budget
- 15
Fewer ads or a cheaper conversion event (add to cart instead of purchase) make a test faster; more conversions per ad make the result more reliable.
The framework on one page
What is creative testing?
Creative testing is running several versions of an ad against each other to learn which one performs best, and why. The creative is what people see and hear, the image or video, the hook, the message and the call to action, so testing it is how you find the message your buyers respond to.
Ad creative testing is different from audience testing: the audience stays the same, and only the ad changes.
What to test first in ad creative testing
Start with the hook, the first one or two seconds of a video or the headline of an image. It decides whether anyone sees the rest, and it is cheap to vary: the same video can open in three ways.
Then test the angle, the reason to buy you lead with: a problem, a result, a price, a comparison. Then the format: talking head, demo, before and after, static image. The call to action and small edits come last, because they rarely change the result as much.
How much budget a creative test needs
A test needs enough conversions per ad to tell the ads apart. Choose the number before you start, with more conversions for a more reliable read, and use the calculator above to plan the spend: 3 ads that each need 20 conversions at a $25 cost per conversion need about $1,500, or about 15 days at $100 a day. It is a planning estimate: your real cost per conversion and delivery will vary, and the calculator does not measure statistical confidence.
If that is too slow or too expensive, test fewer ads at once, or judge on an earlier event that happens more often, such as adding to cart, then confirm the winner on purchases.
When to call a winner
Wait until every ad has reached the budget or the conversions you set, and compare them over the same dates. A lead after one day often disappears by the end of the week as the delivery evens out.
Call a winner when its cost per result is clearly better and the gap holds over several days; a split test tool, such as TikTok's, compares the ad groups on your key metric for you. If the ads are close, treat it as a tie: the variable you tested may not matter much for this product, which is also a result.
Creative testing tools
The ad platforms have split testing built in. In TikTok Ads Manager, you turn on a split test when you create a campaign, choose the variable and a key metric, and set the test to run for at least 7 days, as TikTok recommends; it then compares the ad groups and identifies the better one on that metric.
Outside the platforms, a spreadsheet of hypotheses and results is enough to start. The free hook rate calculator compares the openings of up to five video ads, and the Facebook ad cost calculator turns a test budget into expected impressions, clicks and sales.
Before you launch a creative test
- One hypothesis, written down
- One variable changed, everything else identical
- Conversions per ad and total budget decided
- Same audience, placements and dates for every ad
- A rule for calling the winner
- The next test ready, whatever the result
Make the variants to test with Upadz
A test is only as good as its variants. Upadz starts from a product URL, researches the buyer and the ads running in your market, and proposes 3 ad concepts, each with its own angle and hook. Test the angles against each other first; then keep the winning concept and change only its hook, so each test changes one thing. Upadz makes the ads as finished video ads (50 credits (720p) or 75 credits (1080p)) or static ads (6 credits (Faster) or 10 credits (Pro) per image).
Keep reading
Frequently asked questions
What is a creative testing framework?
A repeatable process for testing ads: a hypothesis, one variable changed, a budget set before launch, results read on the same terms, then scale the winner and test again.
How many creatives should I test at once?
As many as your budget can give enough conversions each. Three ads that each need 20 conversions at a $25 cost per conversion need $1,500; fewer ads make the test faster.
What should I test first in my ads?
The hook, because it decides whether people see the rest of the ad. Then the angle, then the format, and the call to action last.
How long should a creative test run?
Until each ad reaches the conversions or budget you set before launch, and at least 7 days for a TikTok split test, as TikTok recommends. The calculator estimates the number of days at your daily budget.
What are the best creative testing tools?
Start with the split testing built into the ad platforms, such as TikTok's split test. Add a hook rate calculator for video openings and a simple sheet to log hypotheses and results.
Facts checked on against TikTok Ads Help: How to create a split test. Prices and features change; tell us if something is out of date.
Get variants worth testing
Paste a product URL and get 3 ad concepts with different hooks to test.
Start free