Free calculator · instant

A/B test sample size: can your traffic actually run this test?

Most stores don't have the traffic to detect a small lift. Enter your conversion rate, the smallest lift you care about and your daily visitors, and you get visitors per variant and days to run, and whether your traffic can finish the test at all.

5 inputsInstantNo signup
%
%
10% means 2.5% to 2.75%.
Visitors who reach the page being tested, both variants together.
Go deeper with the same numbers
How many visitors does an A/B test need?

At a 2.5% conversion rate, 95% significance and 80% power, a 10% relative lift takes about 64,200 visitors per variant to detect. A 20% lift takes about 16,800 and a 5% lift about 250,800. The practical floor is roughly 100 or more conversions per variant over at least two full weeks.

  • n per variant = (z(1−α/2) × √(2p̄(1−p̄)) + z(1−β) × √(p₁(1−p₁) + p₂(1−p₂)))² ÷ (p₂ − p₁)².
  • p₁ is the baseline rate, p₂ the rate after the lift, p̄ their average.
  • Days to run = 2n ÷ daily visitors in the test.
Worked example. Baseline 2.5%, a 10% lift to 2.75%, 95% significance, 80% power: about 64,200 visitors per variant, 128,400 in total. At 3,000 visitors a day that is about 43 days.
Source: Taylor Sicard, Taylor Sicard Consulting · Benchmarks reviewed September 2026 · Method and benchmarks: High-ROI A/B tests for ecommerce
Method

How the number is calculated

This is the standard two-proportion sample size for a two-sided test with a 50/50 split. It reproduces the sessions-per-variant table in my product page post: 64,200 at a 2.5% baseline and a 10% lift. Days to run divides both variants' visitors by your daily traffic.

21 days or fewerRunnable. Keep it to at least 14 days for two weekly cycles.
22-56 daysLong enough for seasonality and promos to muddy it. Test a bigger change.
Over 56 daysNot a test your traffic can run. Ship on judgement and measure before and after.

With low traffic, test big swings and ship small fixes on judgement. When the test is done, read it with the significance calculator. Every calculator lives on the free tools hub.

Questions

Common questions

How do you calculate sample size for an A/B test?
From four inputs: baseline conversion rate, the smallest relative lift you want to detect, significance (usually 95%) and power (usually 80%). At 2.5% and a 10% lift that comes to about 64,200 visitors per variant.
How long should an A/B test run?
Until it reaches the sample size you set in advance, and at least 14 days so it covers two weekly cycles. About 21 days is a sensible default window.
What if my store doesn't have enough traffic to A/B test?
Then don't run a test that can't finish. Test bigger changes, which need far fewer visitors, or ship the change and compare before and after with the date annotated.
What is minimum detectable effect?
The smallest lift the test is built to detect reliably. Halving it roughly quadruples the visitors you need, which is why tiny lifts are a trap for smaller stores.