What STATISTICAL SIGNIFICANCE means in the A/B Test
What does Statistical Significance mean?
Significance serves to determine the reliability rate of your test. This calculation is based on the display percentage of each of the variations (copies) of the Experiment (test) and on the total number of visits received.
What are the reliability levels?
Red | Orange | Green | Blue |
|---|---|---|---|
Low reliability | Medium reliability | High reliability | Goal exceeded |
When to end the experiment?
When the number of visits (significance) on the page is higher than the one set by your experiment, this indicates that you have reached the sample size needed to conclude the test and have greater confidence in your experiment.
The minimum number for significance will increase or decrease according to the number of variations (copies) you created for the experiment. The fewer variations created, the lower the number required for the experiment to be considered reliable.
You can end the experiment at any time, although it is recommended to reach the defined statistical significance to ensure reliable results.
Still have questions? Reach out to our team on Chat! We're always happy to help.
Updated on: 08/01/2026
Thank you!