Statistical Testing

This page brings together three tools for testing a difference or preparing a measurement. A/B significance shows whether the gap between two variants holds. Sample size helps plan how many visitors to expect. UTM parser breaks a campaign address into its parameters. These tools suit marketing teams that want to check an intuition before acting. Free and no account needed.

Begin with the question you have. If two variants and their results already exist, A/B significance examines the observed gap. If you are planning a test, Sample size offers a reference before launch. UTM parser is more about checking where a campaign came from and how its parameters are set. The three work together, but each fits a different moment in the test.

How to use

Before a test, start with Sample size: enter the difference to detect and the requested parameters to get a volume reference.
During or after collection, use A/B significance: enter the results of both variants and check whether the observed gap holds.
To check provenance, open UTM parser: break the campaign address into parameters and verify that source, medium and campaign are named consistently.
Finally, review the three elements together: planned volume, strength of the gap and campaign parameters. If a UTM label changes, the analysis can become hard to compare.

Frequently asked questions

Does A/B significance prove that one variant is better?

It shows whether the observed gap can be treated as solid given the data entered. It does not prove by itself that a variant will win everywhere or over time.

Why calculate a Sample size?

To avoid deciding too early from a small number of visitors. The result gives a volume reference before launching or extending a test.

What is UTM parser for?

It reads a campaign address and lists its parameters. It helps check that a source, medium or campaign is named correctly before analysis.

Can I launch a test without calculating Sample size?

You can, but you risk deciding too early from a small volume. Sample size gives a reference before launch. Use it with A/B significance to interpret the gap once results are available.

Does UTM parser influence A/B significance?

Not directly. UTM parser checks provenance parameters. A naming mistake can still make groups hard to compare, so check the addresses before reading A/B significance.