A/B Buddy 1.1.0

When conducting an experiment, whether in a digital environment or a physical one, ensuring the collection of an appropriate amount of data is essential for establishing scientifically valid results.

A/B Buddy serves as a sample-size calculator designed to facilitate the design of A/B experiments with ease. Utilizing a power-analysis formula, it provides precise calculations regarding the number of subjects required to detect a statistically significant difference between two groups. This capability addresses concerns regarding sample size, as insufficient participants may obscure meaningful differences between variants, whereas excessive enrollment can extend the duration of the experiment unnecessarily. A/B Buddy effectively identifies the optimal sample size needed.

For example, if your current conversion rate is 10% and you aim to determine if a proposed design change can elevate that rate to 12%, reflecting a 20% increase, A/B Buddy simplifies this process. By inputting the baseline conversion rate of 10% and the minimum detectable effect of 20%, the required sample size appears promptly at the top of the interface.

Furthermore, A/B Buddy includes a Share button that directs users to a web page showcasing their sample size calculations. It is important to note that all data remains completely private; information is stored within the URL fragment and is not transmitted to any external servers.

The application defaults to widely accepted statistical thresholds: a significance level of 5% and a power level of 80%. While many users will find these settings sufficient for their purposes, advanced users have the option to customize them by unlocking additional features through an in-app purchase.

For inquiries or feedback, users are encouraged to reach out via email at [email protected].