We recently dropped version 0.7.0 of the GrowthBook experimentation platform. Here are some of the cool new features:
Experiment results over time
One of our most requested features is now live! There’s a new built-in Date dimension you can use to view how your experiment performed over time. The line shows the uplift with a shaded 95% confidence interval. You can toggle between viewing each day independently (default) or cumulatively. Performance over time can be helpful in detecting novelty or primacy effects.
Full statistics when exploring by dimensions
Now when you do a dimensional analysis on the results of an experiment, you can see the full statistical results, with the chance to beat control, risk, and a percent change graph. This is enabled by default when there are fewer than 5 unique dimension values and can be toggled on manually for dimensions with more values.
Experiment Segments and SQL Filters
You can now apply a segment to an experiment to limit who is included in the analysis. For more control, you can also now add a custom WHERE clause to the experiment query. These new settings along with existing ones that control the analysis are now all easily accessible in a single place on the results page.
Added per metric minimum percent change
We added support for a minimum percent change that is customizable per metric. If an experiment fails to move a metric by this amount, we consider the change insignificant. This is related to the max percent change, where if an experiment changes a metric too much it’s considered suspicious. These settings help encourage best practices when it comes to interpreting results.
Other improvements:
- Easily clone/duplicate a metric
- Added filtering and sorting to the metrics pages
- Added filtering and sorting to past experiments
- Added the ability to delete segments and dimensions
Plus numerous other enhancements and bug fixes. You can read about the full list of changes here.
Have a great week!
