Course · practitioners who run experiments and want to level up
Experiment Design & Analysis
Advanced design decisions and statistical analysis for practitioners who already run experiments. Learn to keep results interpretable, handle messy or borderline data, and make defensible decisions under real-world constraints.
Your instructor
Javid Jamae
Growth engineering leader who scaled Postman from $60M to $100M+ ARR and 20M+ users as Head of Engineering for Growth. Has built and audited experimentation systems at Achieve, Earnest, and Tout. 20+ years in engineering and product leadership.
What you will learn
What you will be able to do by the end.
Choose an MDE anchored in a minimum worthwhile effect and break-even lift, not a guess.
Recognize why peeking inflates false positives and judge signal stability from p-value and confidence-interval trends over time.
Interpret borderline and not-significant results with confidence intervals instead of overclaiming on "directional" language.
Handle inconclusive results with Bayesian lenses, Type M error checks, power curves, and soft decision playbooks.
Communicate uncertainty to stakeholders honestly, reporting point estimates and CIs and stating clearly when a result is inconclusive.
Curriculum · 4 lessons
Everything inside the course.
This course is actively being written. The sections below are live now, with new modules added regularly.
Reducing Experiment Runtime
Get to a decision faster by anchoring the MDE in a minimum worthwhile effect and tightening what you actually need to detect.
Running and Stopping Experiments
Read results honestly: why peeking misleads, how to judge signal stability, and what to do with borderline or inconclusive outcomes.
How to get access
Included with your Delivering Growth membership.
You do not buy this course on its own. Subscribe to the Delivering Growth community on Skool and you get this course plus every other course, the calculators, and the Custom GPT.
- All video lessons and written breakdowns for this course
- Every other Delivering Growth course, included in the same membership
- The Custom GPT trained on the full course material
- Free A/B testing calculators and design templates
- Community access and all future course updates