All courses

Course · PMs, engineers, and analysts

Foundations of Experimentation

A practical survival guide for building experiments that will not lie to you. You do not need to memorize formulas or run your own analysis. You just need to understand why experiments work, what can break them, and how to tell good data from garbage data.

17 lessons PMs, engineers, and analysts Included with membership
JJ

Your instructor

Javid Jamae

Growth engineering leader who scaled Postman from $60M to $100M+ ARR and 20M+ users as Head of Engineering for Growth. Has built and audited experimentation systems at Achieve, Earnest, and Tout. 20+ years in engineering and product leadership.

What you will learn

What you will be able to do by the end.

Speak fluently with data scientists and experimentation tool vendors.

Understand what your testing platform is doing under the hood.

Know when results are trustworthy and when they are not.

Spot the signs of broken tests, like sample ratio mismatch or underpowered samples.

Know how and when to stop an experiment, with the right method for your platform.

Curriculum · 17 lessons

Everything inside the course.

01

Getting Started

Orient yourself to the course and the statistical mindset that separates trustworthy experiments from guesswork.

01Course Overview
02Intro to Experiment Statistics
02

Why Experiments Work

Understand what separates proof from correlation: study types, randomized controlled trials, and why A/B tests bring scientific rigor to product and growth decisions.

03Statistical Studies and RCTs
04Why Experiment?
05Intro to A/B Testing
06Objective, Outcome, and Factors
07The Experimentation Lifecycle
03

Sampling and Statistics

The statistical core: how sampling and assignment work, why variance and the central limit theorem matter, and how power, error rates, sample size, and MDE decide whether a test can succeed.

08Sampling and Assignment
09Variance and The Central Limit Theorem
10Power and Error Rates
11Sample Size and Minimum Detectable Effect (MDE)
04

Designing and Reading Experiments

Put the statistics to work: size experiments with calculators, interpret p-values and confidence intervals, watch a simulation, and know when to stop and how to spot a broken test.

12Experiment Design Calculators
13Inference, P-Value, and Confidence Intervals
14A/B Test Simulation
15Stopping an Experiment
16Sample Ratio Mismatch (SRM)
17Course Recap

How to get access

Included with your Delivering Growth membership.

You do not buy this course on its own. Subscribe to the Delivering Growth community on Skool and you get this course plus every other course, the calculators, and the Custom GPT.

  • All video lessons and written breakdowns for this course
  • Every other Delivering Growth course, included in the same membership
  • The Custom GPT trained on the full course material
  • Free A/B testing calculators and design templates
  • Community access and all future course updates
Subscribe on Skool to get access