Experimentation & Growth Metrics Topics
Growth strategies, experimentation frameworks, and business optimization. Includes A/B testing, conversion optimization, and growth playbooks.
Product-Led Growth & Self-Serve Funnels
Growth driven by the product itself: self-serve signup and onboarding funnels, free-to-paid conversion, and in-product mechanics that acquire and expand users without sales touch. Covers instrumenting and optimizing the self-serve journey and the metrics that gauge a product-led motion. The concept scope is the PLG model and its funnels.
Segmentation Scheme Design and Governance
Designing and governing the segmentation schemes used to analyze product and business metrics. Covers choosing which dimensions materially affect a metric, cardinality handling and the bucketing of continuous dimensions, correlated and redundant dimensions, RFM versus clustering versus rule-based segmentation, granularity against statistical power, and canonical segment definitions that stay stable across analyses. The scope is how a segmentation is built, chosen and maintained, not diagnosing why a specific metric moved.
Experiment Analysis & Result Interpretation
Reading out an experiment after it runs: interpreting the treatment effect, deciding ship/no-ship, and reconciling conflicting or flat results. Covers reasoning under uncertainty, acting on inconclusive or limited data, and translating a measured effect into a business decision. The emphasis is turning experiment output into a defensible recommendation.
Attribution & Conversion Measurement
Measuring what drives a conversion: event tracking and instrumentation, attribution models (first-touch, last-touch, multi-touch), and connecting user actions to outcomes. Covers the analytics plumbing for reliable conversion measurement and the limits of each attribution approach. The scope is the measurement layer for conversions, not the creative or channel strategy that generates them.
User Retention & Engagement
Measuring and improving how users stick with a product after they first convert: retention rate and cohort retention curves (day 1, day 7, day 30, and longer horizons), churn rate, reactivation and resurrection of lapsed users, and engagement-depth signals such as DAU, WAU, MAU, and the DAU/MAU stickiness ratio. Covers defining and computing these metrics, including basic SQL and event-log implementations, diagnosing where and why a retention curve breaks (onboarding gaps, feature-adoption gaps, seasonal or cohort-specific effects), designing experiments and product interventions that deepen habitual usage, cohort-based lifetime value (LTV), and communicating retention findings to stakeholders. This is the post-acquisition, repeat-usage side of the user lifecycle: getting a first-time visitor through signup or first purchase is covered by the companion topic Conversion Funnel Optimization, and pure-SQL implementation depth at large scale (approximate-distinct computation, survival-curve modeling, multi-state subscription churn state machines, and standalone timezone-aware day bucketing) is covered by the companion topic Advanced SQL: Metric Monitoring, Anomaly Detection, and Data Correctness at Scale.
Experiment Prioritization & Roadmap
Running experimentation as a program: building and ranking a test backlog, prioritizing ideas by expected impact and effort, and sustaining experimentation velocity and iteration cadence. Covers scaling and rolling out winning variants, and the learning loop that feeds the next round of tests. The scope is the operating rhythm of a testing program, not the design of any single test.
Growth Metrics & Unit Economics
The core quantitative vocabulary of growth: activation, retention, referral and revenue metrics, growth-accounting frameworks such as AARRR, and unit economics including LTV, CAC, and payback period. Covers defining these metrics precisely and computing growth calculations that reveal whether growth is efficient and durable. The scope is metric definitions and economic math, not go-to-market execution.
Growth Experimentation & Tactics
The tactical, iterative side of growth: rapid ideation of unconventional levers, viral and referral loops, and incentive design that changes user behavior. Covers the growth-hacking mindset of cheap, fast tests to find scalable channels and mechanics. The scope is generating and testing growth tactics, distinct from formal statistical experiment design.
A/B Test Design & Statistical Rigor
Designing and statistically defending a controlled online experiment: framing a testable hypothesis, defining control and treatment variants, choosing the randomization unit, setting the primary success metric, and computing sample size, power, and minimum detectable effect. Covers the statistical foundations that make a readout trustworthy, including hypothesis testing, p-values, confidence intervals, statistical vs practical significance, and Type I/II error. Emphasizes avoiding the common pitfalls that invalidate a test, such as peeking, multiple-comparison inflation, underpowered designs, and how test duration and stopping rules affect the validity of conclusions.