Growth & Business Optimization Topics
Growth strategies, experimentation frameworks, and business optimization. Includes A/B testing, conversion optimization, and growth playbooks.
Experimentation and Product Validation
Designing and interpreting experiments and validation strategies to test product hypotheses. Includes hypothesis formulation, experimental design, sample sizing considerations, metrics selection, interpreting results and statistical uncertainty, and avoiding common pitfalls such as peeking and multiple hypothesis testing. Also covers qualitative validation methods such as interviews and pilots, and using a mix of methods to validate product ideas before scaling.
Customer Experience and Data Driven Thinking
Covers the ability to understand and improve customer experience using quantitative and qualitative evidence. Interviewers look for candidates who analyze user behavior and funnel metrics, identify drop off points, use experiments or controlled tests to validate hypotheses, and balance data signals with user research and empathy. This topic includes awareness of data quality and measurement limitations, selecting appropriate success metrics, interpreting results responsibly, and using insights to prioritize and influence product or process changes that improve customer outcomes. Candidates should show structured thinking about measurement, trade offs when data is incomplete, and how to communicate data driven recommendations to technical and non technical stakeholders.
Metrics Selection and Diagnostic Interpretation
Addresses how to choose appropriate metrics and how to interpret and diagnose metric changes. Includes selecting primary and secondary metrics for experiments and initiatives, balancing leading indicators against lagging indicators, avoiding metric gaming, and handling conflicting signals when different metrics move in different directions. Also covers anomaly detection and root cause diagnosis: given a metric change, enumerate potential causes, propose investigative steps, identify supporting diagnostic metrics or logs, design quick experiments or data queries to validate hypotheses, and recommend remedial actions. Communication of nuanced or inconclusive results to non technical stakeholders is also emphasized.
Growth and Product Metrics Analysis
Analysis skills specific to growth and product contexts: interpreting funnel metrics, cohort and retention analyses, attribution of acquisition versus activation, detecting seasonality and external event impacts, and diagnosing conversion or engagement changes. Candidates should be able to form hypotheses about what drove changes, propose targeted follow up analyses or A B tests, and identify which additional metrics are needed to evaluate unit economics and growth efficiency.
Metric Frameworks and Goal Alignment
Understand how to choose, define, and apply metric frameworks that align product work to company objectives. Topics include common frameworks such as Acquisition, Activation, Retention, Revenue, Referral as well as selecting a single North Star metric that represents overall business success. Candidates should be able to define metrics at multiple levels including feature level, product level, and business level; distinguish leading indicators from lagging indicators and explain how leading metrics predict lagging outcomes; decompose a North Star into measurable submetrics and team level signals that teams can influence directly; set measurable targets and success criteria; and explain why a given metric is the most appropriate North Star for a particular business model. Practice scenarios include choosing metrics for feature launches, improving conversion or retention, reducing friction in checkout flows, and increasing engagement or virality, and describing how those metrics map to business outcomes and Objectives and Key Results.
A/B Testing and Optimization Methodology
Discuss your experience designing and running A/B tests on content elements: headlines, formats, messaging, calls-to-action, visual design, content length, etc. Share specific examples of tests you've run with results and how you implemented learnings. Discuss statistical significance and proper experimental design. Show how you prioritize testing opportunities and build a testing roadmap.
Experimentation Methodology and Rigor
Focuses on rigorous experimental methodology and advanced testing approaches needed to produce reliable, actionable results. Topics include statistical power and minimum detectable effect trade offs, multiple hypothesis correction, sequential and interim analysis, variance reduction techniques, heterogenous treatment effects, interference and network effects, bias in online experiments, two stage or multi component testing, multivariate designs, experiment velocity versus validity trade offs, and methods to measure business impact beyond proximal metrics. Senior level discussion includes designing frameworks and practices to ensure methodological rigor across teams and examples of how to balance rapid iteration with safeguards to avoid false positives.
AARRR Growth Framework & Metrics
Understand the AARRR model (Acquisition, Activation, Retention, Revenue, Referral) as a mental model for thinking about growth. Know how to map growth problems to specific stages: acquisition challenges differ from retention problems. Learn standard metrics for each stage (CAC, LTV, activation rate, retention cohorts, viral coefficient). Practice identifying which stage is most relevant for a given problem.
Experimentation Strategy and Advanced Designs
When and how to use advanced experimental methods and how to prioritize experiments to maximize learning and business impact. Candidates should understand factorial and multivariate designs interaction effects blocking and stratification sequential testing and adaptive designs and the trade offs between running many factors at once versus sequential A and B tests in terms of speed power and interpretability. The topic includes Bayesian and frequentist analysis choices techniques for detecting heterogeneous treatment effects and methods to control for multiple comparisons. At the strategy level candidates should be able to estimate expected impact effort confidence and reach for proposed experiments apply prioritization frameworks to select experiments and reason about parallelization limits resource constraints tooling and monitoring. Candidates should also be able to communicate complex experimental results recommend staged follow ups and design experiments to answer higher order questions about interactions and heterogeneity.