Data Science & Analytics Topics
Statistical analysis, data analytics, big data technologies, and data visualization. Covers statistical methods, exploratory analysis, and data storytelling.
Analysis to Recommendation and Decision Framing
Ability to move from analysis to a concise, justified recommendation and a pragmatic plan for decision and implementation. Candidates should lead with a clear recommendation or conditional decision, support it with evidence and trade offs, quantify expected business impact, estimate effort and time horizon, and state assumptions and limitations. The skill set includes proposing prioritized action plans and alternative options, anticipating objections, defining monitoring and rollback strategies, translating technical remediation or risk into business terms and measurable success metrics, and tailoring recommendations to stakeholder needs and constraints.
Measurement Design and Analysis
Practical measurement design and analytic techniques for producing reliable metric signals and proving impact. Includes instrumentation and tracking plans, experiment selection and validation, attribution modeling and its limitations, sample size and statistical considerations, identifying confounding variables, and reasoning about correlation versus causation. Also covers tradeoffs in data collection and data quality checks, cohort and segmentation design, baselining and threshold setting, designing dashboards and monitoring cadence, and connecting engineering and telemetry data to business outcomes. Candidates should be able to write clear measurement plans and success criteria, describe experiment and validation approaches, and explain how to operationalize results through reporting and iteration.
Engineering and Business Outcomes
How engineering work and technical decisions translate into measurable business outcomes and how to demonstrate that linkage. Topics include mapping architecture choices, reliability, performance improvements and developer productivity initiatives to business metrics such as revenue, customer engagement, time to market, cost reduction and customer satisfaction. Candidates should be able to identify engineering metrics to track including latency, availability, error and incident rates, cycle time and deployment frequency, explain instrumentation strategies to capture signals, design measurement plans and experiments to establish causal impact, and attribute observed changes to specific engineering efforts. This topic also covers communicating technical tradeoffs and impact to nontechnical stakeholders, choosing appropriate granularity for measurement, and describing concrete initiatives with their measurement approach and quantified business impact.
Design and Product Analytics
Using quantitative metrics to inform product and design decisions. Covers key user engagement metrics such as conversion rates, task completion, retention, and feature adoption, and how to instrument and interpret these signals using analytics platforms and product dashboards. Explains how quantitative data complements qualitative research, how to identify design problems from metrics, design experiments and metrics for validation, and how to translate findings into design priorities and success criteria.
Visualization Selection and Effectiveness
Demonstrating the ability to choose appropriate chart types for different data patterns (trends over time, categorical comparisons, distributions, correlations). Creating visualizations that communicate clearly without ambiguity. Using color, formatting, and labels effectively to enhance understanding.
Business Impact Measurement and Metrics
Selecting, measuring, and interpreting the metrics that show whether an initiative, product, or program actually delivered value, and using that evidence to guide decisions. Covers headline outcome metrics (revenue decomposition, customer lifetime value, churn and retention, average revenue per user, unit economics and cost per transaction) alongside operational indicators (throughput, quality, reliability) and how to connect the two. Candidates should be able to distinguish leading from lagging indicators, map operational metrics to business outcomes, form and test hypotheses about what is driving a metric, choose an evaluation window, and recommend changes to what gets measured. Also covers the fundamentals of establishing a valid baseline and comparison group (before/after checks, A/B tests, and other quasi-experimental comparisons when a controlled test is not possible), reasoning about whether an observed change is large enough and reliable enough to act on, and ruling out obvious confounding explanations. Includes quick back-of-the-envelope estimation for order-of-magnitude impact, translating technical or operational metrics into business consequences, building a simple health dashboard for a program or initiative, and communicating results (including uncertainty) as a clear, decision-ready narrative for stakeholders. Depth and specific techniques (for example difference-in-differences, regression discontinuity, or survival analysis) should scale to the role: some interviews probe rigorous experimental design, others probe sound judgment using simpler before/after comparisons.
Analytical Background
The candidate's approach to analytical, evidence-based problem solving: how they take an ambiguous question, break it into testable pieces, gather and examine relevant information or data, choose appropriate methods to reach a conclusion, and turn that conclusion into a concrete recommendation or decision. This can show up as quantitative work (statistics, data analysis, experimentation, dashboards) or as qualitative and domain-specific analysis (reviewing logs or incidents, case or contract research, market or process analysis, root-cause investigation). Draw on academic projects, internships, or professional work. Focus on the end-to-end path: how the question or hypothesis was framed, what evidence was examined and with what tools or methods, what trade-offs were considered, and how the resulting insight changed a real decision or outcome.
Metrics and KPI Fundamentals
Core principles and practical fluency for defining, measuring, and interpreting metrics and key performance indicators, applicable across any professional domain. Candidates should be able to select meaningful metrics aligned to business objectives rather than vanity metrics, explain the difference between a metric and a target, and distinguish leading indicators from lagging indicators. Coverage includes decomposing complex outcomes into actionable component metrics, writing precise metric definitions (for example what counts as an active user, a completed case, a qualified lead, or a resolved ticket, depending on the domain), calculating common rate-based metrics such as engagement rate, churn rate, conversion rate, cycle time, or utilization rate, establishing baselines and sensible targets, and interpreting signal versus noise including awareness of statistical variability. Also includes using segmentation and cohort analysis to diagnose metric movements, and recommending two to three meaningful metrics for a hypothetical problem in the candidate's own domain with justification and action plans.
Dashboard and Data Visualization Design
Principles and practices for designing, prototyping, and implementing visual artifacts and interactive dashboards that surface insights and support decision making. Topics include information architecture and layout, chart and visual encoding selection for comparisons trends distributions and relationships, annotation and labeling, effective use of color and white space, and trade offs between overview and detail. The topic covers interactive patterns such as filters drill downs tooltips and bookmarks and decision frameworks for when interactivity adds user value versus complexity. It also encompasses translating analytic questions into metrics grouping related measures, wireframing and prototyping, performance and data latency considerations for large data sets, accessibility and mobile responsiveness, data integrity and maintenance, and how statistical concepts such as statistical significance confidence intervals and effect sizes influence visualization choices.