Data Engineering & Analytics Infrastructure Topics
Data pipeline design, ETL/ELT processes, streaming architectures, data warehousing infrastructure, analytics platform design, and real-time data processing. Covers event-driven systems, batch and streaming trade-offs, data quality and governance at scale, schema design for analytics, and infrastructure for big data processing. Distinct from Data Science & Analytics (which focuses on statistical analysis and insights) and from Cloud & Infrastructure (platform-focused rather than data-flow focused).
Geospatial and Real Time Processing
Covers design and operation of systems that handle spatial data and low latency event streams. Candidates should explain spatial indexing and query techniques, map matching and coordinate reference considerations, spatial accuracy and privacy trade offs, and storage approaches for geospatial data. For real time processing describe ingestion, messaging patterns, stream processing concepts such as windowing and stateful processing, ordering and delivery semantics, partitioning and scaling strategies, backpressure and fault handling, and trade offs between real time and batch analytics for customer facing metrics.
Batch and Stream Processing
Covers design and implementation of data processing using batch, stream, or hybrid approaches. Candidates should be able to explain when to choose batch versus streaming based on latency, throughput, cost, data volume, and business requirements, and compare architectural patterns such as lambda and kappa. Core stream concepts include event time versus processing time, windowing strategies such as tumbling sliding and session windows, watermarks and late arrivals, event ordering and out of order data handling, stateful versus stateless processing, state management and checkpointing, and delivery semantics including exactly once and at least once. Also includes knowledge of streaming and batch engines and runtimes, connector patterns for sources and sinks, partitioning and scaling strategies, backpressure and flow control, idempotency and deduplication techniques, testing and replayability, monitoring and alerting, and integration with storage layers such as data lakes and data warehouses. Interview focus is on reasoning about correctness latency cost and operational complexity and on concrete architecture and tooling choices.
Data Reliability and Fault Tolerance
Design and operate data pipelines and stream processing systems to guarantee correctness, durability, and predictable recovery under partial failures, network partitions, and node crashes. Topics include delivery semantics such as at most once, at least once, and exactly once and the trade offs among latency, throughput, and complexity. Candidates should understand idempotent processing, deduplication techniques using unique identifiers or sequence numbers, transactional and atomic write strategies, and coordinator based or two phase commit approaches when appropriate. State management topics include checkpointing, snapshotting, write ahead logs, consistent snapshots for aggregations and joins, recovery of operator state, and handling out of order events. Operational practices include safe retries, retry and circuit breaker patterns for downstream dependencies, dead letter queues and reconciliation processes, strategies for replay and backfill, runbooks and automation for incident response, and failure mode testing and chaos experiments. Data correctness topics include validation and data quality checks, schema evolution and compatibility strategies, lineage and provenance, and approaches to detect and remediate data corruption and schema drift. Observability topics cover metrics, logs, tracing, alerting for pipeline health and state integrity, and designing alerts and dashboards to detect and diagnose processing errors. The topic also includes reasoning about when exactly once semantics are achievable versus when at least once with compensating actions or idempotent sinks is preferable given operational and performance trade offs.
Data Lake and Warehouse Architecture
Designing scalable data platforms for analytical and reporting workloads including data lakes, data warehouses, and lakehouse architectures. Key topics include storage formats and layout including columnar file formats such as Parquet and table formats such as Iceberg and Delta Lake, partitioning and compaction strategies, metadata management and cataloging, schema evolution and transactional guarantees for analytical data, and cost and performance trade offs. Cover ingestion patterns for batch and streaming data including change data capture, data transformation approaches and compute engines for analytical queries, partition pruning and predicate pushdown, query optimization and materialized views, data modeling for analytical workloads, retention and tiering, security and access control, data governance and lineage, and integration with business intelligence and real time analytics. Also discuss operational concerns such as monitoring, vacuuming and compaction jobs, metadata scaling, and strategies for minimizing query latency while controlling storage cost.
Data Quality and System Integration Challenges
Focuses on data integrity, governance, and the operational issues that arise when data moves between systems. Candidates should be able to identify common data quality problems such as duplicates, missing or inconsistent fields, formatting mismatches, schema drift, and validation gaps. Understand how those issues propagate through integration pipelines and impact reporting, analytics, forecasting, and other downstream processes. Discuss reconciliation strategies, validation rules, data cleansing, deduplication, master data management patterns, monitoring and alerting for data anomalies, and policies for schema evolution and versioning. Also cover practical approaches to prevent and remediate integration induced data errors and how to prioritize data quality work across cross-system business workflows (for example, CRM/billing integrations, HR and compensation data feeds, marketing automation pipelines, or product analytics), not just any single business function.
Data Integration and Flow Design
Design how systems exchange synchronize and manage data across a technology stack. Candidates should be able to map data flows from collection through activation, choose between unidirectional and bidirectional integrations, and select real time versus batch synchronization strategies. Coverage includes master data management and source of truth strategies, conflict resolution and reconciliation, integration patterns and technologies such as application programming interfaces webhooks native connectors and extract transform load processes, schema and field mapping, deduplication approaches, idempotency and retry strategies, and how to handle error modes. Operational topics include monitoring and observability for integrations, audit trails and logging for traceability, scaling and latency trade offs, and approaches to reduce integration complexity across multiple systems. Interview focus is on integration patterns connector trade offs data consistency and lineage and operational practices for reliable cross system data flow.
Data Architecture and Pipelines
Designing data storage, integration, and processing architectures. Topics include relational and NoSQL database design, indexing and query optimization, replication and sharding strategies, data warehousing and dimensional modeling, ETL and ELT patterns, batch and streaming ingestion, processing frameworks, feature stores, archival and retention strategies, and trade offs for scale and latency in large data systems.
Cloud Data Architecture and Tradeoffs
Designing data architectures specifically for cloud environments and evaluating platform trade offs. Topics include when to use managed relational services, managed nonrelational services, cloud data warehouses, cloud object storage, lifecycle policies, cross region replication, data residency and compliance considerations, cost versus performance trade offs, managed service operational constraints, and strategies for high availability and disaster recovery in the cloud. Candidates should be able to compare cloud service options and justify choices based on reliability, cost, and compliance.
Data Quality and Database Management
Principles and practices for ensuring clean, accurate, and well governed databases and data systems. Covers data hygiene techniques such as deduplication, validation rules, field standardization, regular audits, record merging, archival policies, and remediation workflows. Includes data governance topics like data ownership, stewardship, policy definition, documentation, privacy and compliance controls, and role based access. Addresses how poor data quality propagates downstream into reporting, analytics, personalization, and business decision making, and how to trace root causes across ingestion, transformation, and storage layers. Candidates should be able to diagnose common integrity issues (duplicates, stale or missing fields, schema drift, broken foreign keys), propose tooling and process solutions, and explain how to operationalize data quality and governance at scale across an organization's data systems.