InterviewStack.io LogoInterviewStack.io
Browse more Data Engineer jobs

Data Engineer

C2 Essentials, Inc

Virginia2 weeks ago
5 views1 saves0 applies

Prepare for this role


Benefits

Remote Work

Job Type

full time

Description

We are seeking highly skilled Data Engineers (DA II / DA III) to support a critical federal data modernization initiative focused on enterprise financial management, general ledger analytics, and large-scale data integration efforts. This role is ideal for professionals with strong experience building and optimizing data pipelines, working with Databricks, and supporting cloud-based data platforms within federal environments.

The selected candidates will play a key role in developing scalable data solutions, implementing automated data quality controls, and supporting advanced analytics initiatives leveraging AWS GovCloud and the Advana platform.

Work location is hybrid including majority remote with meetings in Tysons Corner and Crystal City.

Key Responsibilities

• Build, manage, optimize, and maintain enterprise data pipelines within the Advana platform
• Design, develop, and implement scalable ETL/ELT processes to support large-scale data integration and analytics requirements
• Develop data ingestion frameworks utilizing Databricks technologies including Delta Lake, Autoloader, and scheduled jobs 
• Perform data cleansing, transformation, aggregation, and enrichment activities across multiple financial data sources 
• Support Federal Financial Management (FM) and General Ledger (GL) data initiatives
• Analyze and reconcile Universe of Transactions (UoT) data to ensure financial data accuracy and consistency
• Implement and maintain Medallion Architecture frameworks (Bronze, Silver, Gold layers)
• Develop automated data validation, monitoring, and quality assurance processes
• Collaborate with data analysts, product owners, engineers, and business stakeholders to deliver high-quality data solutions
• Optimize performance of large-scale data pipelines and troubleshoot complex data processing issues
• Support cloud-based data environments within AWS GovCloud
• Contribute to CI/CD pipeline development and DevSecOps best practicea 
• Maintain technical documentation and support data governance initiatives


Required Qualifications

• Active Interim Secret Clearance or higher is required
• Demonstrated experience building, managing, and optimizing data pipelines within the Advana platform 
• Hands-on experience with Databricks, including: 
    o Delta Lake 
    o Autoloader 
    o Job Scheduling 
• Experience designing and implementing ETL/ELT processes 
• Experience with data wrangling techniques including: 
    o Data Cleansing 
    o Data Transformation 
    o Data Aggregation 
• Proven experience supporting large-scale Federal Financial Management (FM) and General Ledger (GL) data environments
• Experience with Universe of Transactions (UoT) reconciliations
• Experience working within AWS GovCloud environments
• Experience utilizing cloud services such as Amazon S3
• Familiarity with Medallion Architecture (Bronze, Silver, Gold)
• Experience implementing data quality frameworks and automated validation processes


Technical Skills

• Advanced Python development skills
• Strong experience with: 
    o PySpark 
    o Pandas 
• Expert-level SQL development and optimization
• Experience with GitLab and version control best practices
• Strong understanding of CI/CD principles and DevSecOps methodologies
• Ability to troubleshoot, optimize, and scale complex enterprise data pipelines
• Excellent communication and stakeholder engagement skills


Preferred Qualifications

• Experience with Unity Catalog for data governance
• Knowledge of SAP data structures
• Experience supporting Department of Defense (DoD) financial systems
• Familiarity with enterprise data governance and metadata management frameworks


C2 Essentials is an Equal Opportunity Employer.

This job is found at InterviewStack.io

Skills

analyticsdata pipelinesdatabricksawsetldelta lakemonitoringci/cddevsecopsreconciliationss3pythonpysparkpandassqlgitlabgeneral ledgerdata governancedata qualitydata integrationtechnical documentationquality assurancequality controlstakeholder engagementdata structuresdata ingestiondata transformation

About C2 Essentials, Inc

C2 Essentials provides human resources services and solutions, helping organizations manage their teams and protect their bottom line through proper HR management.

human resources, staffingWebsite