Key Responsibilities

• Design, develop, test, and deploy ETL workflows using Ab Initio, Informatica PowerCenter, or IBM DataStage.

• Develop and optimize complex SQL queries, stored procedures, and database objects.

• Build and maintain data integration processes for large-scale enterprise data warehouses.

• Work extensively with Teradata databases for data extraction, transformation, and loading activities.

• Develop and maintain PySpark applications for big data processing and data transformation.

• Analyze source-to-target mappings and implement data transformation logic.

• Perform data validation, reconciliation, and quality checks to ensure data accuracy and consistency.

• Troubleshoot ETL job failures, performance bottlenecks, and data issues.

• Collaborate with business analysts, data architects, and stakeholders to gather and understand requirements.

• Follow best practices for ETL development, coding standards, and documentation.

• Participate in code reviews, testing, deployment, and production support activities.

• Monitor ETL processes and ensure timely execution of data loads

Technical Skills

• Strong experience with at least one ETL tool:

  • Ab Initio (Preferred)

  • Informatica PowerCenter

  • IBM DataStage

• Advanced SQL development and query optimization skills.

• Hands-on experience with Teradata databases.

• Strong knowledge of PySpark and distributed data processing concepts.

• Experience with data warehousing concepts, dimensional modeling, and ETL methodologies.

• Knowledge of Unix/Linux shell scripting.

• Experience with data validation, data quality, and reconciliation processes.

• Understanding of performance tuning and optimization techniques.

Requirements

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

• 5+ years of experience in ETL/Data Engineering development.

• Strong analytical, problem-solving, and troubleshooting skills.

• Excellent communication and collaboration abilities.