Data Engineer (AWS)

Company: Tibil Solutions
Location: Bangalore
Experience: 4 – 6 Years
Employment Type: Full Time

Job Overview

We are looking for a skilled Data Engineer with strong experience in Python, SQL, and AWS data services to build and manage scalable data pipelines. The ideal candidate will work with large datasets, design efficient data processing workflows, and support analytics and reporting solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines for processing large datasets.
• Develop data processing scripts using Python.
• Write optimized SQL queries for data extraction and transformation.
• Process large volumes of data using Apache Spark (Scala or PySpark).
• Manage and store data using AWS S3.
• Implement serverless data workflows using AWS Lambda.
• Use AWS Glue Crawlers for data cataloging and metadata management.
• Query data efficiently using Amazon Athena.
• Develop dashboards or reports using Amazon QuickSight or other visualization tools.
• Monitor and optimize data pipelines using AWS CloudWatch.
• Work with Amazon EMR for big data processing.
• Integrate alerting or messaging workflows using AWS SNS when required.

Required Skills

• Strong proficiency in Python programming.
• Hands-on experience with SQL.
• Experience with Apache Spark (Scala or PySpark).
• Experience working with AWS S3.
• Experience with AWS Lambda.
• Hands-on experience with AWS Glue Crawlers.
• Experience with Amazon Athena.
• Experience with any data visualization tool (QuickSight, Power BI, Tableau, etc.)

Preferred Skills

• Experience with Amazon EMR.
• Knowledge of AWS SNS.
• Experience with AWS CloudWatch monitoring.

Eligibility

• 4 – 6 years of experience in Data Engineering or Big Data technologies.
• Experience working with AWS cloud services and big data tools.
• Strong problem-solving and analytical skills.