InterviewStack.io LogoInterviewStack.io
Browse more Data Engineer jobs

Data Engineer

Indiumsoft

Hyderabad, Telangana, India2 months ago
38 views19 saves0 applies

Prepare for this role


Job Type

full time

Description

Job Title: Data Engineer Job Description: • Design, build, and maintain scalable data pipelines using PySpark and Python • Develop and optimize complex SQL queries for large datasets • Implement and manage ETL/ELT processes ensuring data quality and reliability • Collaborate with business and product teams to translate data requirements into solutions • Build and maintain data warehouse solutions • Handle large-scale data processing using Hadoop/Big Data technologies • Perform performance tuning and optimization of data workflows Required Skills: • Strong hands-on experience with PySpark and Python • Advanced proficiency in SQL • Solid experience in ETL processes and data warehousing • Familiarity with Hadoop ecosystem and Big Data technologies • Experience working with large datasets in distributed environments • Good communication and business understanding Good to Have: • Experience with Apache Airflow • Exposure to cloud platforms (AWS, GCP, Azure) • Knowledge of data lakes and modern data architectures • Experience with streaming tools (Kafka, Spark Streaming)

This job is found at InterviewStack.io

Skills

data pipelinespysparkpythonsqletlhadoopdata warehousingapacheairflowawsgcpazurekafkasparkdata qualitydata architecture

About Indiumsoft

Indiumsoft is an IT services company based in Hyderabad, Telangana, India. The company specializes in software development and operations automation, with job openings indicating a focus on Python and related technologies.

it services, technology