BigData Engineer
NTT DATA
Singapore1 month ago
77 views23 saves7 applies
Prepare for this role
Job Type
full time
Description
Requirements
- University Graduate in Computer Science or Related discipline
- 5-7 years of experience in developing, maintaining and supporting Enterprise Class Big Data Applications, preferably in banking environments
- Expertise in Big Data technologies/tools/platforms such as Hadoop, HDFS, Hive, Impala, HDFS, Presto, Spark, Hive, Impala, Zeppelin, Yarn, Cloudera, Hortonworks
- Experience in Relational Databases
- Knowledge and experience in coding and performance tuning of Spark jobs. Java Spark preferred but not compulsory
- Establish and adhere to best practices relating to Apache Spark programming
- Responsible for understanding functional/non-functional requirements and implement them in Apache Spark
- Experience in usage of CI/CD tools Jenkins, Git, Bitbucket
- Experience in writing Linux basic Shell Scripts
- Knowledge and experience in Apache Spark batch and streaming framework
- Knowledge of working with different file formats like Parquet, ORC, AVRO and JSON
- Knowledge of Micro Services architecture
- Knowledge of S3 is added advantage
- Ability to work proactively, independently and with cross-functional and cross-regional teams
- Strong communication and analytical skills and experience in Agile projects
This job is found at InterviewStack.io
Skills
hadoophiveprestosparkjavaapacheci/cdjenkinsgitlinuxparquets3agilerelational databases
About NTT DATA
NTT DATA helps clients transform through consulting, industry solutions, business process services, IT modernization and managed services.
it services, consultingWebsite