- As a Data Engineer, you will be required to select and integrate any Big Data tools and frameworks required to provide requested capabilities. Will also be involved in implementing the data ingestion & ETL/ELT processes in modern data systems.
Required Skills, Competencies & Experience:
- 4+Years of Experience.
- Expert level proficiency in SQL. Proficiency in any of the programming language: Python/ Scala/ Java
- Experience with Cloud infrastructure like AWS / Azure.
- Expertise in building data pipelines, efficient ETL design, implementation, and maintenance.
- Hands on experience on Hadoop tools/technologies like Spark / Databricks, Map Reduce, Hive, HDFS.
- Expertise and excellent understanding of big data toolset such as Sqoop, Spark-streaming, Kafka, NiFi
- Good working knowledge in NoSQL DB (Mongo, HBase, Casandra) desired.