Job DescriptionAWS Data Engineer
The Data Engineer’s responsible for architecture, design, & implementation of batch & streaming analytics, ML algorithms, NLP generation, & other emerging tech in the field of advanced analytics.
Experience in developing, deploying and operating on large scale distributed systems on a commercial scale
Experience working in Cloud-based Big Data Infrastructure eg: Azure, AWS
Good working experience on Cloud, Delta Lake, ETL processing.
Experience in Big Data technologies like HDFS, Hadoop, Hive, Pig, Sqoop, Kafka, Spark, etc.
Working knowledge on Python and PySpark Programming.
Working with a wide range of data sources like (DB2, SAP HANA etc) and intermediate expertise in SQL and PL/SQL(optional)
Ability to work with a global team, playing a key role in communicating problem context to the remote teams, stake holders and product owners.
Work in a highly agile environment
Excellent communication and teamwork skills.
Knowledge on Data Governance & Security Principles
Minimum BS in Computer Science or closely related discipline