Job DescriptionAzure Data Engineer
The Data Engineer’s responsible for architecture, design, & implementation of batch & streaming analytics, ML algorithms, NLP generation, & other emerging tech in the field of advanced analytics.
Minimum BS degree in Computer Science or similar field
Four plus years of experience with (Hadoop Distributed File System, Hadoop, Hive, Pig, Sqoop, Kafka, Apache Spark, hBase, Oozie, No SQL databases, PostgreSQL, GIT, REST API, Snowflake, etc.)
Experience in Java/Python/Scala
Experience extracting/querying/joining large data sets at scale
Experience building data platforms using Azure stack
Experience building data ingestion pipelines using Azure Data Factory to ingest structured & unstructured data
Strong knowledge on Azure Storage schematics such as Gen1 & Gen2
Experience in harmonizing raw data into a consumer-friendly format using Azure Databricks
Knowledge of Azure networking, security, key vaults, etc.
Experience in data wrangling, advanced analytic modeling, & AI/ML capabilities is preferred
Experience utilizing Snowflake to build data marts with the data residing in Azure storage is a plus
Knowledge of SAS, Teradata, Oracle, or other databases a plus
Exposure with R & ML technologies a plus