Data Engineer-Data Platforms-Azure

About the Role

As a Data Engineer specializing in Data Platforms on Azure, you will advise on, develop, and maintain data engineering solutions on the Azure Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various Azure services.

Key Responsibilities

• Design, build, and operate batch and real-time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.
• Design, build, and operate the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
• Implement and maintain Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.
• Apply proficiency in open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.
• Operate and maintain data engineering solutions to ensure seamless batch and real-time data processing.

Requirements & Tech Stack

• Proficiency in Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.
• Experience working with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.
• Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala.
• Experience developing and maintaining data engineering solutions on the Azure Cloud ecosystem.
• Experience designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

Qualifications

• Preferred Education: Master's Degree