Data Engineer

Project Role

Data Engineer

Project Role Description

• Design, develop, and maintain data solutions for data generation, collection, and processing.
• Create data pipelines.
• Ensure data quality.
• Implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
• Collaborate with cross-functional teams to understand data requirements.
• Contribute to the overall data strategy of the organization.

Roles and Responsibilities

• Design and build data foundations and end-to-end solutions to maximize value from data.
• Help create data-driven thinking within the organization.
• Design & build data solutions and mentor junior engineers.
• Convert vision and data strategy for IT solutions and deliver.
• Actively deliver the roll-out and embedding of Data Foundation initiatives in support of key business programs.
• Coordinate the change management process, incident management, and problem management process.
• Present reports and findings to key stakeholders.
• Act as the subject matter expert on Data Analysis & Design.
• Drive implementation efficiency and effectiveness across pilots and future projects.
• Contribute to community building initiatives.

Requirements & Tech Stack

• Microsoft Azure Databricks
• AWS / Azure / SAP - Master
• ELT - Master
• Data Modeling - Master
• Data Integration & Ingestion
• Data Manipulation and Processing
• GITHUB
• Action
• Azure DevOps
• Data Factory
• Databricks
• SQL DB
• Synapse
• Stream Analytics
• Glue
• Airflow
• Kinesis
• Redshift

Qualifications

• Minimum 3 year(s) of experience required.
• Minimum 4 year(s) of experience required.
• 15 years full-time education.