Supervising Associate-GDS R And DA UKI

Job Title: Supervising Associate (Data Engineer)

Job Purpose

• Collaborate with business reporting and cross-functional teams to understand business requirements.
• Perform data engineering.
• Support project transitions, lead transition activities, and manage post-transition development, enhancements, and modifications.
• Work across multiple projects with back-end data architects and systems engineers to build data objects that support business needs.
• Apply specialized knowledge to advance the organization’s vision and direction, serving as the team’s subject matter expert.

Key Skills & Experience

• Python: (Advanced – Essential) - Strong hands-on experience writing production-quality Python (PySpark) with proven ability to develop reusable, modular, and scalable data processing code, focused on ETL/ELT pipeline development within Databricks environments.
• SQL: (Advanced – Essential) - Deep expertise in writing and optimizing complex SQL queries (joins, window functions, performance tuning) with strong experience designing data models and transformations in a LakeHouse architecture.
• Spark / Databricks (PySpark / Scala): (Advanced – Essential) - Strong experience using Apache Spark for distributed data processing with the ability to design, optimize, and maintain scalable ingestion and transformation pipelines using Databricks and Delta Lake principles.
• Change Management & Adaptability: (Intermediate–Advanced) - Demonstrated ability to manage and adapt to evolving data requirements, implementing changes to pipelines and processes while maintaining stability and data integrity.
• Project / Delivery Management: (Intermediate–Advanced) - Proven ability to manage end-to-end data engineering deliverables, prioritize workload, meet deadlines, and collaborate effectively with cross-functional stakeholders.
• Azure DevOps: (Intermediate) - Experience implementing CI/CD pipelines to automate the build, test, and deployment of data engineering solutions, ensuring reliable and repeatable releases.
• Git / Version Control: (Intermediate – Essential) - Proficient in Git-based workflows including branching, pull requests, and version control for collaborative development and controlled deployment of data pipeline code.
• Data Pipeline Development: (Advanced) - Strong experience designing and maintaining ingestion pipelines across batch and streaming workloads with a focus on reliability, scalability, and performance.
• Data Quality & Governance: (Intermediate–Advanced) - Experience implementing data validation, monitoring, and governance controls to ensure high data quality and trust in data outputs.
• Azure Cloud: (Intermediate) - Working knowledge of Azure data services and integration patterns to support scalable, secure, and cloud-native data engineering solutions.

Professional & Behavioural Competencies

• Strong analytical and problem‑solving skills, with the ability to demonstrate initiative and ownership.
• Highly detail‑oriented, with strong organizational skills and a commitment to quality, efficiency, and accuracy.
• Client‑focused mindset, with a clear understanding of service delivery concepts.
• Strong communication and presentation skills, enabling clear and effective articulation of insights to stakeholders across all levels.
• Collaborative team player, contributing positively to the team environment and supporting junior team members.
• Comfortable working in a project‑based environment, managing deliverables end‑to‑end and owning processes from initiation to completion.
• Flexible and adaptable, with the ability to respond effectively to change.