Data Engineer
atsMantra®
Pune City, Maharashtra, India8h agovia LinkedIn
About the Role
Experienced developer specializing in Python, Java, React JS, and Azure cloud platforms, with expertise in application modernization, automation, and data processing. Designs, implements, and supports scalable Azure-based services using technologies such as Azure Databricks, Azure Functions, Azure Storage, and CI/CD pipelines. Skilled in platform configuration, workflow orchestration, job scheduling, production support, and cloud migration. Focused on delivering secure, resilient, and cost-effective solutions in enterprise environments.
Key Responsibilities
- Develop and configure Azure cloud applications and platforms, including Azure Databricks, Azure Functions, and Azure Storage.
- Build and support data processing, ETL/ELT pipelines, and automation.
- Implement workflow orchestration, job scheduling, monitoring, and alerting.
- Modernize legacy applications and support cloud migration initiatives.
- Provide production support, incident management, and troubleshooting.
- Improve performance, scalability, and cost efficiency.
- Automate CI/CD and apply DevOps best practices.
- Support data validation, operational controls, and governance.
Requirements & Tech Stack
- Languages: Python, Java, React JS, SQL, Shell Scripting
- Python ecosystem: Pandas, NumPy, PySpark
- Azure: Azure Databricks, Azure Functions, Azure Storage Accounts, Azure Blob Storage, Azure App Services, Azure Monitor
- Data engineering: ETL/ELT development, PySpark processing, data transformation and validation, data ingestion pipelines, batch and scheduled processing
- Scheduling and orchestration: Databricks Workflows, Azure Data Factory Pipelines, Azure Functions Timer Triggers, Cron Scheduling, workflow monitoring and alerting
- Databases and storage: PostgreSQL, Azure SQL Database, SQLite, CSV, Parquet
- Testing: Unit testing, integration testing, automated test frameworks
- DevOps: Azure DevOps, Git, CI/CD pipelines, release automation, infrastructure as code
- Tools: Jupyter Notebooks, Databricks Notebooks, VS Code
Qualifications
Previous experience in UBS infrastructure and banking environments is preferred.