Data Engineer-Data Platforms-AWS
IBM
Pune Division, Maharashtra, India2h agovia LinkedIn
This job at a glance
- Who can apply
- Freshers · Master's degree
- Must know
- ETLEHR / EMRScalaSparkAirflow
- Nice to have
- AWSPython
- Work
- On-site in Pune Division
- Pay
- Not stated by the employer.
- Listed
- 27 Oct 2026 · still open
Sign in free to see which of these skills your resume already shows.
About the Role
As a Data Engineer specializing in Data Platforms on AWS, you will advise on, develop, and maintain data engineering solutions on the AWS Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various AWS services.
Key Responsibilities
- Design and Develop Data Pipelines: Design, build, and operate batch and real-time data pipelines using AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis.
- Create Data Layers: Create data layers on AWS RedShift, Aurora, and DynamoDB, and migrate data using AWS DMS.
- Manage Data Services: Schedule and manage data services on the AWS Platform.
- Develop Batch and Real-time Pipelines: Develop batch and real-time data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka.
- Utilize Open Source Technologies: Utilize open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform.
Requirements & Tech Stack
- Exposure to AWS Toolset: Experience working with AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis.
- Data Pipeline Development: Exposure to developing batch and real-time data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka.
- Data Layer Creation: Experience working with AWS RedShift, Aurora, and DynamoDB to create data layers and migrate data using AWS DMS.
- Open Source Technologies: Exposure to utilizing open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform.
- Data Service Management: Experience scheduling and managing data services on the AWS Platform.
Qualifications
Preferred Education: Master's Degree
Preferred Technical And Professional Experience:
- Proficiency with AWS Databrew: Experience working with AWS Glue Databrew.
- Knowledge of Lambda Functions: Exposure to using Lambda functions with Python.
- Familiarity with RedShift Spectrum: Experience working with RedShift Spectrum.