AWS Data Engineer
Scoutit
Bengaluru, Karnataka, India3h agovia LinkedIn
About the Role
We're looking for AWS Data Engineers.
Key Responsibilities
- Design, build, and operate batch and real-time data pipelines using AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis.
- Create data layers on AWS RedShift, Aurora, and DynamoDB, and migrate data using AWS DMS.
- Schedule and manage data services on the AWS Platform.
- Develop batch and real-time data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka.
- Utilize open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on the AWS Platform.
Requirements & Tech Stack
- Experience working with AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis.
- Experience developing batch and real-time data pipelines for Data Warehouse and Datalake.
- Experience utilizing AWS Kinesis and Managed Streaming for Apache Kafka.
- Experience working with AWS RedShift, Aurora, and DynamoDB.
- Experience with AWS DMS.
- Experience with open source technologies like Apache Airflow and dbt.
- Experience with Spark / Python or Spark / Scala on the AWS Platform.
- Experience scheduling and managing data services on the AWS Platform.