Data Engineer I
Amazon
Bengaluru, Karnataka, India1+ yrs1h agovia LinkedIn
Key Responsibilities
- Work with SDE teams and business stakeholders to understand data requirements and design data ingress flow for team
- Lead the design, model, and implementation of large, evolving, structured, semi-structured and unstructured datasets
- Evaluate and implement efficient distributed storage and query techniques
- Interact and integrate with internal and external teams and systems to extract, transform, and load data from a wide variety of sources
- Implement robust and maintainable code with clear and maintained documentation
- Implement test automation on code implemented through unit testing and integration testing
- Work in a tech stack which is a mix of AWS services and legacy ETL tools within Amazon
About The Team
Data Insights, Metrics & Reporting team (DIMR) is the central data engineering team in Amazon Warehousing & Distribution org.
Requirements & Tech Stack
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
- Experience with AWS services
- Experience with legacy ETL tools
Qualifications
- 1+ years of data engineering experience
- Experience with Big Data and MPP systems
- History of coming up with innovative solutions to complex technical problems
- Aptitude for quick and willing learning of new technologies
- Ability to determine and apply the best technology for a given problem
- Ability to explain complex concepts to non-technical customers in simple terms
Preferred Qualifications
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage