Data Engineer with expertise in SQL IRC295049
GlobalLogic
Bengaluru, Karnataka, India1h agovia LinkedIn
Key Responsibilities
- Design and optimize SQL / PostgreSQL schemas, queries, indexes, and stored procedures.
- Integrate datasets from multiple sources (Postgres, NoSQL, object storage, data lakes).
- Collaborate with data engineers to design pipelines feeding into Snowflake or any data lake house.
- Work with data engineering tools (Spark with Scala, PySpark or any other programming language, Kafka, Flink, MinIO, Iceberg).
- Deploy and manage pipelines and Data lake integrations on OpenShift / AWS Kubernetes.
- Collaborate with DevOps on CI/CD pipelines (Jenkins, Git, Stash).
Requirements & Tech Stack
- Strong experience in PostgreSQL or SQL (schemas, query tuning, stored procedures, indexes).
- Familiarity with data engineering tools (Spark Scala, PySpark, Kafka, Flink).
- Experience in MinIO and Apache Iceberg in data lake/lakehouse setups.
- Skilled in OpenShift / AWS Kubernetes deployment.
- Familiar with CI/CD pipelines (Jenkins, Git, Stash).