GCP + Big query (2-5)
Infosys
Hybrid - Chennai, Bengaluru, Mumbai (All Areas)2–5 yrs11h agovia Naukri
GCP + Big Query
Key Responsibilities
- Design and develop scalable data pipelines using GCP services.
- Build and maintain ETL/ELT processes for structured and unstructured data.
- Develop and optimize data models and data warehouse solutions using BigQuery.
- Ingest data from various sources into GCP environments.
- Work with large-scale datasets and ensure data quality, integrity, and performance.
- Monitor, troubleshoot, and optimize data processing workflows.
- Collaborate with data analysts, data scientists, and business stakeholders.
- Implement data governance, security, and compliance best practices.
- Automate data workflows and deployments using CI/CD practices.
Requirements & Tech Stack
- 2-5 years of experience in Data Engineering.
- Strong experience with Google Cloud Platform (GCP).
- Hands-on experience with:
- BigQuery
- Dataflow
- Cloud Composer (Airflow)
- Pub/Sub
- Cloud Storage
- Dataproc
- Strong SQL skills and query optimization experience.
- Experience with Python, PySpark, or Java.
- Knowledge of ETL/ELT frameworks and data warehousing concepts.
- Experience working with batch and real-time data processing.
- Familiarity with Git and CI/CD tools.