PySpark Developer
Infosys
Bengaluru East, Karnataka, India1h agovia LinkedIn
This job at a glance
- Who can apply
- Freshers
- Must know
- SparkETLSQLTroubleshootingPythonLinux
- Work
- On-site in Bengaluru East
- Pay
- Not stated by the employer.
- Skill demand
- SQL52%Spark38%ETL32%Troubleshooting31%of 99 similar fresher jobs posted in India this week
- Listed
- 1 Nov 2026 · still open
Sign in free to see which of these skills your resume already shows.
About the Role
Develop, maintain, and optimize data pipelines using PySpark.
Key Responsibilities
- Design, develop, and maintain data pipelines using PySpark.
- Develop ETL/ELT processes for ingesting, transforming, and loading large volumes of data.
- Write optimized PySpark code for data processing and transformation.
- Work with structured and semi-structured data from multiple sources.
- Develop and optimize SQL queries for data extraction and validation.
- Troubleshoot data quality and performance issues.
- Collaborate with Data Engineers, Analysts, and Business teams to understand requirements.
- Participate in code reviews and follow data engineering best practices.
- Monitor and support production data pipelines.
Requirements & Tech Stack
- Strong experience in PySpark.
- Good programming knowledge of Python.
- Hands-on experience with SQL.
- Understanding of ETL/ELT concepts and data warehousing.
- Experience working with large datasets and distributed processing.
- Knowledge of Spark SQL, DataFrames, and Spark transformations.
- Familiarity with Linux/Unix environment.
- Exposure to cloud platforms such as AWS, Azure, or GCP.
- Knowledge of Databricks.
- Experience with workflow orchestration tools such as Airflow.
- Understanding of CI/CD concepts.