PySpark Developer

This role involves developing and maintaining robust data pipelines and applications using PySpark. The ideal candidate will be responsible for designing, implementing, and optimizing data processing solutions to meet business requirements, ensuring data quality and efficiency.

Key Responsibilities:

Develop and maintain PySpark jobs for data transformation and processing.
Design and implement scalable data pipelines.
Optimize existing PySpark code for performance and efficiency.
Collaborate with data engineers and scientists to understand data requirements.
Ensure data quality and integrity throughout the data processing lifecycle.
Troubleshoot and resolve data-related issues.

Requirements/Qualifications:

Experience with PySpark and related technologies.
Strong understanding of data warehousing concepts.
Proficiency in Python programming.
Experience with big data technologies (e.g., Hadoop, Spark).
Knowledge of data modeling and database design.
Excellent problem-solving and analytical skills.

About the Company: Tata Consultancy Services is a global leader in information technology services and consulting. The company helps businesses worldwide transform and grow through innovative solutions and services.