Pyspark Data Engineer

This role focuses on designing, developing, and maintaining robust data pipelines and solutions using Pyspark and related technologies. The Data Engineer will be responsible for ensuring data quality, performance, and scalability within a complex data environment, contributing to data-driven decision-making across the organization.

Key Responsibilities:

Develop and maintain scalable data pipelines using Pyspark.
Design and implement data models and schemas.
Ensure data quality and accuracy through validation and monitoring.
Optimize data processing performance and efficiency.
Collaborate with data scientists and analysts to meet data needs.
Troubleshoot and resolve data-related issues.

Requirements/Qualifications:

Experience with Pyspark and related data processing frameworks.
Strong understanding of data warehousing concepts.
Proficiency in SQL and relational databases.
Experience with data modeling and schema design.
Excellent problem-solving and analytical skills.
Ability to work independently and as part of a team.
Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.

About the Company: Infosys is a global leader in technology services and consulting. The company helps clients across various industries transform their businesses through innovative solutions and digital technologies.