PySpark Databricks Developer

This role focuses on developing and maintaining robust data pipelines and solutions using PySpark and Databricks. The ideal candidate will be responsible for designing, implementing, and optimizing data processing workflows to support business intelligence and data analytics initiatives.

Key Responsibilities:

Develop and maintain PySpark jobs for data transformation and processing.
Design and implement data pipelines within the Databricks environment.
Optimize Spark jobs for performance and scalability.
Collaborate with data engineers and data scientists to understand data requirements.
Troubleshoot and resolve data pipeline issues.
Ensure data quality and integrity.

Requirements/Qualifications:

Experience with PySpark and the Databricks platform.
Strong understanding of data warehousing concepts.
Proficiency in SQL and data manipulation techniques.
Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
Solid understanding of data structures and algorithms.
Excellent problem-solving and communication skills.

About the Company: Infosys is a global leader in technology services and consulting. They help clients transform their businesses through innovative solutions and digital transformation strategies.