PySpark Testing

This role focuses on ensuring the quality and reliability of data processing pipelines built using PySpark. The ideal candidate will be responsible for designing, developing, and executing comprehensive test plans to validate data accuracy, performance, and scalability. This position requires a strong understanding of testing methodologies and experience with big data technologies.

Key Responsibilities:

Develop and execute test plans, test cases, and test scripts for PySpark applications.
Perform functional, integration, performance, and regression testing.
Identify, document, and track defects using a bug tracking system.
Collaborate with developers to resolve issues and ensure timely delivery of high-quality software.
Automate testing processes to improve efficiency and coverage.
Analyze test results and provide clear and concise reports.

Requirements/Qualifications:

Experience with PySpark and related big data technologies.
Strong understanding of testing methodologies and best practices.
Proficiency in writing test scripts and automating testing processes.
Excellent analytical and problem-solving skills.
Ability to work independently and as part of a team.
Experience with data validation and quality assurance.

About the Company:

Teksills is a technology services company specializing in providing innovative solutions to businesses across various sectors. They focus on helping clients leverage technology to achieve their strategic goals and improve operational efficiency.