Azure, Databricks, PySpark Engineer

This role focuses on developing and maintaining data engineering solutions leveraging Azure cloud technologies, Databricks, and PySpark. The ideal candidate will be responsible for building robust and scalable data pipelines, ensuring data quality, and contributing to the overall data architecture.

Key Responsibilities:

Design, develop, and maintain data pipelines using Databricks and PySpark.
Implement data quality checks and monitoring processes.
Optimize data processing performance and scalability.
Collaborate with cross-functional teams to understand data requirements.
Troubleshoot and resolve data-related issues.
Contribute to the development of data governance policies.

Requirements/Qualifications:

Strong experience with Azure cloud services (e.g., Azure Data Factory, Azure Synapse Analytics).
Proficiency in Databricks and PySpark for data processing and analytics.
Experience with data warehousing concepts and technologies.
Solid understanding of data modeling and database design.
Excellent problem-solving and communication skills.
Experience with version control systems (e.g., Git).

About the Company: Srivango is a technology company focused on providing innovative solutions to businesses across various sectors. They specialize in helping organizations leverage data and technology to achieve their strategic goals.