Azure Databricks Sr. Engineer

This role focuses on designing, developing, and maintaining robust data solutions leveraging Azure and Databricks. The Senior Engineer will be responsible for building scalable and efficient data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver impactful business insights.

Key Responsibilities:

Design and implement data pipelines using Azure Data Factory, Databricks, and related technologies.
Develop and maintain Spark jobs for data processing and transformation.
Ensure data quality and integrity through rigorous testing and monitoring.
Collaborate with data scientists and analysts to support their analytical needs.
Optimize performance and scalability of data solutions.
Troubleshoot and resolve data-related issues.

Requirements/Qualifications:

Significant experience in data engineering and cloud computing.
Strong proficiency in Azure services, including Azure Data Factory, Databricks, Azure Synapse Analytics, and Azure Blob Storage.
Experience with Spark and Python.
Solid understanding of data warehousing concepts and ETL processes.
Excellent problem-solving and communication skills.
Experience with DevOps practices and CI/CD pipelines.

About the Company: Cogency Infratech is a technology company specializing in providing innovative solutions to complex business challenges. They focus on delivering high-quality services and products within the technology sector.