Azure Databricks Data Engineer L3

This role focuses on designing, building, and maintaining robust data pipelines and solutions using Azure and Databricks. The ideal candidate will be responsible for transforming raw data into actionable insights, ensuring data quality, and collaborating with cross-functional teams to deliver data-driven solutions.

Key Responsibilities

Develop and maintain data pipelines using Azure Data Factory, Databricks, and related technologies.
Design and implement data models and schemas optimized for performance and scalability.
Ensure data quality and integrity through data validation and monitoring.
Collaborate with data scientists and analysts to support their analytical needs.
Troubleshoot and resolve data-related issues.
Implement and maintain data security and governance policies.

Requirements/Qualifications

Experience with Azure cloud services, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage.
Proficiency in programming languages such as Python or Scala.
Strong understanding of data warehousing concepts and ETL processes.
Experience with data modeling and database design.
Familiarity with big data technologies such as Spark.
Excellent problem-solving and communication skills.

About the Company

Sparix Global Private Limited is a technology company specializing in providing innovative solutions to businesses across various sectors. They focus on leveraging data and technology to help clients achieve their strategic goals.