Databricks Engineer

This role focuses on designing, developing, and maintaining robust data pipelines and solutions using Databricks. The Databricks Engineer will be responsible for building scalable and efficient data processing systems to support business intelligence and analytics initiatives.

Key Responsibilities:

Develop and maintain Databricks notebooks and pipelines.
Design and implement data ingestion, transformation, and loading processes.
Optimize Spark jobs for performance and scalability.
Collaborate with data scientists and analysts to understand data requirements.
Ensure data quality and integrity.
Troubleshoot and resolve data-related issues.

Requirements/Qualifications:

Significant experience with Databricks and Spark.
Proficiency in Python or Scala.
Experience with data warehousing concepts.
Strong understanding of data modeling and ETL processes.
Experience with cloud platforms (e.g., AWS, Azure, GCP).
Excellent problem-solving and communication skills.

About the Company: Qentelli is a technology services company specializing in data and analytics solutions. They help organizations leverage data to drive innovation and achieve their business goals.