Big Data Engineer Architect

This role focuses on designing, building, and maintaining robust and scalable big data solutions. The ideal candidate will be responsible for developing and implementing data pipelines, ensuring data quality, and contributing to the overall architecture of our data platform.

Key Responsibilities:

Design and develop scalable data pipelines using various big data technologies.
Implement data quality checks and monitoring processes.
Collaborate with cross-functional teams to understand data requirements.
Optimize data storage and processing for performance and cost-effectiveness.
Troubleshoot and resolve data-related issues.
Contribute to the evolution of our data architecture.

Requirements/Qualifications:

Extensive experience in big data technologies (e.g., Hadoop, Spark, Kafka).
Strong programming skills in languages such as Python or Java.
Experience with data warehousing and ETL processes.
Solid understanding of data modeling and database design.
Excellent problem-solving and analytical skills.
Ability to work independently and as part of a team.

About the Company: Transunion is a global provider of risk and identity solutions. The company helps businesses and consumers make informed decisions by providing data and analytics that assess risk and verify identity.