About the Role

We are looking for a skilled and passionate Data Engineer to join and strengthen the Data Engineering team. In this role, you will play a critical part in building and maintaining modern, scalable, and high-performing data platforms using Azure Databricks and Lakehouse architecture.

You will work on cutting-edge technologies and collaborate closely with data science, analytics, and platform teams to unlock the true value of data.

Key Responsibilities

As a Data Engineer, you will be responsible for:

Data Engineering & Development

• Design, build, and maintain high-quality, scalable, and tested data pipelines.

• Develop and manage Databricks structured streaming pipelines.

• Build and optimize event-driven and real-time data processing solutions.

• Implement and maintain Unity Catalog-based Lakehouse architecture.

• Develop analytics-ready datasets to support business insights and reporting.

Platform & Automation

• Build and manage CI/CD pipelines using Azure DevOps.

• Identify and implement automation opportunities across workflows.

• Ensure reliable and stable data platform operations.

• Apply governance, security, and documentation standards.

Data Quality & Reliability

• Establish the Data Lakehouse as a trusted and reliable source of truth.

• Monitor, troubleshoot, and resolve data incidents.

• Support business users and technical teams with data-related queries.

• Continuously improve platform performance and reliability.

Collaboration & Support

• Work closely with data science, analytics, platform, and business teams.

• Champion data engineering best practices.

• Provide technical guidance and mentorship where required.

• Contribute to a culture of learning, quality, and continuous improvement.

Core Behaviours & Values

We are looking for someone who demonstrates:

✔ Think Impact

• Focuses on outcomes and business value.

• Prioritizes effectively and avoids low-impact activities.

✔ Own It

• Takes responsibility for delivery.

• Proactively removes blockers and manages stakeholders.

✔ Back Each Other

• Works collaboratively and supports colleagues.

• Encourages open and honest communication.

✔ Push for Better

• Continuously seeks improvement.

• Challenges the status quo and embraces innovation.

Technical Skills & Experience

Essential Skills

• Strong experience with Azure Databricks and cloud data platforms.

• Advanced proficiency in Python, PySpark, and SQL.

• Experience developing Spark/Databricks pipelines.

• Hands-on experience with structured streaming and event-driven systems.

• Strong understanding of Lakehouse architecture and best practices.

• Experience with Unity Catalog.

• Expertise in Azure DevOps and CI/CD pipelines.

• Knowledge of data modelling (dimensional/star schemas).

• Experience working in Agile environments.

Desirable Skills

• Exposure to multiple data technology stacks.

• Experience in large-scale enterprise environments.

• Knowledge of security, governance, and compliance frameworks.

Collaboration & Communication

You will be expected to:

• Partner with cross-functional teams to deliver integrated data solutions.

• Build strong relationships and become a trusted team member.

• Communicate clearly and professionally.

• Balance fast delivery with long-term scalability and maintainability.

• Stay updated with industry trends and emerging technologies.

Technical Assurance & Quality

• Ensure all solutions are fit for purpose and aligned with business strategy.

• Apply best practices in architecture, performance, and security.

• Continuously optimize platform efficiency.

• Maintain high engineering standards without being overly rigid.

Conduct & Compliance

In line with regulatory requirements, you must:

• Act with integrity, diligence, and professionalism.

• Treat customers fairly and ethically.

• Cooperate with regulatory bodies.

• Follow proper market conduct standards.

• Deliver positive outcomes for end users.

Education & Qualifications

• Bachelor’s degree in computer science, Engineering, or related field (preferred but not mandatory).

• Relevant certifications in cloud/data technologies are a plus.

Why Join:

• Work with cutting-edge Databricks and Lakehouse technologies.

• Be part of a high-impact data transformation journey.

• Collaborate with talented engineers and analysts.

• Opportunity for continuous learning and career growth.

• Contribute to building a future-ready data ecosystem.