We are currently seeking a Senior Data Engineer who will be responsible for designing, building, and maintaining scalable data pipelines, data models, and API-driven data sharing solutions that centralise reporting and provide the business with reliable access to high-quality data. The role sits at the intersection of data engineering and platform integration, enabling data consumption across the organisation through modern cloud-based tools and well-governed data APIs. The Senior Data Engineer will work closely with business stakeholders and technical teams to understand requirements, design and implement solutions, and ensure data is accessible, reliable, and fit for purpose.
Our client based in Dubai, is one of the largest multinationals in the region. This position is a contract role with an initial duration of 9 months and is renewable.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines to ingest, transform, and load data from multiple source systems into Snowflake for reporting and analysis.
- Develop and manage data transformation workflows using DBT to ensure data is clean, well-modelled, and ready for consumption.
- Manage and govern data integrations through Azure API Management (APIM), ensuring secure and scalable API connectivity across systems.
- Design, develop, and expose APIs for data sharing and downstream data consumption by internal and external consumers.
- Implement and maintain data models including star schemas, data marts, and semantic layers to support efficient querying and reporting.
- Orchestrate and automate data pipelines using StreamSets and Apache Airflow to ensure timely and reliable data loads.
- Collaborate with business stakeholders and technical teams to gather requirements and translate them into robust data engineering solutions.
- Monitor data platform health and pipeline performance, troubleshooting issues to ensure stable and reliable operations.
- Apply data governance and data quality best practices throughout the pipeline and modelling lifecycle.
- Perform system maintenance, security updates, and patching to maintain platform security and stability.
- Plan and manage project activities, resolving dependencies to support timely delivery of data engineering initiatives.
- Document data flows, API specifications, and data models to ensure maintainability and knowledge sharing across the team.
Knowledge, Skills & Experience:
- Relevant certifications in data engineering, cloud platforms, or API management are preferred.
- 5-7 years of overall experience, with 3-5 years in a relevant data engineering role.
- Bachelor's degree in Computer Science, Computer Applications, or a related field.
- Strong hands-on experience with Snowflake as a cloud data platform.
- Proficiency in DBT (Data Build Tool) for data transformation and modelling.
- Experience with Azure API Management (APIM) for managing and exposing data APIs.
- Solid understanding of API development and design, particularly for data sharing and consumption use cases.
- Strong SQL skills and experience with data warehousing concepts and dimensional modelling.
- Experience with StreamSets and/or Apache Airflow for pipeline orchestration is advantageous.
- Familiarity with data governance practices, data quality frameworks, and security best practices.
- Ability to work effectively with both technical and non-technical stakeholders to deliver data solutions.
- Experience in the software industry with a focus on data engineering and cloud platforms; aviation industry experience is not required.
- Proficiency in standard productivity tools including Microsoft Office to support project reporting and stakeholder communication.
