Job Description
About the Role:
We are seeking a Data Engineer (Innovation) with 6+ years of experience to design, develop and maintain data pipelines to support AI initiatives.
Requirements
- Collaborate with data scientists to understand requirements and ensure data availability and quality.
- Implement data processing and transformation logic to prepare data for analysis and modelling.
- Monitor and optimize data pipelines for performance, scalability, and reliability.
- Stay abreast of the latest advancements in data engineering technologies and best practices.
- Contribute to low-level architecture/technical design aligned to the high-level solution and business
- requirements
- Work within the agile development team to analyse and decompose stories into tasks for simpler
- implementation
- Proactively identify new frameworks/tools/processes to enhance the efficiency of the development team
- Responsible for the end-to-end quality of your own deliverables
- Communicate clearly and effectively with team members throughout all the implementation lifecycle
Experience
- Bachelor's degree or higher in Computer Science, Engineering, or a related field.
- Proven experience working as a Data Engineer or similar role, preferably in the airline industry or a related field.
- Proficiency in programming languages such as Python, Java, or Scala, as well as experience with data processing frameworks (e.g., Apache Spark).
- Strong understanding of database technologies and SQL.
- Experience with cloud platforms and services (e.g., AWS, Azure, Google Cloud) is a plus.