Job Description
About the Role:
We are seeking a Data Engineer (Innovation) with 6+ years of experience to design, develop and maintain data pipelines to support AI initiatives.
Requirements
-
Collaborate with data scientists to understand requirements and ensure data availability and quality.
-
Implement data processing and transformation logic to prepare data for analysis and modelling.
-
Monitor and optimize data pipelines for performance, scalability, and reliability.
-
Stay abreast of the latest advancements in data engineering technologies and best practices.
-
Contribute to low-level architecture/technical design aligned to the high-level solution and business
-
requirements
-
Work within the agile development team to analyse and decompose stories into tasks for simpler
-
implementation
-
Proactively identify new frameworks/tools/processes to enhance the efficiency of the development team
-
Responsible for the end-to-end quality of your own deliverables
-
Communicate clearly and effectively with team members throughout all the implementation lifecycle
Experience
-
Bachelor's degree or higher in Computer Science, Engineering, or a related field.
-
Proven experience working as a Data Engineer or similar role, preferably in the airline industry or a related field.
-
Proficiency in programming languages such as Python, Java, or Scala, as well as experience with data processing frameworks (e.g., Apache Spark).
-
Strong understanding of database technologies and SQL.
-
Experience with cloud platforms and services (e.g., AWS, Azure, Google Cloud) is a plus.