Data Engineer

At Alstom, we understand transport networks and what moves people. From high-speed trains, metros, monorails, and trams, to turnkey systems, services, infrastructure, signalling and digital mobility, we offer our diverse customers the broadest portfolio in the industry. Every day, 80,000 colleagues lead the way to greener and smarter mobility worldwide, connecting cities as we reduce carbon and replace cars.

PURPOSE OF THE JOB:

The purpose of the job is to develop through iterative process data Integration and analytics solutions. Develop data products answering to Projects/Customer needs, from the data ingestion to ML productization.

You will Build data analytics solutions, developing Data applications (Data ingestion, Cleaning, data processing, etc.) to provide state-of-the-art advanced analytic and quantitative tools and modelling techniques to derive business insights, solve complex business problems and improve decisions.

Reporting to the Data Architect, the role will develop, support and advice on the day-to-day Data platform, Data processing and Data analytics requirements of Business areas and Deployment Projects key operational processes while continually improving the impact of these processes.

SCOPE OF WORK:

• Design and develop data pipelines from different sources.

• Produce efficient and elegant code that meets business requirements.

• Focus on business applications, cost optimization, client’s strategic needs and future growth goals.

• Data ingestion, data processing, pipelines orchestration, data access, data quality, ML training modules, performance evaluation module: all deployed on AKS cluster.

• Create and maintain high quality detailed technical documentation.

• Design, implement and deploy customer facing projects on AKS.

• Design and implement CI/CD automation pipelines (Gitlab, Helm).

• Experience implementing modern cloud data architectures and engineering (our solutions are deployed on Azure and On-Premises)

• Responsible for overall data lake stack and MLOps platform, with production deployments.

SKILLS AND EDUCATION:

Essential: Degree in Computer Science or Engineering is required for this role. You should have minimum 8 years of working experience in developing Data applications, developing software for different sub system. Experience in Data processing applications based on Python / Pyspark architectures. Strong experience in programming is required for this role (Agile methodologies). Experience in big data, Data Integration or Data analytics application development. Implementing and deploying Data processing and advanced analytics (Machine Learning/statistics) solutions based on MLOps for large enterprise or commercial customers in complex heterogeneous environments. Hands-on experience in the Big Data stack and related technologies:

• Programming using Python.

• Understanding of enterprise data concepts such as Master Data Management and Enterprise Data Warehouse.

• Database application development, using SQL and NoSQL stores.

• Understanding of SQL, report generation using visualization tools such as Tableau/Power BI.

• Experience designing and implementing data pipelines for consumption by machine learning and BI solutions.

• Python

• Deltalake, airflow

• GitLab(CI)/Helm(CD)

• SQL Databases / NoSQL / Blob Storage

• Azure

• Kafka

• AKS and Docker.

• Visualization and BI tools (PowerBI)

Desired:

• Pyspark

• Real projects' hands-on experience with Azure PaaS solutions.

• Good understanding of RBAC and IAM Access Control

• Experience with Azure data stores (e.g., Azure Data Lake GEN2, Azure SQL Data Warehouse, Azure Blob Storage), messaging systems (Azure Event Hubs and Queues), and data processing engines (Azure Data Lake Analytics, Azure HDInsight).

• Experience implementing cloud data architecture and data integration patterns like Azure Data Factory, Databricks, etc.

• Experience developing/deploying Machine Learning pipelines. Azure ML model execution architecture

Others requirements:

• High level of English (daily working language). Working understanding of French is a plus.

• Availability to travel as required

You don’t need to be a train enthusiast to thrive with us. We guarantee that when you step onto one of our trains with your friends or family, you’ll be proud. If you’re up for the challenge, we’d love to hear from you!

Important to note

As a global business, we’re an equal-opportunity employer that celebrates diversity across the 63 countries we operate in. We’re committed to creating an inclusive workplace for everyone.

Job Segment: Database, Data Warehouse, Cloud, Computer Science, SQL, Technology