Senior Data Engineer

This is us

At Avenga, we believe that human creativity empowers technology that matters. Operating globally, our 6000+ specialists provide a full spectrum of services, including business and tech advisory, enterprise solutions, CX, UX and Ul design, managed services, product development, and software development.

This is us

At Avenga, we believe that human creativity empowers technology that matters. Operating globally, our 6000+ specialists provide a full spectrum of services, including business and tech advisory, enterprise solutions, CX, UX and Ul design, managed services, product development, and software development.

This is you

• Experience with design, development, and implementing scalable and efficient ETL processes using Apache Spark and PySpark

• Expertise in Python

• Strong SQL skills

• Experience with utilizing Airflow to manage and schedule data pipelines and workflows

• Experience working with large datasets in various formats, including DataFrames and Parquet files

• Collaborate with cross-functional teams to design and develop big data solutions that meet business requirements

• Possess excellent problem-solving and analytical skills

• Be able to work independently

• Strongly preferred: experience working with IBM Cloud (Cirrus) for cloud-based data processing and storage

  
  At Avenga, everyone matters. We provide equal opportunities in recruitment, career development, and leadership, regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to fostering a work environment where our diverse community of employees, candidates, and business partners actively shapes our growth. By bringing together people from different backgrounds and experiences, we build a workplace where everyone feels free to be themselves while honoring the boundaries of others.