Senior Managing Consultant Data Analytics

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate will work closely with data scientists, analysts, and software engineers to ensure reliable data availability and optimize data systems for analytics and machine learning.

Responsibilities

• Design, develop, and maintain scalable data pipelines for processing large datasets.

• Build and manage ETL/ELT workflows for data ingestion, transformation, and loading.

• Develop and optimize data warehouse and data lake architectures.

• Ensure data quality, reliability, and integrity across data platforms.

• Work with cross-functional teams to understand data requirements.

• Implement data governance, security, and compliance standards.

• Monitor, troubleshoot, and optimize data systems for performance.

• Automate data workflows and scheduling processes.

Requirements:

• Strong programming skills in Python, Java, or Scala

• Expertise in SQL

• Experience with Apache Spark, Apache Kafka, or Apache Airflow

• Knowledge of Hadoop ecosystem

• Experience with data warehousing solutions such as Amazon Redshift, Google BigQuery, or Snowflake

• Familiarity with cloud platforms like Amazon Web Services, Google Cloud, or Microsoft Azure

• Understanding of data modeling and database design