Senior Data Scientist

senior data engineer

Job Description:

We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain scalable data platforms and cloud-based data pipelines. The ideal candidate should have strong expertise in big data technologies, ETL/ELT frameworks, cloud platforms, and modern data warehouse solutions. The role involves working closely with Data Scientists, Analysts, and Business teams to support enterprise analytics and AI/ML initiatives.

Responsibilities:

• Design, build, and optimize scalable ETL/ELT pipelines for large-scale enterprise data platforms.
• Develop and maintain data lakes, data warehouses, and lakehouse architectures.
• Work with structured, semi-structured, and unstructured datasets from multiple data sources.
• Implement data ingestion, transformation, orchestration, and monitoring frameworks.
• Build cloud-native data solutions using AWS, Azure, or GCP services.
• Optimize data processing performance using Spark, Databricks, Hadoop, and distributed computing technologies.
• Collaborate with Data Scientists and BI teams to support analytics and machine learning workloads.
• Implement data governance, security, quality checks, and best practices.
• Develop CI/CD pipelines and automation for data engineering workflows.
• Troubleshoot and resolve production issues related to data pipelines and platforms.
• Mentor junior engineers and participate in architecture discussions.

Required Skills:

• 10+ years of experience in Data Engineering.
• Strong hands-on experience with Python, SQL, Scala, or Java.
• Expertise in Spark, Databricks, Hadoop, Kafka, Airflow, and Snowflake.
• Experience with cloud platforms: AWS, Azure, or GCP.
• Strong experience with ETL/ELT pipeline development and orchestration tools.
• Experience with Data Warehousing and Data Modeling concepts.
• Knowledge of real-time and batch data processing.
• Hands-on experience with Docker, Kubernetes, and CI/CD pipelines.
• Strong understanding of performance tuning and optimization.
• Experience with Git, DevOps, and Agile methodologies.

Preferred Skills:

• Experience supporting AI/ML pipelines and MLOps environments.
• Knowledge of Delta Lake, Iceberg, or modern lakehouse architectures.
• Experience in Banking, Healthcare, Retail, Insurance, or Manufacturing domains.
• Familiarity with Power BI/Tableau reporting integrations.
• Exposure to Generative AI or AI-driven analytics platforms.

Pay: $70.00 - $80.00 per hour

Benefits:

• Relocation assistance

Work Location: In person