Senior AWS Data Engineer-5

Job Type: Contract

Job Category: IT

Job Description

Data Integration & Pipeline Development
Design and implement data workflows using AWS Glue, EMR, Lambda, MWAA (Airflow), and Redshift.
Build scalable ETL/ELT processes leveraging PySpark, Apache Spark, and Python.
Ensure accurate extraction, transformation, and loading (ETL) of large datasets.
Data Quality & Integrity
Implement validation, cleansing, and monitoring mechanisms within pipelines.
Ensure compliance with governance, regulatory, and industry standards.
Performance Optimization
Optimize workflows for performance, scalability, and cost-efficiency on AWS.
Fine-tune queries and enhance Redshift performance by resolving bottlenecks.
Collaboration & Business Support
Translate business requirements into technical specifications for data pipelines.
Partner with analysts and business stakeholders to ensure timely data delivery for BI and analytics.
Documentation & Compliance
Maintain technical documentation, workflow diagrams, and system specifications.
Ensure adherence to data governance and compliance frameworks.

5+ years in data engineering, ETL, and data warehousing.
3+ years of hands-on AWS experience (S3, EMR, Glue, Athena, Redshift, RDS, Spectrum, Airflow).
3+ years in programming (Python, Java, or Scala) with strong PySpark/Spark experience.
2+ years with CI/CD tools and modern DevOps practices.
Strong knowledge of distributed data processing (Hadoop, Spark) and data lake architectures.
Excellent problem-solving and optimization skills.

Required Skills

DEVOPS ENGINEER

SENIOR EMAIL SECURITY ENGINEER