Job Type: Contract
Job Category: IT
Job Description
Job Title: AWS Data Engineer
Location: Irvine, CA (Onsite)
Type: Contract
Role Summary
We are seeking an experienced AWS Data Engineer with strong expertise in cloud-based data pipelines, ETL development, and modern orchestration tools. The ideal candidate will have hands-on skills in AWS, Python, ETL frameworks, Airflow, and familiarity with OpenAI-based integrations, as well as experience with Harness and Helix for CI/CD and version control.
Key Responsibilities
Design, build, and optimize ETL/ELT pipelines on AWS.
Develop data processing workflows using Python and AWS-native tools.
Build and orchestrate pipelines using Apache Airflow.
Integrate and utilize OpenAI APIs within data workflows (preferred).
Implement CI/CD pipelines using Harness.
Work with version control and configuration tools such as Helix.
Ensure data quality, reliability, and performance across data systems.
Collaborate with data architects, analysts, and business stakeholders.
Troubleshoot issues and optimize pipeline performance.
Required Skills
Strong hands-on experience with AWS services: S3, Lambda, Glue, EMR, Redshift, Aurora, IAM, CloudWatch, etc.
Proficient in Python for data engineering tasks.
Experience designing scalable ETL/ELT pipelines.
Solid experience with Apache Airflow.
Exposure to/Experience with OpenAI integrations.
Experience using Harness for deployment automation.
Experience with Helix (Perforce) for code versioning.
Strong understanding of data modeling and warehouse concepts.
Required Skills
CLOUD SECURITY ENGINEER
DEVOPS ENGINEER
SENIOR EMAIL SECURITY ENGINEER