Data Engineer (Hybrid)

Job Title: Data Engineer

LOCATION: Irvine, CA (onsite). Monday through Thursday onsite, Fridays remote.

COMPENSATION: $50-95 an hour. This is a 2-year contract that will convert to full-time.

ABOUT US: We are on a mission to develop innovative AI solutions that will revolutionize our workforce. As we embark on an exciting new greenfield AI project, our data team is forward-thinking and data-driven dedicated to transforming data into actionable insights. We are seeking a skilled Data Engineer to join our team, responsible for leveraging Python, Java, PostgreSQL, Snowflake and AWS to design, develop, and maintain data pipelines and systems that support our analytics and decision-making processes.

JOB DESCRIPTION:

Position Overview: As a Data Engineer, you will play a pivotal role in the development and management of our data infrastructure. You will work closely with cross-functional teams to ensure data availability, reliability, and quality, enabling data-driven decision-making across the organization.

RESPONSIBILITIES:

Data Pipeline Development:

• Design, implement, and maintain data pipelines using Python, PostgreSQL, and AWS technologies.
• Develop efficient and scalable ETL processes to extract, transform, and load data from various sources into our Snowflake data warehouses.

Database Management:

• Design and maintain PostgreSQL databases, including schema design, indexing, and performance optimization.
• Monitor database performance, troubleshoot issues, and implement improvements as needed.
• AWS Integration:
• Utilize AWS services, such as AWS Glue, S3, Redshift, and EMR, for data storage, processing, and analytics.
• Collaborate with AWS solutions architects to optimize data-related AWS infrastructure.

Data Quality and Governance:

• Implement data quality checks and validation processes to ensure data accuracy and consistency.
• Enforce data governance policies and security measures to protect sensitive data.

Documentation and Collaboration:

• Maintain comprehensive documentation of data pipelines, database schemas, and ETL processes.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver actionable insights.

Performance Optimization:

• Continuously monitor and optimize data pipelines and database performance for scalability and efficiency.

QUALIFICATIONS:

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• Proven experience (3+ years) as a data engineer with expertise in Python, Java, PostgreSQL, and AWS.
• Strong SQL skills and proficiency in data modeling and database design.
• Hands-on experience with AWS services, particularly Glue, S3, Redshift, and EMR.
• Knowledge of ETL processes and data integration techniques.
• Excellent problem-solving skills and attention to detail.
• Effective communication and collaboration skills to work within a team.
• A commitment to staying current with industry trends and best practices in data engineering.

WHAT MAKES THIS EXCITING:

• Be part of a dynamic team in a data-driven organization.
• Technical ownership on greenfield projects
• Contribute to projects that have a meaningful impact on our business and industry.
• Competitive compensation and opportunities for professional growth.
• Work in a collaborative and innovative environment.

If you are a skilled Data Engineer with expertise in Python, Java, PostgreSQL, and AWS and are passionate about turning data into insights, we encourage you to apply. Join us in our mission to harness the power of data!