Data Pipeline Engineer

Job ID: 5706

City:

State:

Job Type: Full-time

Compensation: $115 to $140

We are seeking a Data Pipeline Engineer to support enterprise data migration and integration efforts for a federal program. This role will be responsible for planning, developing, and maintaining ETL workflows and data pipelines to migrate legacy application data from MS SQL and Oracle environments into the Pega platform.

The ideal candidate will have hands-on experience with data engineering, ETL development, cloud technologies, and relational databases, along with the ability to work collaboratively in a fast-paced environment supporting critical migration timelines and contract deliverables.

Key Responsibilities

Design, develop, and maintain ETL workflows and data pipelines for large-scale data migration efforts
Migrate legacy application data from MS SQL and Oracle databases into the Pega platform
Perform data assessment, profiling, transformation, cleansing, and validation activities
Develop source-to-target mappings and support reconciliation processes
Execute trial migrations, production cutovers, and post-migration issue resolution
Ensure migration activities align with IRS business rules and PGLD/RIM requirements
Collaborate with developers, testers, business stakeholders, and IRS teams throughout migration and testing cycles
Support parallel migration activities alongside application development and testing efforts
Document migration strategies, mappings, scripts, procedures, and migration results
Troubleshoot data pipeline and migration issues while meeting project deadlines

Required Skills & Qualifications

3+ years of experience in data engineering, ETL development, or data migration
Strong experience with relational databases and SQL development
Experience working with Oracle, PostgreSQL, and MS SQL environments
Experience with cloud technologies, preferably AWS
Hands-on experience with the following tools and technologies:
- Informatica
- Informatica S3 Connector
- AWS CLI (Command Line Interface)
- CloudBees Jenkins
- Jira, Confluence, GitLab
- PostgreSQL
- Oracle
- SQL
- Tableau
- TOAD
- Linux
Strong analytical, troubleshooting, and data validation skills
Ability to manage priorities and meet contract deadlines in a collaborative team environment