Qureos Mentor

Centurion Consulting Group

<div><p>Centurion is looking for an Azure Data Factory Engineer for a long-term federal government project. This position is 100% remote. It is open to US Citizens that hold an Active Secret Clearance.</p>
<div>
Requirements Gathering
<br>
<ul><li>Collaborate with business analysts, data architects, and stakeholders to gather requirements and ensure data integrity throughout the migration lifecycle.</li><li>Ability to create Data mapping documents (Source to Target) by understanding business rules.</li></ul></div>
<div>
Data Understanding/Profiling<br>
<ul><li>Perform data profiling, cleansing, and quality checks to ensure accuracy and completeness of migrated data.</li><li>Analyze and map source Oracle database schemas to target Dataverse tables/entities, defining transformation and cleansing logic as required.</li></ul></div>
<div>
Technical Requirements for Development<br>
<ul><li>Write and optimize SQL queries, stored procedures, and scripts for Oracle databases to support data migration and validation.</li><li>Implement data transformation processes to ensure data compatibility with Dataverse data types, relationships, and constraints.</li><li>Experience with Dataverse data types and CRUD operations</li><li>Experience configuring data pipelines in ADF (to extract, transform, load). Experience using .csv files as sources of data for the ADF pipelines</li><li>Experience using Oracle CDCs as sources of data for the ADF pipelines. Experience logging errors (audit framework) from an ADF pipeline to a Dataverse table</li><li>Experience pushing data to Dataverse table(s) including necessary transformations to match target field types (i.e. Dataverse lookups, choices, date/time, etc.)</li><li>Experience configuring setting for pipelines to improve concurrency/performance (i.e., ADF cores, memory, etc.)</li><li>Experience with additional Azure services (e.g., Logic Apps, Data Lake, Azure Functions, Azure SQL).</li><li>Experience/exposure in python/shell scripting is a plus</li></ul></div>
<div>
Data Validation Post migration<br>
<ul><li>Ability to generate a reconcile report of the migrated data using SQL or scripts</li></ul></div>
<div>
Code Migration<br>
<ul><li>Must be familiar with Git or source code repository &amp; CI/CD process.</li></ul></div>
<p><b>REF: JOB-5406</b></p></div>

Azure Data Factory Engineer

Join Centurion Consulting Group and explore 1   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

Centurion Consulting Group

ABOUT_COMPANY

Azure Data Factory Engineer