Data Engineer

Position Overview

We are seeking a skilled Data Engineer to handle end-to-end ETL development and data reporting. This role involves building data pipelines from scratch, managing data flow within the Azure ecosystem, and conducting rigorous unit testing on work delivered by offshore teams.

Required Technical Stack

Candidates must be 100% proficient in the following technologies:

• ETL & Orchestration: Azure Data Factory (ADF)
• Database: Microsoft SQL Server
• Storage: Azure Blob Storage / Storage Gen2
• Reporting: Microsoft Power BI
• Automation: Microsoft Power Automate
• Emerging Tech: Microsoft Fabric and Power Apps (Experience is preferred, but a willingness to learn is acceptable).

Key Responsibilities

• ETL Development: Create ETL flows from scratch. This includes extracting data from sources (CSV files or SQL Server), performing transformations using Azure Data Factory, and loading the data back into Microsoft SQL Server.
• Reporting & Analysis: Load raw data files (e.g., CSVs) into Power BI, update existing reports with new data (e.g., adding the last two years of data), and analyze reports to ensure accuracy compared to previous years.
• Unit Testing: Create and execute unit test cases for development work (such as reference data and GMs tables) completed by offshore teams to ensure validity before production.
• Process Synchronization: Use Power Automate to synchronize data sets and reports across the environment.

Interview Expectation

Candidates should be prepared for a technical assessment that may include:

• Case Study: completing a take-home case study to demonstrate a full ETL flow and Power Automate solution.
• Live Coding: A live session with the technical team to answer questions or modify code within their system.

Work Schedule

• This role requires working onsite in Baltimore, MD, two days per week .