Data Engineer | Analyst
Required Skills:
-
Experience with Microsoft Azure and Microsoft BI stack
-
Experience developing Azure Data Factory, SQL, Databricks (PySpark, Scala, SQL), Stream Analytics, Components experience in working on data lake & DW solutions on Azure
-
Experience in configuring and managing Azure DevOps pipelines
-
Lead and implement data pipelines for software solutions and ensure that technology deliverables are met based on business requirements
-
ETL Architecture design and implementation at enterprise level
-
Work with subject matter experts and Data/ Business Analysts to understand business data and related processes
-
Using Agile and DevOps methods, build platform architecture using a variety of sources (on-premises such as SQL Server, cloud IaaS/ SaaS such as Azure).
-
Implement rules & automate data cleansing, mapping, transformation, logging, and exception handling.
-
Experience in designing and implementing BI solution on Azure, (ADLS, Azure Databricks, ADF, Azure Synapse, Azure SQL, etc.)
-
Design, build, and deploy databases and data stores
-
Participate in cross-functional teams to promote technology strategies, analyze, and test products, perform proofs-of-concept, and pilot new technologies and/or methods.
-
Establish and document standards, guidelines, and best practices for teams utilizing the solutions.
-
Implement / operationalize Analytics by developing representations and visualizations in BI.
-
Work with clients (internal or external) to determine business requirements, priorities, define key performance indicators (KPI)
-
Data management experience, strong excel skills (pivot tables, VLOOKUP’s, etc.), stronghold in Power BI
-
Design, and document dashboards, alerts, and reports either on a regular recurring basis or as needed.
Development experience using the below technologies
-
Azure Data Factory
-
Azure Data Lake Storage
-
Azure Databricks
-
Azure Synapse SQL
-
SQL Server
-
Azure Event Hub
-
Azure Function
-
Azure App Services
Having knowledge of the following will be a plus
-
Power Apps
-
Microsoft SharePoint
-
Power Automate
-
Dynamic 365
-
Understanding of DevOps practices
-
Demonstrates teamwork and collaboration
-
Passionate about new technologies
-
Certification in DP-200, DP-201, DP-203, DA-100, PL-300, AZ-900