Data Engineer

Highlights

Job Description

Responsibilities

• Design, develop, and maintain data pipelines and integration workflows using Azure Data Factory, Databricks, and Fabric Data Pipelines.
• Work with large-scale data platforms within the Azure ecosystem (including Azure Synapse, Azure Data Lake, Power BI, and Microsoft Fabric).
• Perform analytical and technical tasks to complete ongoing projects requiring research, data collection, and detailed analysis following organizational standards.
• Implement and optimize ETL/ELT processes for structured and unstructured data sources.
• Collaborate closely with cross-functional teams like Data Scientists, Analysts, and Business Users, delivering robust, production-grade data solutions.
• Exercise independent judgment to troubleshoot and resolve data pipeline, integration, and performance issues.
• Ensure data quality, consistency, and compliance with governance policies.

Key Skills Requirements

• 2–4 years of experience in a Data Engineering or similar role.
• Proven experience with Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake, and Microsoft Fabric Stack (including Fabric Data Engineering, Fabric Data Warehouse, and Fabric Data Activator).
• Strong desire and ability to learn and apply modern Azure cloud technologies, Python, and Apache Spark to build resilient, scalable data pipelines.
• Hands-on experience with SQL and database solutions (e.g., Databricks, MS Fabric SQL Server, Snowflake, etc.).
• Familiarity with data warehousing, data modeling, and ETL/ELT concepts.
• Proficiency in scripting/programming languages such as Python or Scala.
• Understanding of CI/CD processes and tools like Azure DevOps, GitLab, or Jenkins.
• Experience with containerization and orchestration technologies (Docker, Kubernetes).