Azure Data Engineer

PCS Gulf excels in IT and financial consulting, driven by the belief that optimal solutions arise from a diverse network of experts collaborating across IT, Finance, and business strategy. Our seasoned team remains industry leaders, staying updated on the latest trends. We provide innovative, cutting-edge solutions tailored to clients' needs, drawing from vast industry exposure. Collaborating closely, we craft comprehensive solutions addressing all aspects of business. With a stellar track record and proficiency, we empower clients, from startups to large corporations, to realize their full potential. At PCS Gulf, our unwavering dedication is to deliver tangible results.

Responsibilities:

• You are detailed reviewing and analysing
  structured, semi-structured and unstructured data sources for quality,
  completeness, and business value.
• You design, architect, implement and test
  rapid prototypes that demonstrate value of the data and present them to
  diverse audiences.
• You participate in early state design and
  feature definition activities.
• Responsible for implementing robust data
  pipeline using Microsoft,Databricks Stack.
• Responsible for creating reusable and scalable
  data pipelines.
• You are a Team-Player, collaborating with team
  members across multiple engineering teams to support the integration of
  proven prototypes into core intelligence products.

Requirements:

• Advanced working knowledge and experience with
  relational and non-relational databases
• Experience building and optimizing Big Data
  data pipelines, architectures, and data sets.
• Strong experience in Azure
  Datafactory,Databricks, Eventhub, Python,PySpark ,Azure Synapse and SQL
• Azure Devops experience to deploy the ADF
  pipelines.
• Minimum
  3-5 years of experience.
• Knowledge/Experience with Azure cloud
  stack.