data governance engineer

Confiz

<div><p>We are seeking an experienced Azure Data Engineer (5+ years) with strong expertise in data warehousing on lakehouse architecture, data engineering, data quality, and governance. The ideal candidate will design and build scalable data pipelines on Microsoft Fabric, implement data quality frameworks, and operationalize governance processes using Microsoft Purview. This role combines technical delivery with data compliance, ensuring trusted and well-governed data across the organization.</p>
<p><b>Key Responsibilities</b></p>
<ul><li>Design and develop <b>batch data pipelines</b> using <b>Fabric Pipelines and PySpark</b>.</li>
<li>Implement <b>data quality rules</b>, validation checks, and monitoring dashboards.</li>
<li>Develop <b>data catalog, lineage, classification, and business glossary</b> in <b>Microsoft Purview</b>.</li>
<li>Enforce <b>data governance policies, standards, and best practices</b> across Microsoft Fabric</li>
<li>Collaborate with DevOps to automate deployments using <b>Azure DevOps</b>.</li>
<li>Integrate data quality in <b>CI/CD pipelines</b> through <b>Azure DevOps</b>.</li>
<li>Ensure compliance with <b>data privacy regulations</b> (e.g., PDPL).</li>
<li>Partner with business and data stewards to improve overall data integrity and usability.</li>
</ul>
<p><b>Required Skills &amp; Experience</b></p>
<ul><li><b>5+ years</b> of experience in data engineering, quality, and governance roles.</li>
<li>Strong hands-on experience with <b>Azure Data Factory</b>, <b>Apache Spark (PySpark)</b>, and <b>Azure Synapse/Fabric</b>.</li>
<li>Proven expertise in <b>Microsoft Purview</b> for governance and catalog management.</li>
<li>Proficient in <b>Python</b> and <b>SQL</b> for data processing and validation.</li>
<li>Understanding of <b>data quality dimensions</b>, profiling, and cleansing techniques.</li>
<li>Strong analytical, problem-solving, and communication skills.</li>
<li>Experience with <b>Great Expectations</b> or similar data validation tools is a plus.</li>
</ul>
<p><b>Preferred Qualifications</b></p>
<ul><li><b>Microsoft Certified: Fabric Data Engineer Associate</b> or equivalent certification.</li>
<li>Experience with <b>Microsoft Fabric</b> and <b>AI-driven metadata or quality tools</b>.</li>
</ul>
<p>We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.</p>
<p>What makes Confiz stand out is our focus on processes and culture. Confiz is <b>ISO 9001:2015</b> (QMS), <b>ISO 27001:2022</b> (ISMS), <b>ISO 20000-1:2018</b> (ITSM), <b>ISO 14001:2015</b> (EMS), <b>ISO 45001:2018 </b>(OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.</p>
<p>People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.</p>
<p>To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</p></div>

Principal Data Engineer – Data Quality & Governance

Living Stones Group

<p><b>MDM ENGINEER</b> (Healthcare)</p><p><b>Type:</b> Full-time, 6-month contract<br/>(This is an in-person office-based position with optional/per request business trips to Saudi Arabia)</p><p>Are you passionate about Master Data Management (MDM) and its role in transforming healthcare? Join our innovative team to build cutting-edge solutions that redefine the future of health data. We are looking for a <b>MDM Engineer</b> who thrives on solving complex problems, loves working with data, and is eager to make a real-world impact in the healthcare domain.</p><p><b>Responsibilities</b></p><p>● Understanding of MDM processes</p><p>● Collaborate with cross-functional teams to integrate data from various sources, ensuring consistency and accuracy.</p><p>● Optimize MDM processes to improve data quality, governance, and security.</p><p>● Ensure compliance with healthcare regulations (e.g., HIPAA, GDPR) for sensitive data management.</p><p>● Troubleshoot and resolve data integration and performance issues.</p><p>● Monitor and improve MDM systems to meet business and technical needs.</p><p>● Design, develop, and maintain scalable MDM solutions tailored to healthcare applications.</p><p><b>Requirements</b></p><p>● <b>Must skill:</b> 3+ years of hands-on experience with MDM tools (e.g., Informatica MDM, Reltio, Profisee, IBM InfoSphere).</p><p>● <b>Must skill: </b>Strong understanding of data modeling, data integration, and ETL processes.</p><p>● Experience working with healthcare data (e.g., FHIR, HL7, EHR systems).</p><p>● Scripting languages: Python, SQL, Javascript, Clojure, YAML.</p><p>● Solid knowledge of data governance and compliance in healthcare.</p><p>● Familiarity with cloud platforms and data pipelines.</p><p>● Excellent problem-solving skills and attention to detail.</p><p>● Strong communication and teamwork skills.</p><p>● English - Upper intermediate, <b>Arabic - Advanced.</b></p><p><b>What We Offer:</b></p><p>● Competitive salary rate depending on your experience and skills</p><p>● Challenging tasks and ability to improve professional knowledge and skills.</p><p>● A team where your feedback is appreciated</p><p>● Office in Cairo</p><p><b>Why You&rsquo;ll Love Working With Us</b></p><p>● <b>Impact</b>: Your work will directly contribute to improving healthcare systems and saving lives.</p><p>● <b>Innovation</b>: Be part of a team that pushes the boundaries of data management in healthcare.</p><p>● <b>Connection</b>: Join a company where collaboration and teamwork are key.</p><p>If you&rsquo;re ready to take on the challenge of revolutionizing healthcare, we&rsquo;d love to hear from you!</p><p><b>Apply now</b> people@livingstones.group</p><p>and let&rsquo;s create a healthier future together.</p><p>Job Type: Contract<br/>Contract length: 6 months</p>

Master Data Management (MDM) ENGINEER (Health)

Microsoft

<div><b>Overview</b><p><br>
Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft&rsquo;s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers&rsquo; heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world.</p><p></p><p><br>
We are looking for passionate engineers experienced in building reliable, high‑throughput, cloud‑scale data systems. Our team owns the Microsoft Next Gen Privacy Unified Catalog, an evolving platform that unifies and enriches metadata from diverse systems to power privacy, governance, and responsible data intelligence across Microsoft. You will design core components of a modern distributed data platform that relies heavily on AI‑assisted development and AI‑powered early error detection to improve engineer velocity, data quality, and operational reliability.</p><p></p><p><i><br>
Microsoft&rsquo;s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.</i></p><b><br>
Responsibilities</b><p><br>
We are looking for passionate engineers who excel at building reliable, high‑scale, cloud‑native data systems. Our team is responsible for the Microsoft Next Gen Privacy Unified Catalog, an evolving platform that unifies metadata from diverse systems to power privacy, governance, and responsible data intelligence across Microsoft. We build high‑throughput data pipelines, scalable distributed transformations, and enrichment workflows that combine signals from multiple services. This is a unique opportunity to contribute to foundational data infrastructure with deep engineering challenges in distributed systems, metadata processing, cloud architecture, and service integration.
</p><p><b>Responsibilities include:</b></p><p>
1) Design and implement large‑scale data pipelines that ingest, transform, and unify metadata across multiple systems, enabling advanced governance and analytics capabilities.</p><p>
 2) Build modular transformation and enrichment components, including integrations with internal microservices, ensuring reliability, resiliency, and performance at cloud scale.
</p><p>3) Leverage AI‑powered tools for code generation, testing, and early‑error detection, improving reliability, accelerating development cycles, and reducing operational overhead.
</p><p>4) Improve platform scalability, observability, and reliability through robust monitoring, automated recovery patterns, and engineering excellence practices.</p><p>
5) Collaborate closely with partner engineering teams to shape data models, processing patterns, and APIs that support long‑term platform evolution and new privacy capabilities.</p><p>
6) Drive engineering quality end‑to‑end, including testing, performance validation, CI/CD automation, and operational readiness for high‑scale production workloads.</p><p>
7) Participate in on‑call rotations and incident response, contributing to root‑cause analysis and long‑term improvements in system resilience and availability.</p><p>
8) Contribute to architectural discussions and technical strategy, helping define the next generation of Microsoft&rsquo;s privacy and governance data platform.</p><b><br>
Qualifications</b><p><br>
1) Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 10&ndash;12 years&rsquo; experience in data engineering, distributed systems, software development, or data platform work</p><p>
2) Strong experience with data or software engineering, with solid proficiency in Python, Java, Scala, or C# - 3+ years in SQL-based query languages (e.g., SQL, KQL)</p><p>
3) 8+ years of experience with ETL and data cloud computing technologies, including Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Logic Apps, Azure Functions, Azure Data Explorer, and Power BI or equivalent platforms
</p><p>4) Hands‑on experience with cloud‑scale ETL and data processing technologies, such as: Distributed compute engines (e.g., Spark / PySpark) Cloud data platforms and orchestration tools Metadata indexing, search systems, or governance frameworks Data ingestion, transformation, and operational analytics pipelines.</p><p>
Join us to build the Microsoft Next Gen Privacy Unified Catalog, a data governance platform that operates at true planet scale.</p><p>
You&rsquo;ll work on distributed data systems that process massive, constantly evolving datasets across Microsoft, designing pipelines and enrichment frameworks that power privacy, compliance, and responsible AI. If you want to solve deep technical challenges, work with world‑class engineers, and help shape the future of data governance for one of the largest data ecosystems on the planet, this is the role for you.<br>
<br>
Define and establish the core architecture for the Microsoft Next Gen Privacy Unified Catalog data pipeline, setting foundational patterns for -transformation, enrichment, AI‑assisted automation, and large‑scale metadata processing. - Provide technical leadership and mentor a growing data engineering team, guiding design decisions, elevating engineering standards, and helping early‑career engineers develop strong technical judgment. - Drive AI‑driven improvements across the pipeline, applying AI for code generation, intelligent validation, and early error detection to improve reliability, development velocity, and data quality.</p><br>
<p></p>
<br>
<p>This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.</p><p></p><p><br>
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process<b>.</b></p></div>

Senior Software Engineer

Capgemini

<div><div><div><p>Hyderabad, Navi Mumbai, Chennai (ex Madras), Pune, Bangalore</p><div>
Azure Purview Data Engineer</div><p>
</p></div></div><div></div><div><div><div><div><div><p>
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you&rsquo;d like, where you&rsquo;ll be supported and inspired by a collaborative community of colleagues around the world, and where you&rsquo;ll be able to reimagine what&rsquo;s possible. Join us and help the world&rsquo;s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.</p><div><div><div><div><b>
You Role</b></div></div><div><ul><li>
Architect, configure, and optimize Purview for data cataloging, classification, lineage, and compliance</li><li>
Integrate Purview with Azure</li><li>
Define and enforce data sensitivity labels and automated policies</li><li>
Conduct Purview scans, classify data via ML, and maintain data map</li><li>
Monitor data security posture, manage audit logs, and respond to incidents</li><li>
Automate governance tasks with PowerShell, Azure CLI, or Python scripts</li></ul></div></div><div><div><div><b>
Your Profile</b></div></div><div><ul><li><p>
Should have 2+ years of experience in Azure Purview technology with strong project track record</p></li><li>
Strong customer orientation, decision making, problem solving, communication and presentation skills</li><li>
Very good judgement skills and ability to shape compelling solutions and solve unstructured problems with assumptions</li><li>
Very good collaboration skills and ability to interact with multi-cultural and multi-functional teams spread across geographies</li><li>
Strong executive presence and entrepreneurial spirit</li><li>
Superb leadership and team building skills with ability to build consensus and achieve goals through collaboration rather than direct line authority</li></ul></div></div><div><div><div><b>
What you&rsquo;ll love about working here</b></div></div><div><ul><li>You can shape your career with us. We offer a range of career paths and internal opportunities within Capgemini group. You will also get personalized career guidance from our leaders.</li><li>You will get comprehensive wellness benefits including health checks, telemedicine, insurance with top-ups, elder care, partner coverage or new parent support via flexible work.</li><li>You will have the opportunity to learn on one of the industry's largest digital learning platforms, with access to 250,000+ courses and numerous certifications.</li></ul><div>
</div></div></div><div><div><div><b>About Capgemini</b></div></div></div></div><div></div><p>
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.</p></div></div><div><div><div>
<div><div>Ref. code</div><div>
277253-en_GB</div></div><div><div>
Posted on</div><div>
10 Nov 2025</div></div><div><div>
Experience level</div><div>
Experienced Professionals</div></div><div><div>
Contract type</div><div>
Permanent</div></div><div><div>
Location</div><div>
Hyderabad, Navi Mumbai, Chennai (ex Madras), Pune, Bangalore</div></div><div><div>
Business unit</div><div>
I and D Global Business Line</div></div><div><div>
Brand</div><div>
Capgemini</div></div></div></div></div></div></div></div></div><p></p>

Azure Purview Data Engineer

Infosys

<div><h2 class="jobSectionHeader"><b>Job Description:</b></h2><br>
<ul>
<li>We are seeking an experienced Data Engineer with strong expertise in Azure Data Services Big Data technologies and ETL ELT processes</li>
<li>The ideal candidate will have domain knowledge in CPG and Manufacturing sectors along with hands on experience in data governance data modeling and cloud based data engineering</li>
<li>This role involves building scalable data pipelines integrating industrial data platforms and enabling advanced analytics for smarter decision making</li></ul><br>
<h2 class="jobSectionHeader"><b>
Key Responsibilities:</b></h2><br>
<ul>
<li>Design and develop data pipelines using Azure Data Factory Azure Databricks and Azure Data Lake Gen2</li>
<li>Implement ETL ELT processes data integration techniques and data governance standards</li>
<li>Work with Big Data technologies such as Apache Spark and PySpark for large scale data processing</li>
<li>Gather engineer and prepare data for analytics and business insights</li>
<li>Integrate systems and data across diverse environments ensuring seamless connectivity</li>
<li>Build solutions to extract and consolidate data from multiple sources sales inventory product customer databases</li>
<li>Collaborate with ML Engineers Data Scientists and business stakeholders to enable automation and advanced analytics</li>
<li>Contribute to coding standards and best practices for data engineering workloads</li>
<li>Support modernization initiatives aligned with Industry 4</li>
<li>0 and ISA 95 standards</li></ul><br>
<h2 class="jobSectionHeader"><b>
Technical Requirements:</b></h2><br>
<ul>
<li>5 7 years of experience in data engineering and data governance within industrial domains CPG Manufacturing</li>
<li>Strong knowledge of Azure Data Services Azure Data Factory Azure Databricks Azure Data Lake Gen2</li>
<li>Expertise in ETL processes data integration tools and pipeline development</li>
<li>Proficiency in Python SQL and Apache Spark</li>
<li>Understanding of Industry 4</li>
<li>0 ISA 95 standards and maintenance strategies</li>
<li>Familiarity with AI ML concepts and ability to work with advanced analytics teams</li>
<li>Experience with DevOps CI CD for data pipeline automation</li></ul><br>
<h2 class="jobSectionHeader"><b>
Additional Responsibilities:</b></h2><br>
<ul>
<li>Good to have</li>
<li>Exposure to data modeling data warehousing and cloud architecture</li>
<li>Knowledge of business intelligence tools and statistical programming</li>
<li>Ability to research and implement new tools for automation and optimization</li></ul><br>
<h2 class="jobSectionHeader"><b>
Preferred Skills:</b></h2>
Technology-&gt;Data Engineering-&gt;Databricks,Technology-&gt;Cloud Integration-&gt;Azure Data Factory (ADF),Technology-&gt;Cloud Platform-&gt;Azure Analytics Services-&gt;Azure Data Lake,Technology-&gt;Consulting - Data Governance-&gt;Data Governance,Technology-&gt;Database-&gt;Data Modeling,Technology-&gt;OpenSystem-&gt;Python - OpenSystem</div>

Data Engineer

Novo Tree Minds

<div><h2 class="jobSectionHeader"><b>Job Description for Backend Developer in Bengaluru</b></h2>
<p>Job Description: Backend Engineer - Lead</p>
<p>Mandatory- Team Management</p>
<p>Experience-5+ Years</p>
<p>Skills- Python, Pyspark, API</p>
<p>Location: Bengaluru</p>
<p>Company: This is a leader in next-generation risk decisioning and responsible AI governance, empowering banks and lenders to build transparent, compliant, and data-driven solutions. Our platforms combine advanced analytics, real-time data integration, and GenAI to support complex financial decision workflows for regulated industries.</p>
<p>Role Overview As a Backend Engineer</p>
<p>you will:</p>
<ul><li>Architect, develop, and maintain backend components for our Risk Decisioning Platform.</li></ul>
<ul><li>Build and orchestrate scalable backend services that automate, optimize, and monitor high-value credit and risk decisions in real time.</li></ul>
<ul><li>Integrate with ORM layers &ndash; such as SQLAlchemy &ndash; and multi RDBMS solutions (Postgres, MySQL, Oracle, MSSQL, etc) to ensure data integrity, scalability, and compliance.</li></ul>
<ul><li>Collaborate closely with Product Team, Data Scientists, QA Teams to create extensible APIs, workflow automation, and AI governance features.</li></ul>
<ul><li>Architect workflows for privacy, auditability, versioned traceability, and role-based access control, ensuring adherence to regulatory frameworks.</li></ul>
<ul><li>Take ownership from requirements to deployment, seeing your code deliver real impact in the lives of customers and end users.</li></ul>
<p>Technical Skills Languages: Python 3.9+, SQL</p>
<p> Frameworks: Flask, SQLAlchemy, Celery, Marshmallow, Apache Spark</p>
<ul><li>Databases: PostgreSQL, Oracle, SQL Server, Redis</li></ul>
<ul><li>Tools: pytest, Docker, Git, Nx</li></ul>
<ul><li>Cloud: Experience with AWS, Azure, or GCP preferred</li></ul>
<ul><li>Monitoring: Familiarity with OpenTelemetry and logging frameworks</li></ul><br>
<p></p>
<p>Why Join Us?</p>
<ul><li>Cutting-Edge Tech: Work hands-on with the latest AI, cloud-native workflows, and big data tools&mdash;all within a single compliant platform.</li></ul>
<ul><li>End-to-End Impact: Contribute to mission-critical backend systems, from core data models to live production decision services.</li></ul>
<ul><li>Innovation at Scale: Engineer solutions that process vast data volumes, helping financial institutions innovate safely and effectively.</li></ul>
<ul><li>Mission-Driven: Join a passionate team advancing fair, transparent, and compliant risk decisioning at the forefront of fintech and AI governance.</li></ul>
<p>What Weʼre Looking For</p>
<ul><li>Proficiency in Python, SQLAlchemy (or similar ORM), and SQL databases.</li></ul>
<ul><li>Experience developing and maintaining scalable backend services, including API, data orchestration, ML workflows, and workflow automation.</li></ul>
<ul><li>Solid understanding of data modeling, distributed systems, and backend architecture for regulated environments.</li></ul>
<p> Curiosity and drive to work at the intersection of AI/ML, fintech, and regulatory technology. Experience mentoring and guiding junior developers.</p></div>

Backend Engineer- Lead

Cigres Technologies

<p></p><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div>Bengaluru, Karnataka, India</div></div><div><div>
Job Type</div></div><div><div>
Full Time</div></div></div></div></div></div></div><div></div><div><div><div><div><div><div><div><div><div><div>
About the Role</div></div><div><div>
Mandatory Skills<br>
Databricks Engineer, Power Bi Developer, Dax Queries, SQL, Data Warehousing, Power Automate<br>
<br>
Skill to Evaluate<br>
Databricks Engineer, Power Bi Developer, Dax Queries, SQL, Data Warehousing, Power Automate<br>
<br>
Experience<br>
5 to 9 Years<br>
Key Responsibilities:<br>
<br>
<ul><li>Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes.</li><li>Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders.</li><li>Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.</li><li>Optimize data storage and retrieval processes to enhance performance and reduce latency.</li><li>Ensure data quality and integrity by implementing best practices for data governance and validation.</li><li>Mentor junior data engineers and contribute to knowledge sharing within the team.</li><li>Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.</li></ul><br>
Skills and Tools Required:<br>
<br>
<ul><li>Proficiency in Databricks and experience with Spark for big data processing.</li><li>Strong experience with Power BI, particularly in building reports and dashboards using DAX.</li><li>Solid programming skills in Python or Scala for developing data pipelines.</li><li>Knowledge of SQL and experience with relational databases and data warehousing concepts.</li></ul>
- Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.<br>
<ul><li>Understanding of data modeling, ETL processes, and data integration methodologies.</li><li>Excellent problem-solving skills and attention to detail.</li><li>Strong communication and collaboration abilities to work effectively in a team-oriented environment.</li></ul><br>
Skill Area Tools &amp; Technologies<br>
Data Engineering Databricks, Apache Spark, Delta Lake<br>
Programming Python, SQL, PySpark<br>
BI &amp; Visualization Power BI, DAX, Power Query<br>
Cloud Platforms Azure<br>
DevOps &amp; CI/CD Git, Azure DevOps<br>
Data Governance Unity Catalog, Data Lake Security<br>
<br>
Preferred Qualifications:<br>
<br>
<ul><li>Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field.</li><li>Previous experience in a similar data engineering role, particularly within a corporate environment.</li><li>Knowledge of additional BI tools and data visualization platforms is a plus.</li></ul></div></div><div><div>
Requirements</div></div><div></div><div><div><div><div><div><div><div><div><div><div><div>
Mandatory Skills</div></div><div><div>
Databricks Engineer, Power Bi Developer, Dax Queries, SQL, Data Warehousing, Power Automate</div></div><div></div><div><div><br>
Skill to Evaluate</div></div><div><div>
Databricks Engineer, Power Bi Developer, Dax Queries, SQL, Data Warehousing, Power Automate</div></div><div></div><div><div><br>
Experience</div></div><div><div>
5 to 9 Years</div></div><div><div>
Key Responsibilities:</div></div><div></div><div><ul><li><br>
Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes.</li></ul></div><div><ul><li>Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders.</li></ul></div><div><ul><li>Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.</li></ul></div><div><ul><li>Optimize data storage and retrieval processes to enhance performance and reduce latency.</li></ul></div><div><ul><li>Ensure data quality and integrity by implementing best practices for data governance and validation.</li></ul></div><div><ul><li>Mentor junior data engineers and contribute to knowledge sharing within the team.</li></ul></div><div><ul><li>Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.</li></ul></div><div></div><div><div><br>
Skills and Tools Required:</div></div><div></div><div><ul><li><br>
Proficiency in Databricks and experience with Spark for big data processing.</li></ul></div><div><ul><li>Strong experience with Power BI, particularly in building reports and dashboards using DAX.</li></ul></div><div><ul><li>Solid programming skills in Python or Scala for developing data pipelines.</li></ul></div><div><ul><li>Knowledge of SQL and experience with relational databases and data warehousing concepts.</li></ul></div><div><div>
- Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.</div></div><div><ul><li>Understanding of data modeling, ETL processes, and data integration methodologies.</li></ul></div><div><ul><li>Excellent problem-solving skills and attention to detail.</li></ul></div><div><ul><li>Strong communication and collaboration abilities to work effectively in a team-oriented environment.</li></ul></div><div></div><div><div><br>
Skill Area Tools &amp; Technologies</div></div><div><div>
Data Engineering Databricks, Apache Spark, Delta Lake</div></div><div><div>
Programming Python, SQL, PySpark</div></div><div><div>
BI &amp; Visualization Power BI, DAX, Power Query</div></div><div><div>
Cloud Platforms Azure</div></div><div><div>
DevOps &amp; CI/CD Git, Azure DevOps</div></div><div><div>
Data Governance Unity Catalog, Data Lake Security</div></div><div></div><div><div><br>
Preferred Qualifications:</div></div><div></div><div><ul><li><br>
Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field.</li></ul></div><div><ul><li>Previous experience in a similar data engineering role, particularly within a corporate environment.</li></ul></div><div><ul><li>Knowledge of additional BI tools and data visualization platforms is a plus.</li></ul></div></div></div></div></div></div></div></div></div></div><div><div>
About the Company</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><div></div>

Senior Data Engineer with Data Bricks

Search 10000+ Data governance engineer jobs near you this January. New roles added regularly across leading industries. Apply today.