data quality engineer

Citylogix

<div><p><b>About Citylogix</b></p><p>
Citylogix is a leading provider of data and analytics for smart city transportation infrastructure, leveraging LiDAR, 360&deg; imaging, and AI-powered analytics to create detailed digital maps, and provide predictive analytics for proactive asset management.</p><p><b><br>
About the role</b></p><p>
The Data Quality Engineer serves as the guardian of system integrity and data accuracy across the entire pipeline infrastructure. This position encompasses comprehensive testing responsibilities, from unit testing individual components to validating end-to-end system functionality and data correctness. The engineer will develop sophisticated testing frameworks that ensure both technical reliability and data integrity at scale. The role requires a methodical approach to quality assurance combined with deep understanding of data validation techniques. The successful candidate will establish quality gates throughout the development lifecycle and implement real-time monitoring systems to detect anomalies before they impact operations.</p><p></p><p><b><br>
What you'll do</b></p><ul><li>
Develop automated testing for all pipeline components</li><li>
Implement end-to-end system and integration testing</li><li>
Create data validation and integrity frameworks</li><li>
Design performance and load testing procedures</li><li>
Build real-time quality monitoring systems</li><li>
Test features before production deployment</li><li>
Investigate and resolve data discrepancies</li></ul><p><b>
Qualifications</b></p><ul><li>
3+ years in QA/testing roles, preferably with data systems</li><li>
Experience with test automation frameworks</li><li>
Knowledge of data validation techniques</li><li>
Familiarity with performance testing tools</li><li>
Strong analytical and troubleshooting skills</li></ul></div>

Data Quality Engineer

Codvo.ai

<div><div><div><div><b>Data Quality Engineer</b></div><div></div><div><b><br>
Role Overview</b></div><div>
We are looking for a Data Quality Engineer to design and implement robust data quality frameworks. The ideal candidate will ensure data accuracy, consistency, and reliability across our data platforms.</div><div></div><div><b><br>
Key Responsibilities</b></div><ul><li>Develop and maintain data quality checks and validation frameworks</li><li>Collaborate with data engineers and analysts to identify and resolve data issues</li><li>Monitor data pipelines for anomalies and inconsistencies</li><li>Implement data profiling and cleansing processes</li><li>Ensure adherence to data governance and compliance standards</li><li>Automate data quality reporting and alerting mechanisms</li><li>Contribute to continuous improvement of data quality practices</li></ul><div></div><div><b><br>
Technologies &amp; Skills</b></div><ul><li>Databricks (PySpark, Delta Lake, SQL)</li><li>Snowflake</li><li>Azure Data Factory</li><li>Informatica</li><li>Teradata</li><li>CI/CD (GitHub Actions, Azure DevOps)</li><li>Cloud Platforms (Azure, AWS, GCP)</li><li>Python</li><li>SQL</li><li>Data Governance</li><li>Data Modeling</li><li>Streaming (Kafka, Event Hub)</li><li>Unity Catalog</li></ul><div></div><div><b><br>
Nice-to-Have Skills</b></div><ul><li>Experience with ML pipelines (MLflow, Feature Store)</li><li>Knowledge of visualization tools (Power BI, Tableau, Looker)</li><li>Exposure to Graph databases (Neo4j) or RAG/LLM pipelines</li><li>Containerization (Docker, Kubernetes)</li><li>Basic front-end knowledge (React/Angular)</li><li>Microservices (FastAPI/Flask)</li></ul><div></div><div><b><br>
Qualifications &amp; Experience</b></div><ul><li>Bachelor&rsquo;s or Master&rsquo;s in Computer Science, Data Engineering, or related field</li><li>5&ndash;8 years of experience in data-related roles</li><li>Strong problem-solving and analytical skills</li><li>Clear communication and documentation abilities</li><li>Experience working in cross-functional teams</li></ul><p></p><p><b><br>
About Us</b></p><p>
At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.</p></div></div></div><p></p>

Quality Automation Engineer - Data (India)

Confiz

<div><p>We are seeking an experienced Azure Data Engineer (5+ years) with strong expertise in data warehousing on lakehouse architecture, data engineering, data quality, and governance. The ideal candidate will design and build scalable data pipelines on Microsoft Fabric, implement data quality frameworks, and operationalize governance processes using Microsoft Purview. This role combines technical delivery with data compliance, ensuring trusted and well-governed data across the organization.</p>
<p><b>Key Responsibilities</b></p>
<ul><li>Design and develop <b>batch data pipelines</b> using <b>Fabric Pipelines and PySpark</b>.</li>
<li>Implement <b>data quality rules</b>, validation checks, and monitoring dashboards.</li>
<li>Develop <b>data catalog, lineage, classification, and business glossary</b> in <b>Microsoft Purview</b>.</li>
<li>Enforce <b>data governance policies, standards, and best practices</b> across Microsoft Fabric</li>
<li>Collaborate with DevOps to automate deployments using <b>Azure DevOps</b>.</li>
<li>Integrate data quality in <b>CI/CD pipelines</b> through <b>Azure DevOps</b>.</li>
<li>Ensure compliance with <b>data privacy regulations</b> (e.g., PDPL).</li>
<li>Partner with business and data stewards to improve overall data integrity and usability.</li>
</ul>
<p><b>Required Skills &amp; Experience</b></p>
<ul><li><b>5+ years</b> of experience in data engineering, quality, and governance roles.</li>
<li>Strong hands-on experience with <b>Azure Data Factory</b>, <b>Apache Spark (PySpark)</b>, and <b>Azure Synapse/Fabric</b>.</li>
<li>Proven expertise in <b>Microsoft Purview</b> for governance and catalog management.</li>
<li>Proficient in <b>Python</b> and <b>SQL</b> for data processing and validation.</li>
<li>Understanding of <b>data quality dimensions</b>, profiling, and cleansing techniques.</li>
<li>Strong analytical, problem-solving, and communication skills.</li>
<li>Experience with <b>Great Expectations</b> or similar data validation tools is a plus.</li>
</ul>
<p><b>Preferred Qualifications</b></p>
<ul><li><b>Microsoft Certified: Fabric Data Engineer Associate</b> or equivalent certification.</li>
<li>Experience with <b>Microsoft Fabric</b> and <b>AI-driven metadata or quality tools</b>.</li>
</ul>
<p>We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.</p>
<p>What makes Confiz stand out is our focus on processes and culture. Confiz is <b>ISO 9001:2015</b> (QMS), <b>ISO 27001:2022</b> (ISMS), <b>ISO 20000-1:2018</b> (ITSM), <b>ISO 14001:2015</b> (EMS), <b>ISO 45001:2018 </b>(OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.</p>
<p>People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.</p>
<p>To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</p></div>

Principal Data Engineer – Data Quality & Governance

Apple

<div>Join Apple&rsquo;s Data Management Team and Shape the Future of Reliable Data in the Manufacturing Space!<br>
<br>
At Apple, we believe that great decisions start with great data. Our Data Quality team within Operations is looking for a Machine Learning Engineer with Software Engineering background to help ensure the integrity, accuracy, and reliability of mission-critical data. In this role, you will design and build scalable ML-driven solutions for data validation, anomaly detection, and quality monitoring-helping Apple&rsquo;s global operations run with precision and confidence. If you're passionate about applying cutting-edge machine learning to solve real-world data challenges at scale, come join us in pushing the boundaries of what&rsquo;s possible.<br>
<br>
<b>Description</b><br>
At Apple, we rely on high-quality data to drive critical decisions across our global operations. We are looking for a Machine Learning Engineer with software engineering skills to develop and deploy ML-driven data validation solutions that ensure data integrity. In this role, you will build scalable anomaly detection systems, work on Gen AI projects, collaborate with data engineering teams to enhance data quality frameworks, and drive innovations in MLOps and data monitoring.<br>
<br>
<ul><li>Develop ML-based data validation and monitoring solutions, focusing on anomaly detection and explainability.</li></ul><br>
<ul><li>Analyze large datasets to detect data drift, integrity issues, and emerging quality risks.</li></ul><br>
<ul><li>Apply the full ML lifecycle, from exploratory data analysis (EDA) and feature engineering to model selection, training, deployment, and monitoring.</li></ul><br>
<ul><li>Experiment with different methodologies to improve model accuracy and reliability.</li></ul><br>
<ul><li>Collaborate with data engineering teams to design frameworks for detecting missing, inconsistent, or duplicate data.</li></ul><br>
<ul><li>Investigate root causes of data quality issues and propose scalable, automated solutions.</li></ul><br>
<ul><li>Stay up to date with the latest advancements in data science, MLOps, and data engineering best practices.</li></ul><br>
<b>
Preferred Qualifications</b><br>
Experience with MLOps tools (MLflow, Kubeflow) for managing data quality models.<br>
<br>
Exposure to big data frameworks (Spark, Kafka) for real-time data validation.<br>
<br>
Familiarity with CI/CD for data pipelines and model deployments.<br>
<br>
Strong problem-solving skills and ability to diagnose complex data issues.<br>
<br>
Experience working with large-scale structured and unstructured data.<br>
<br>
Familiarity with data engineering concepts, including ETL pipelines, batch/stream processing.<br>
<br>
<b>Minimum Qualifications</b><br>
3+ industry experience in building ML solutions and collaborating with software teams.<br>
<br>
Strong experience in machine learning for anomaly detection, data validation, or data quality improvement.<br>
<br>
Proficiency in Python (Pandas, NumPy, Scikit-learn, PyTorch/TensorFlow, etc.).<br>
<br>
Hands-on experience with SQL and databases (PostgreSQL, Snowflake, MySQL, etc.).<br>
<br>
Strong knowledge of statistical methods (PCA, exponential smoothing, and etc.) for detecting anomalies, drift, and inconsistencies.<br>
<br>
Experience with version control (Git) and software development best practices.&quot;,&quot;internalDetails&quot;:null,&quot;eeoContent&quot;:null</div>

Machine Learning Software Engineer

LTIMindtree

<div>
 <p>
  <strong>
   <u>
    Data Quality Engineer
   </u>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Experience: 5+ Years
  </strong>
 </p>
 <p>
  <strong>
   Location: Hyderabad/Gurgoan/Noida
  </strong>
 </p>
 <p>
  <strong>
   Notice Period: 0-30 days
  </strong>
 </p>
 <p>
  <strong>
   Work Mode: Hybrid
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <u>
    Key Responsibilities
   </u>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Design and execute ETL test plans and cases including automated scripts
  </li>
  <li>
   Validate data transformations and loading processes utilizing automation where possible
  </li>
  <li>
   Identify and document data discrepancies and errors automating error detection
  </li>
  <li>
   Perform data quality profiling and analysis employing automated data quality checks
  </li>
  <li>
   Write and execute SQL queries for data validation and automate data validation processes
  </li>
  <li>
   Test database stored procedures and functions creating automated test suites
  </li>
  <li>
   Document test results and create detailed reports automating report generation
  </li>
  <li>
   Track and manage defects using bug tracking tools and automate defect reporting
  </li>
  <li>
   Collaborate with developers and analysts to resolve data issues and contribute to automated testing frameworks
  </li>
  <li>
   Ensure data compliance with business rules and standards implementing automated compliance checks
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <u>
    Key Requirements
   </u>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   5years of experience in data quality and ETL testing
  </li>
  <li>
   Strong understanding of ETL concepts data warehousing principles and database systems
  </li>
  <li>
   Proficiency in SQL and experience with relational databases PostgreSQL SQL Server Snowflake
  </li>
  <li>
   Experience with ETL tools eg Informatica Talend DataStage AWS Glue Azure Data Factory
  </li>
  <li>
   Experience with cloudbased data platforms eg AWS Azure GCP is a plus
  </li>
  <li>
   Familiarity with data quality tools and techniques
  </li>
  <li>
   Experience with test management and bug tracking tools eg Jira Azure DevOps
  </li>
  <li>
   Experience with AgileScrum methodologies
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <u>
    Personal Attributes
   </u>
  </strong>
 </p>
 <ul>
  <li>
   Very good communication skills
  </li>
  <li>
   Ability to easily fit into a distributed development team
  </li>
  <li>
   Ability to manage timelines of multiple initiatives
  </li>
  <li>
   Selfmotivated especially with respect to learning new software tools and best practices in software quality assurance
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  If you&rsquo;re ready to make an impact and grow your career, let&rsquo;s connect!
 </p>
 <p>
  <strong>
   Disclaimer
  </strong>
  : At LTIMindtree, we believe in creating a culture of innovation, which reflects in everything we do. Empower yourself with possibilities that will take you to newer heights and will open to you newer avenues. Experience a vibrant work environment, brimming with new ideas, diverse people, and the innate drive to excel.
 </p>
 <p>
  Please also note that neither LTIMindtree nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTIMindtree for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTIMindtree disclaims any liability in case of loss or damage suffered as a consequence of the same.
 </p>
 <p>
  LTIMindtree is proud to be an equal opportunity employer. We are committed to equal employment opportunity regardless of race, ethnicity, nationality, gender, gender identity, gender expression, language, age, sexual orientation, religion, marital status, veteran status, socio-economic status, disability, or any other characteristic protected by applicable law.
 </p>
 <p>
 </p>
</div>


Quality Analyst

<div><p>We are seeking an experienced engineer to design and implement a Quality Assurance (QA) framework for automated testing across our cloud-native, real-time, and batch data pipelines. The ideal candidate will have deep expertise in Python-based test frameworks, data validation at scale, and CI/CD integration, ensuring reliability, accuracy, and performance in our data platform.</p>
<p><b>Key Responsibilities</b></p>
<ul><li>Design and develop a scalable automated data quality and testing framework for real-time (Kafka/Flink/Spark Streaming) and batch (PySpark) data pipelines.</li>
<li>Integrate automated data validation (schema checks, statistical profiling, anomaly detection) into data workflows using tools like Great Expectations, Deequ, or custom-built Python solutions.</li>
<li>Build test harnesses and reusable libraries for unit, integration, and regression testing of ETL pipelines and APIs.</li>
<li>Implement continuous testing pipelines integrated with CI/CD tools (Azure DevOps, GitHub Actions, or Jenkins).</li>
<li>Collaborate with data engineers to embed data quality gates within orchestration tools (Azure Data Factory / Airflow).</li>
<li>Define and monitor data quality KPIs, thresholds, and alerting using observability tools (Datadog, Prometheus, etc.).</li>
<li>Develop mock data generation and simulation frameworks for performance and stress testing.</li>
<li>Ensure comprehensive test coverage for schema evolution, transformation logic, and downstream data consumption APIs.</li>
<li>Contribute to best practices and documentation around test-driven data engineering and quality-first development culture</li>
<li>Have experience of Shift-Left Testing and Test-Driven Data Engineering</li>
<li>Integrate QA Framework with Orchestration and Monitoring Pipelines</li>
<li>Develop Synthetic Data Generators for Edge Cases and Negative Testing</li>
<li>Validate Schema Evolution and Backward Compatibility</li>
<li>Optimize Testing for Cost Efficiency</li>
<li>Ensure Stability of Every Release</li>
</ul>
<p><b>Required Skills</b></p>
<ul><li>Strong knowledge of data warehousing, lakehouse architectures, and data lake</li>
<li>Overall 6+ years of experience in data warehousing domain and 3+ in ETL testing and data quality</li>
<li>Strong Python development skills, emphasizing modular, testable, and reusable code.</li>
<li>Hands on knowledge of test automation tools and libraries for data warehouse solutions.</li>
<li>Expertise with data quality libraries such as Great Expectations, Deequ, Soda Core, or equivalent.</li>
<li>Solid understanding of SQL and ability to validate transformations over large-scale datasets.</li>
<li>Familiarity with Apache Spark (PySpark) and real-time data processing frameworks (Kafka, Flink, Spark Streaming).</li>
<li>Experience with Azure ecosystem (Data Factory, Databricks, Storage, Synapse).</li>
<li>Experience with CI/CD pipelines and automated testing workflows.</li>
<li>Exposure to monitoring and alerting for data quality metrics</li>
</ul>
<p>We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.</p>
<p>What makes Confiz stand out is our focus on processes and culture. Confiz is <b>ISO 9001:2015</b> (QMS), <b>ISO 27001:2022</b> (ISMS), <b>ISO 20000-1:2018</b> (ITSM), <b>ISO 14001:2015</b> (EMS), <b>ISO 45001:2018 </b>(OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.</p>
<p>People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.</p>
<p>To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</p></div>

Data Quality & Test Automation Framework Engineer

Cargill

<div><div><div><h2 class="jobSectionHeader"><b>Job Purpose and Impact</b></h2>
</div><div><ul><li>The Senior Professional, Data Engineering job designs, builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision, this job ensures that large sets of data are efficiently processed and made accessible for decision making.</li></ul></div></div><div><div><h2 class="jobSectionHeader"><b>
Key Accountabilities</b></h2>
</div><div><ul><li>Accountable for Data Quality solution design, development, deploy using Informatica IMDC &ndash; Cloud Data Quality platform across Data Migration/ Conversion Projects and Steady State.</li><li>
Build DQ solution design or architecture, define best practice, develop re-usable &amp; scalable DQ solution.</li><li>
Implement POC/ Pilot for DQ Solution using Informatica IDMC &ndash; Cloud Data Quality and Integration.</li><li>
Provide technical support and guidance to team on IDMC services &ndash; CDQ, CDI, CDP, CDGC, etc.</li><li>
Lead business and technical discussions, educate &amp; drive adoption of the DQ Solution/ tools.</li><li>
Partner with Global &amp; Enterprise data teams and consult on data quality capabilities to define, Implement and socialize data definitions, Standards/ Polices.</li><li>
Collaboration with business users &amp; data quality trustee, Identify and Prioritize DQ issues &amp; Remediation.</li><li>
Independently handle complex issues with minimal supervision, while escalating only the most complex issues to appropriate staff.</li></ul></div></div><div><div><h2 class="jobSectionHeader"><b>
Qualifications</b></h2>
</div><div><ul><li>12+ years of experience in Informatica Data Quality Platform - IDMC Cloud DQ and IDQ.</li><li>
Proven experience in Informatica IDMC Cloud services &ndash; Cloud Data Quality (CDQ), Data Integration (CDI), Application Integration (CAI), Data Profiling, Address Doctor/AD6, Data Governance and Catalog (CDGC).</li><li>
Sound knowledge in Data Quality Solution design and Architecture using Informatica cloud Platform.</li><li>
Hands-on in IDMC &ndash; Cloud Data Profiling, DQ Rule creation and DQ Scorecard generation functionalities.</li><li>
Hands-on in IDMC - Match &amp; Merge/ De-duplication process to identify Master &amp; Subordinate records.</li><li>
Experienced in IDMC - Data Extraction, Data validation and Reports generation for batch &amp; real-time.</li><li>
Hands-on in Informatica-Address Doctor/ AD6) - Address/ Location Cleansing, Standardizing and Validation</li><li>
Good knowledge in IDMC admin Tasks - Creation of Projects &amp; connections, Schedules, etc.</li><li>
Good knowledge in other IDMC services &ndash; Administrator, Monitor, Operational Insights, CLAIR GPT, etc.</li><li>
Hands-on experience in Informatica Power Center, IDQ developer, IDQ Analyst, MDM, etc.</li></ul></div></div></div>

Sr. Data Engineer

Search 10000+ Data quality engineer jobs near you this November. New roles added regularly across leading industries. Apply today.