data integration engineer

Cotiviti

<div>Overview:
<p>
Edifecs/Cotiviti is seeking a Data Integration Engineer to join our innovative software teams. In this position, you will be responsible for onboarding customers to the Risk Adjustment workflow applications. As part of this role, you will work with platform engineering, product, and implementation teams. The ideal candidate has experience in building scalable data pipelines that enable workflow applications, reporting, and customer confidence. You must have strong, hands-on technical expertise in big data technologies and communication abilities with non-tech and technical audiences.
</p>Responsibilities:
<ul><li>Design and develop data flows and extraction
</li><li>Integrate client&rsquo;s data into the Edifecs/Cotiviti/Cotiviti Risk Adjustment
</li><li>Work with relational databases and Python
</li><li>Implement open-source standards for data
</li><li>Develop a new framework for data ELT jobs to scale implementation, monitoring, and
</li><li>Build and scale automation that orchestrate complex
</li><li>Ability to support existing processes while leading efforts to redefine the data
</li></ul>Qualifications:
<ul><li>3+ years of hands-on experience with relational database systems (PostgreSQL).</li><li>
2+ years of hands-on experience developing ELT jobs/data pipelines within various technologies such as: Argo Workflows, cron, Airflow, dbt, great
</li><li>2+ years of experience in Linux system.</li><li>
Proficiency in shell scripting and automation</li><li>
Experience building reusable data methods and working with version control systems (git).</li><li>
3+ years of hands-on experience with programming languages such as
</li><li>Plus - Experience with container deployment platforms and tools, such as Kubernetes, Docker, Helm, and Terraform.</li><li>
Plus - AWS Cloud experience: EC2, RDS, SQS, IAM,</li></ul></div><p></p>

Data Integration Engineer

SD (Middle East) LLC

<div><b>Together we make a difference</b>
<p>
We are a leading provider of innovative, high-performance solutions for airport logistics. Our portfolio includes products and services for baggage and cargo handling, advanced software for the digitalization of logistics processes, and a comprehensive range of maintenance and support services. Our major clients include renowned airports and airlines around the world.</p>
<p>
We are looking for a highly motivated self-starter who is passionate about technology to join our team as a <b>Data Integration Enginee</b>r in <b>Dubai.</b></p>
<b>What are my responsibilities?</b>
<ul><li>Develop code to normalize data from various sources for ingestion and processing in Vanderlande Logistics&rsquo; flagship SaaS application.</li>
<li>Ensure quality assurance for SaaS applications.</li>
<li>Design and enhance technical solutions for both new and existing customers.</li>
<li>Document proposed and implemented solutions, ensuring sound design and architecture.</li>
<li>Provide regular status updates to requestors and key stakeholders.</li>
<li>Ensure technical project documentation is thorough and up to date.</li>
<li>Manage the handover process for the Service and Customer Success teams.</li>
<li>Actively contributes to a collaborative, inclusive, and results-driven team environment.</li>
<li>Communicate effectively with stakeholders and set clear expectations.</li>
<li>Collaborate with a geographically dispersed, diverse team to exceed goals and align with strategic objectives.</li>
<li>Manage a dynamic workload, adjusting priorities and actions in response to evolving business needs and new information.</li>
</ul><b>What do I need to qualify for the role?</b>
<ul><li>Strong analytical, logical thinking, and problem-solving skills.</li>
<li>Passion for delivering high-quality projects and a commitment to excellence.</li>
<li>Educational background in software development, computer science, mathematics, or a related field.</li>
<li>Experience with at least one programming language (e.g., Java or Python).</li>
<li>Knowledge of SQL, networking, and Unix/Linux is a plus.</li>
<li>Proficiency in Microsoft Office Suite and other relevant tools; experience with GitLab is advantageous.</li>
<li>Willingness to learn about airport and baggage handling operations.</li>
<li>Ability to motivate teams and drive timely project completion.</li>
<li>Tech-savvy with excellent written, verbal, and analytical communication skills.</li>
<li>Highly organized with strong attention to detail.</li>
<li>Skilled in both written and oral communication, with strong interpersonal abilities.</li>
<li>Capable of conducting research into project-related issues and technologies.</li>
<li>Experience with Agile and/or Lean management methodologies.</li>
<li>Familiarity with client/server and web-based applications.</li>
<li>Fluency in English is required; basic knowledge of German is an advantage.</li>
<li>Resilient and comfortable with flexible working hours.</li>
<li>Basic understanding of APIs and data integration tasks.</li>
<li>Experience in the aviation industry is a plus.</li></ul></div>

Oracle

<div><div><div>We're seeking a Senior Data Integration Engineer to design, develop, and manage enterprise-grade data integration solutions. The ideal candidate will have experience with ETL/ELT processes, API-driven integrations, and enterprise data platforms, with strong technical skills and collaboration abilities.
</div><div>Please apply, If you have the passion and standard methodologies work in an environment where challenges are a norm, where individual brilliance is valued and goes hand in hand with team performance, Where being proactive is how we do things !!!</div></div></div>
<br><div></div><div><div>Successful applicants should have/demonstrate:
</div><p>Key responsibilities
</p><ul><li>Architect, design, and optimize scalable big data solutions for batch and real-time processing.
</li><li>Develop and maintain ETL/ELT pipelines to ingest, transform, and synchronize data from diverse sources.
</li><li>Integrate data from cloud applications, on-prem systems, APIs, and streaming workspaces into centralized data repositories.
</li><li>Implement and manage <b>data lakes </b>and <b>data warehouses </b>solutions on cloud infrastructure.
</li><li>Ensure <b>data consistency, quality, and compliance </b>with governance and security standards.
</li><li>Collaborate with data architects, data engineers, and business stakeholders to align integration solutions with organizational needs.
</li></ul><p>Core qualifications
</p><ul><li>Proficiency in Python, Java, or Scala for big data processing.
</li><li><b>Big Data Frameworks: </b>Strong expertise in Apache Spark, Hadoop, Hive, Flink, or Kafka.
</li><li>Hands-on experience with data modeling, data lakes (Delta Lake, Iceberg, Hudi), and data warehouses (Snowflake, Redshift, BigQuery).
</li><li><b>ETL/ELT Development: Expertise with tools like Informatica, Talend, SSIS, Apache NiFi, dbt, or custom Python-based frameworks.
</b></li><li><b>APIs &amp; Integration: Strong hands-on experience with REST, SOAP, GraphQL APIs, and integration platforms (MuleSoft, Dell Boomi, SnapLogic).
</b></li><li><b>Data Pipelines: Proficiency in batch and real-time integration (Kafka, AWS Kinesis/ Azure Event Hub/ GCP Pub/Sub).
</b></li><li><b>Databases: Deep knowledge of SQL (Oracle, PostgreSQL, SQL Server) and NoSQL (MongoDB, Cassandra, DynamoDB) systems.
</b></li></ul><p>Preferred experience
</p><ul><li>Expertise with at least one major cloud platform (AWS, Azure, GCP).
</li><li>Experience with data services such as AWS EMR/Glue, GCP Dataflow/Dataproc, or Azure Data Factory.
</li><li>Familiarity with containerization (Docker) and orchestration (Kubernetes).
</li><li>Knowledge of CI/CD pipelines for data engineering.
</li><li>Experience with OCI and Oracle Database (including JSON/REST, sharding) and/or Oracle microservices tooling.</li></ul></div><div></div>

Senior Big Data Engineer

Assurety Consulting & Solutions Pvt. ltd

<p>Assurety Consulting is looking for a skilled <b>Data Engineer</b> to design, develop, and maintain robust data solutions. The ideal candidate will have hands-on experience with SQL Server, SSIS, and Azure Data Factory, along with strong knowledge of ETL processes and data optimization.</p><p><b>Key Responsibilities:</b></p><ul><li>Develop, optimize, and maintain ETL pipelines and data workflows.</li><li>Work with SQL Server and Azure Data Factory (ADF) for data integration.</li><li>Implement data warehousing, data lake, and data modeling solutions.</li><li>Collaborate with business and analytics teams to ensure reliable data delivery.</li><li>Improve data quality, performance, and scalability.</li></ul><p><b>Requirements:</b></p><ul><li>Bachelor&rsquo;s degree in Computer Science, Information Systems, or a related field.</li><li>Minimum 3 years of experience as a Data Engineer.</li><li>Strong expertise in SQL Server, SSIS, and Azure Data Factory (ADF).</li><li>Experience in ETL, Data Warehousing, and performance optimization.</li><li>Excellent analytical and problem-solving skills.</li></ul><p><b>Why Join Us:</b></p><ul><li>Collaborative and growth-oriented work environment.</li><li>Opportunity to work with cutting-edge data technologies.</li><li>Clear career progression paths and skill-building opportunities.</li></ul><p><b>Location</b>: Shahrah - e - Faisal, Karachi</p><p>Job Type: Full-time</p><p>Work Location: In person</p>

Data Engineer

CHROMEIS

<div><h4 class="jobSectionHeader"><b>Overview:</b></h4>
<p>
We are seeking a detail-oriented Data Engineer responsible for designing, developing, and maintaining scalable data systems. The ideal candidate will build robust data pipelines, ensure data quality, and collaborate across teams to support analytics and reporting. This role requires a strong understanding of data modeling, data warehousing, integration techniques, and the ability to translate business needs into technical solutions.</p>
<h4 class="jobSectionHeader"><b>
Responsibilities:</b></h4>
<ul><li>Design and implement scalable data pipelines for ingesting, processing, and storing data from diverse sources, ensuring optimal performance and reliability.</li>
<li>Develop and maintain data models that support analytical and operational needs, using techniques that balance normalization and denormalization.</li>
<li>Build and optimize data warehousing solutions, incorporating strategies for partitioning, indexing, and backup to enhance query performance.</li>
<li>Integrate data from various sources through effective ETL processes, resolving format and structure differences to ensure consistency and integrity.</li>
<li>Create clear and actionable data visualizations to communicate data trends and insights to stakeholders.</li>
<li>Write and maintain clean, efficient code for data processing tasks and basic SQL queries, ensuring the solutions are scalable and maintainable.</li>
<li>Collaborate with cross-functional teams to translate business requirements into technical designs and document data architectures.</li>
<li>Employ logical reasoning and problem-solving skills to troubleshoot issues in data flows and optimize system performance.</li>
<li>Communicate effectively, both in writing and verbally, to document processes, share insights, and support decision-making.</li>
</ul><h4 class="jobSectionHeader"><b>Qualifications:</b></h4>
<ul><li>Bachelor&rsquo;s degree in Computer Science, Information Technology, or a related field, or equivalent experience.</li>
<li>Proven experience in building data pipelines, data warehousing, and data integration projects.</li>
<li>Proficiency in SQL and familiarity with at least one programming language (e.g., Python, Java, or similar) used in data processing.</li>
<li>Solid understanding of data modeling techniques, including strategies for handling OLAP systems and large datasets.</li>
<li>Experience with data visualization tools and practices.</li>
<li>Strong analytical and logical reasoning skills, combined with excellent English writing and communication abilities.</li>
<li>Ability to work independently and collaboratively in a dynamic, fast-paced environment.</li>
<li>This position offers an exciting opportunity for a motivated Data Engineer to contribute to the overall data strategy, ensuring efficient data capture, storage, and analysis that drives informed decision-making.</li>
</ul><h4 class="jobSectionHeader"><b>Application Process:</b></h4>
<div><ul><li>Please send your resume to [careers@chromeis.com] with a relevant subject line.</li></ul>
<ul><li>If your resume is shortlisted, you will be invited to take an online AI-based assessment.</li></ul>
<ul><li>Candidates who pass this test will move on to the next stage: an on-call interview with the end client.</li></ul>
<ul><li>Successful candidates from all rounds will receive an offer based on the initial discussion during the first call.</li></ul></div></div>

Systems Limited

<div><h4 class="jobSectionHeader"><b>We are looking for a Data Engineer with 3&ndash;4 years of experience in data engineering, data integration, or a related role.</b></h4>
<h4 class="jobSectionHeader"><b>Responsibilities</b></h4>
<ul>
<li><p>Develop scalable ETL processes using <b>Spark</b>, <b>Hadoop</b>, and other big data technologies.</p>
</li>
<li><p>Design, test, and maintain pipelines that transform raw data into structured formats for analysis and reporting.</p>
</li>
<li><p>Utilize tools such as <b>Hive</b>, <b>HBase</b>, <b>MapReduce</b>, and <b>Spark</b> for both real-time and batch data processing.</p>
</li>
<li><p>Manage and optimize <b>relational</b> and <b>NoSQL databases</b> (including <b>Vertica</b>) and write complex SQL queries for data manipulation.</p>
</li>
<li><p>Automate data workflows and routine processes through <b>shell scripting</b> and related automation tools.</p>
</li>
<li><p>Enhance performance, scalability, and cost efficiency across data storage, retrieval, and transformation layers.</p>
</li>
<li><p>Partner with <b>data analysts</b>, <b>data scientists</b>, and business teams to deliver reliable, high-quality data solutions.</p>
</li>
<li><p>Monitor ETL processes for data accuracy, troubleshoot issues, and ensure data integrity across environments.</p>
</li>
<li><p>Maintain detailed documentation of pipelines, workflows, and processes for transparency and continuity.</p></li></ul><br>
<p>
</p><h4 class="jobSectionHeader"><b>Requirements:</b></h4>
<ul>
<li><p>3&ndash;4 years of experience in <b>data engineering</b>, <b>data integration</b>, or a similar role.</p>
</li>
<li><p>Strong hands-on experience with the <b>Hadoop ecosystem</b> (HDFS, Hive, HBase, MapReduce).</p>
</li>
<li><p>Proficiency in <b>Apache Spark</b> for large-scale data processing.</p>
</li>
<li><p>Advanced <b>SQL</b> skills and experience working with <b>Vertica</b> and other <b>relational/NoSQL databases</b>.</p>
</li>
<li><p>Familiarity with <b>ETL processes</b>, data integration, and transformation best practices.</p>
</li>
<li><p>Proficiency in <b>shell scripting</b> for automating data workflows.</p>
</li>
<li><p>Experience with <b>data pipeline orchestration tools</b> (e.g., Airflow, Oozie, or similar) is a plus.</p>
</li>
<li><p>Strong <b>problem-solving and troubleshooting</b> skills with high attention to detail.</p></li></ul></div><div></div>

Senior Consultant Data Analytics

Accenture

<p><b>Project Role : </b>Data Engineer<br>
<b>Project Role Description : </b>Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
<br>
<b>Must have skills : </b>Python (Programming Language)<br>
<b>Good to have skills : </b>NA<br>
Minimum <b>3</b> year(s) of experience is required<br>
<b>Educational Qualification : </b>15 years full time education<br>
<br>
Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to effectively migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand data requirements and contribute to the overall data strategy of the organization, ensuring that data is accessible and reliable for decision-making purposes. Roles &amp; Responsibilities: - Expected to perform independently and become an SME. - Required active participation/contribution in team discussions. - Contribute in providing solutions to work related problems. - Develop and optimize data pipelines to enhance data processing efficiency. - Collaborate with data scientists and analysts to understand data needs and provide necessary support. Professional &amp; Technical Skills: - Must To Have Skills: Proficiency in Python (Programming Language). - Strong understanding of data structures and algorithms. - Experience with ETL tools and data integration techniques. - Familiarity with database management systems and SQL. - Knowledge of data quality frameworks and best practices. Additional Information: - The candidate should have minimum 3 years of experience in Python (Programming Language). - This position is based at our Gurugram office. - A 15 years full time education is required.</p>
<br>
15 years full time education

Search 10000+ Data integration engineer jobs near you this October. New roles added regularly across leading industries. Apply today.

10000 data integration engineer jobs NEAR_ME

Data Integration Engineer

Data Integration Engineer

Senior Big Data Engineer

Data Engineer

Data Engineer

Senior Consultant Data Analytics

Data Engineer