hadoop software engineer

IQVIA

<div>Riyadh, Saudi Arabia | Full time | Hybrid | R1522167</div>
<br><div><h3 class="jobSectionHeader"><b>About the Role</b></h3><div>
We are seeking a highly skilled <b>Cloudera Engineer</b> to join our Big Data team. In this role, you will design, build, and manage Hadoop clusters using Cloudera technologies, ensuring optimal performance, scalability, and security. You will collaborate with cross-functional teams to deliver robust big data solutions that power critical business insights.</div><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><li>
Build and configure new clusters and projects involving Cloudera (CDH) technologies.</li><li>
Manage storage, performance tuning, and volume management for Hadoop clusters.</li><li>
Troubleshoot and resolve application and cluster issues, escalating when necessary.</li><li>
Handle cluster design, capacity planning, performance optimization, monitoring, and scaling.</li><li>
Perform standard system administration tasks, including user management, permissions, and upgrades.</li><li>
Monitor and resolve day-to-day cluster issues, ensuring SLA compliance.</li><li>
Support users with administrative needs and optimize job performance.</li><li>
Perform SQL queries and performance tuning across all levels.</li><li>
Collaborate with cross-functional teams to set up production environments and enable business solutions.</li><li>
Develop scripts to automate reporting and maintenance activities.</li><li>
Implement backup and recovery strategies using Cloudera Replication Manager.</li><li>
Address live performance and stability issues and prevent recurrence.</li><li>
Support data engineering efforts, ETL pipelines, and data science teams using Python and Scala.</li></ul><h3 class="jobSectionHeader"><b>
What We&rsquo;re Looking For</b></h3><ul><li>
Proven experience in Hadoop administration and Cloudera (CDH) technologies.</li><li>
Strong knowledge of cluster design, performance tuning, and troubleshooting.</li><li>
Proficiency in SQL and scripting for automation.</li><li>
Familiarity with backup/recovery strategies and operational best practices.</li><li>
Ability to support data engineering and data science teams.</li><li>
Strong problem-solving skills and ability to work under pressure.</li></ul><h3 class="jobSectionHeader"><b>
Why Join Us?</b></h3><ul><li>
Work on cutting-edge big data technologies in a collaborative environment.</li><li>
Opportunity to influence architecture and performance strategies.</li><li>
Be part of a team that values innovation, efficiency, and continuous improvement.</li></ul><div>
IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more at https://jobs.iqvia.com</div><div>
IQVIA is committed to integrity in our hiring process and maintains a zero tolerance policy for candidate fraud. All information and credentials submitted in your application must be truthful and complete. Any false statements, misrepresentations, or material omissions during the recruitment process will result in immediate disqualification of your application, or termination of employment if discovered later, in accordance with applicable law. We appreciate your honesty and professionalism.</div></div>

Cloudera Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p>TCS Walk-in Drive at Hyderabad- Synergy Park</p>
<p>
Date- 11-Apr-26</p>
<p>
JD</p>
<p>
</p><div><div><div><div><div>Skills and Experience Required</div><br>
</div><div><ul><li> 3+ years of hands-on experience working with Databricks, Apache Spark, or related big data platforms</li></ul>
<ul><li> Proficiency in programming languages such as Python, Scala, or SQL for data transformation and pipeline development</li></ul>
<ul><li> Hands-on experience with Spark SQL, Delta Lake, Lakeflow Spark Declarative Pipelines and Unity Catalog</li></ul>
<ul><li> Strong understanding of ETL/ELT workflows, data modeling, and data warehousing concepts</li></ul>
<ul><li> Experience with cloud platforms (Azure, AWS, or GCP)</li></ul>
<ul><li> Familiarity with CI/CD practices and version control tools such as Git</li></ul>
<ul><li> Knowledge of data governance, data quality, and security best practices</li></ul>
<ul><li> Excellent problem-solving, analytical, and communication skills.</li></ul>
<ul><li> Ability to work collaboratively in an agile team environment</li></ul>
<ul><li> Databricks certifications are preferred</li></ul><br>
</div></div><br>
<div><div><div>Responsibilities</div><br>
</div><div><ul><li> Implement data ingestion, transformation, and integration processes from various structured and unstructured data sources</li></ul>
<ul><li> Develop, maintain, and optimize scalable data pipelines and workflows on the Databricks platform</li></ul>
<ul><li> Collaborate with analysts and business stakeholders to understand data requirements and deliver solutions</li></ul>
<ul><li> Ensure data reliability, quality, and security across all data engineering processes</li></ul>
<ul><li> Troubleshoot, debug, and resolve data pipeline issues and performance bottlenecks</li></ul>
<ul><li> Document data engineering workflows and technical designs</li></ul>
<ul><li> Monitor and maintain data pipeline health, proactively addressing any potential issues</li></ul>
<ul><li> Stay up-to-date with emerging data engineering technologies and best practices, especially within the Databricks ecosystem</li></ul><br>
</div></div><br>
</div></div><br>
</div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>405018</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | Scala | SQL | Apache Spark</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Databricks Engineer

Exert Infotech LLC

<div>
 <p>
  📢 Hiring: Data Engineer (Entry-Level) &ndash; USA 🇺🇸
 </p>
 <p>
  <strong>
   🎓 Open to Dec 2025 &amp; May Graduates | Visa Sponsorship Available
  </strong>
 </p>
 <p>
  We are actively looking for
  <strong>
   motivated and detail-oriented Data Engineer graduates
  </strong>
  to join our growing team in the United States. If you are passionate about data, cloud technologies, and building scalable pipelines &mdash; this is a great opportunity to kickstart your career.
 </p>
 <p>
  🔹 Role: Data Engineer (Entry-Level)
 </p>
 <p>
  📍 Location: United States (Onsite / Hybrid / Remote options available)
 </p>
 <p>
  🎓 Eligibility: Graduating in
  <strong>
   Dec 2025 or May 2026
  </strong>
 </p>
 <p>
  💼 Job Type: Full-time
 </p>
 <p>
  🌍 Work Authorization:
  <strong>
   OPT / CPT / STEM OPT / GC/ US Citizen
  </strong>
 </p>
 <p>
  🔧 Key Responsibilities:
 </p>
 <ul>
  <li>
   Design, build, and maintain scalable
   <strong>
    data pipelines
   </strong>
  </li>
  <li>
   Work with large datasets using
   <strong>
    SQL, Python, or Spark
   </strong>
  </li>
  <li>
   Support
   <strong>
    ETL/ELT processes
   </strong>
   and data integration
  </li>
  <li>
   Collaborate with data analysts and business teams
  </li>
  <li>
   Ensure
   <strong>
    data quality, governance, and performance optimization
   </strong>
  </li>
 </ul>
 <p>
  🛠️ Required Skills:
 </p>
 <ul>
  <li>
   Strong knowledge of
   <strong>
    SQL &amp; Python
   </strong>
  </li>
  <li>
   Understanding of
   <strong>
    Data Structures &amp; Algorithms
   </strong>
  </li>
  <li>
   Familiarity with
   <strong>
    cloud platforms
   </strong>
   (AWS / Azure / GCP)
  </li>
  <li>
   Exposure to tools like
   <strong>
    Apache Spark, Hadoop, Snowflake
   </strong>
  </li>
  <li>
   Basic understanding of
   <strong>
    data warehousing concepts
   </strong>
  </li>
 </ul>
 <p>
  ⭐ Preferred Qualifications:
 </p>
 <ul>
  <li>
   Internship/project experience in data engineering or analytics
  </li>
  <li>
   Knowledge of
   <strong>
    Airflow, Kafka, or DBT
   </strong>
  </li>
  <li>
   Experience with
   <strong>
    real-time data processing
   </strong>
  </li>
 </ul>
 <p>
 </p>
</div>


Jr Data Engineer

ReliaQuest

<div><p><b>Why it&rsquo;s worth it:</b></p><p></p><p>
Are you a passionate Software Engineer who has a proven track record of solving complex problems and being at the forefront of innovation? Pursuing a career at ReliaQuest will allow you to write code and manipulate data in ways that have never been done before, driving automation of threat detection and response for one of the world&rsquo;s fastest growing industries. You will lead the creation, testing, and deployment of cutting-edge security technology to enterprise customers across the globe. Above all else, this role will allow you to work and learn from some of the most talented people in the business as well as have a direct contribution to the growth and success of RQ.</p><p></p><p><b>
The everyday hustle:</b></p><ul><li>
Research and develop creative solutions across a wide range of cutting-edge technologies to continuously evolve our platform, GreyMatter.</li><li>
Create REST API&rsquo;s and integrations between various products to improve and automate our customer&rsquo;s threat detection.</li><li>
Manage the continuous integration and deployment processes of complex technologies.</li><li>
Perform code reviews to ensure consistent improvement.</li><li>
Proactively automate and improve all stages of the software development lifecycle.</li><li>
Interface closely with various parts of the business, both internally and externally, to ensure all users are leveraging the product with ease and to its full potential.</li><li>
Provide support to other team members as well as cultivate a culture of constant collaboration.</li></ul><p></p><p><b>
Do you have what it takes?</b></p><ul><li>
0-1 Years of Software Development experience in the following languages and/or technologies: Python, JS, React, Angular, Java, C#, MySQL, Elastic Search or equivalent.</li></ul><p></p><p><b>
What makes you uncommon?</b></p><ul><li>
Hands on experience with one or more of the following technologies (Elasticsearch, Kafka, Apache Spark, Logstash, Hadoop/hive, Tensorflow, Kibana, Athena/Presto/BigTable, Angular, React).</li><li>
Experience with cloud platforms such as AWS, GCP, or Azure.</li><li>
Solid understanding of unit testing, continuous integration and deployment practices.</li><li>
Experience with Agile Methodology.</li><li>
Higher education/relevant certifications.</li></ul></div>

Associate Software Engineer

PROZ TECHNOLOGIES

<p>Hello,<br/>Greetings from Proztec Qatar! I hope everything is going well with you.</p><p><b>JOB DESCRIPTION</b></p><p>The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and architectures to support data processing and analytics. The role focuses on handling large datasets, ensuring data quality, and enabling seamless integration across systems. The engineer will work closely with data analysts, data scientists, and business teams to deliver reliable and efficient data solutions.</p><p><b>DUTIES &amp; RESPONSIBILITIES</b></p><ul><li>Design, build, and maintain scalable ETL/ELT data pipelines</li><li>Process and manage large volumes of structured and unstructured data</li><li>Develop and optimize SQL queries for data extraction and transformation</li><li>Ensure data quality, integrity, and consistency across systems</li><li>Integrate data from multiple sources including APIs, databases, and cloud platforms</li><li>Monitor and troubleshoot data pipeline performance issues</li><li>Collaborate with data analysts and data scientists to support analytics and reporting needs</li><li>Implement data governance and security best practices</li><li>Maintain documentation for data flows, models, and pipelines</li><li>Optimize data storage and processing for performance and cost efficiency</li></ul><p><b>SKILLS &amp; ABILITIES</b></p><ul><li>Strong experience in SQL and database management</li><li>Hands-on experience with ETL/ELT processes and tools</li><li>Proficiency in Python for data processing and automation</li><li>Knowledge of Big Data technologies (e.g., Hadoop, Spark)</li><li>Experience with cloud data platforms (AWS, Azure, or GCP)</li><li>Strong problem-solving and analytical skills</li></ul><p><b>POTENTIAL BACKGROUND</b></p><ul><li>Minimum <b>4+ years of experience</b> in Data Engineering</li><li>Experience handling large-scale data processing and pipelines</li><li>Exposure to enterprise data architecture and analytics environments</li><li>Experience working with cloud-based data solutions is a plus</li></ul><p><b>CERTIFICATIONS (MANDATORY/PREFERRED)</b></p><ul><li>Google Professional Data Engineer &ndash; Preferred</li><li>Azure Data Engineer Associate &ndash; Preferred</li><li>AWS Data Analytics Certification &ndash; Preferred</li></ul><p><b>LANGUAGE REQUIREMENT</b></p><ul><li>Arabic or Non-Arabic Speaker</li></ul><p><b>WORK LOCATION</b></p><ul><li>Onshore &amp; Offshore</li></ul><p><b>SOFT SKILLS</b></p><ul><li>Strong analytical and problem-solving abilities</li><li>Good communication and collaboration skills</li><li>Attention to detail and data accuracy</li><li>Ability to manage multiple tasks and deadlines</li><li>Proactive and solution-oriented mindset</li></ul><p>If you&rsquo;re interested or have relevant experience, feel free to share your updated CV.</p><p>Job Type: Full-time</p><p>Pay: QAR15,000.00 - QAR18,000.00 per month</p><p>Work Location: In person</p>

Data Engineer

MASTER-WORKS

<div><p>Master-Works is seeking a highly skilled Data Engineer to join our team. The ideal candidate will develop, construct, test, and maintain data architectures such as databases and large-scale processing systems. You will be responsible for building data pipelines, ensuring data integrity, and enabling data accessibility to support our business analytics and decision-making processes.</p><p><b>
Responsibilities:</b></p><ul><li>
Design, build, and maintain efficient and scalable data pipelines and architectures.</li><li>
Develop ETL processes to collect, clean, and process data from various sources.</li><li>
Collaborate with data scientists, analysts, and stakeholders to meet data requirements.</li><li>
Optimize data pipeline performance and troubleshoot data issues as they arise.</li><li>
Ensure data security and compliance with organizational policies.</li><li>
Document data engineering processes and workflows.</li></ul><br>
<b>
Requirements</b><br>
<ul><li>
Bachelor's degree in Computer Science, Engineering, or related field.</li><li>
Minimum 3 years of experience in data engineering or related roles.</li><li>
Proficiency in programming languages such as Python, Java, or Scala.</li><li>
Experience with SQL and NoSQL databases.</li><li>
Familiarity with big data tools and platforms like Hadoop, Spark, Kafka, etc.</li><li>
Strong analytical and problem-solving skills.</li><li>
Ability to work collaboratively in a team-oriented environment.</li></ul></div>

Zoolatech

<div><div><div><div><div><div><div><div><b>OVERVIEW</b></div>
</div><div><div>RESPONSIBILITIES</div>
</div><div><div>REQUIREMENTS</div>
</div></div></div></div><div><div><div><p>Our client is a global jewelry manufacturer that is transforming its data and analytics footprint and is also on a journey from IaaS-based Microsoft/QV solutions to Azure PaaS.</p><p>
As a Data Engineer, you will collaborate with product owners, architects, and other key profiles across the global organisation. You will help business verticals and clusters maximize the value of the data and drive business change as a result.</p><p>
Your primary focus will be building and implementing scalable data products on the global data platform together with other smart engineers in the organization.</p>
</div><div><ul><li><p>Work closely with your colleagues within a product team to design scalable, efficient, and stable products</p></li><li><p>
﻿﻿Work closely with product owners to build and deliver features designed to drive commercial business cases and efficiencies within reporting and analytics, and other data-driven use cases</p></li><li><p>
﻿﻿Create and maintain a high-quality data pipeline architecture</p></li><li><p>
﻿﻿Obtain relevant business and system knowledge to convert requirements efficiently to technical design documentation and conceptual data modelling</p></li><li><p>
﻿﻿Ingest large, complex data sets, automate manual processes, optimize data delivery, improve data quality, etc.</p></li><li><p>
﻿﻿Own your data products and track continuous stability and benefits</p></li><li><p>
Live and breathe &quot;build -once-consume-many&quot; culture in which we enable others to use our data products for maximum value-add</p></li><li><p>
﻿﻿Work with stakeholders and teams to assist with data-related technical challenges</p></li><li><p>
﻿﻿Follow best practice and existing guidelines, but also push the limits</p></li><li><p>
﻿﻿Thrive in a fast-paced environment, and you get motivated by challenges as a true problem solver.</p></li></ul>
</div><div><ul><li><p>Relevant education within Computer Science, Mathematics, Economics, Information Management, or Statistics</p></li><li><p>
﻿﻿3+ years of experience as a Data Engineer or in a Software engineering role with a focus on data</p></li><li><p>
﻿﻿Proven experience with ADF, Data Lake, Synapse, T/U-SQL, Databricks, MDS, DAX, SSIS, and SQL Server</p></li><li><p>
﻿﻿Experience with at least one object-oriented or functional/scripting language - Java, Scala, Python, etc.</p></li><li><p>
DevOps and CI/CD focus</p></li><li><p>
Hands-on with git and coding best practices</p></li><li><p>
Unit testing</p></li><li><p>
Experience in working with relational data sets using SQL</p></li><li><p>
Experience with data warehousing, dimensional modelling, and cubes</p></li><li><p>
﻿﻿Experience in building and optimizing data pipelines, architectures, and datasets</p></li><li><p>
﻿﻿Experience in working with Azure, AWS, or other cloud providers</p></li><li><p>
Designed, built, and delivered production-ready data products at an enterprise level</p></li><li><p>
Highly proficient in English and able to communicate with all levels</p></li><li><p>
﻿﻿Agile mindset and experience of Scrum</p></li></ul><p><b>
It's a plus if you have worked with:</b></p><ul><li><p>
﻿﻿Big data: Spark, Hadoop</p></li><li><p>
﻿﻿Data pipeline and workflow tools: Airflow</p></li><li><p>
﻿﻿Infrastructure: Kubernetes and Helm; we're using Airflow running on Kubernetes</p></li><li><p>
﻿﻿Stream-processing systems: Kafka or Spark Streaming</p></li></ul>
</div></div></div><div><div><div><div><p>Location:
</p><div>Istanbul, Turkey
</div></div><div><p>Seniority:
</p><div>Middle
</div></div><div><p>Technologies:
</p><div>Data
</div></div></div></div><div><div><p>Benefits:
</p><ul><li><b>Paid Vacation
</b></li><li><b>Hybrid Work (home/office)
</b></li><li><b>Sick Days
</b></li><li><b>Sport/Insurance Compensation
</b></li><li><b>Holidays Day Off
</b></li><li><b>English Classes
</b></li><li><b>Training Compensation
</b></li><li><b>Transportation compensation</b></li></ul></div></div></div></div></div></div>

Search 10000+ Hadoop software engineer jobs near you this May. New roles added regularly across leading industries. Apply today.

10000 hadoop software engineer jobs Near Me

Cloudera Engineer

Databricks Engineer

Jr Data Engineer

Associate Software Engineer

Data Engineer

Data Engineer

Data Engineer