hadoop engineer

IQVIA

<div>Riyadh, Saudi Arabia | Full time | Hybrid | R1522167</div>
<br><div><h3 class="jobSectionHeader"><b>About the Role</b></h3><div>
We are seeking a highly skilled <b>Cloudera Engineer</b> to join our Big Data team. In this role, you will design, build, and manage Hadoop clusters using Cloudera technologies, ensuring optimal performance, scalability, and security. You will collaborate with cross-functional teams to deliver robust big data solutions that power critical business insights.</div><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><li>
Build and configure new clusters and projects involving Cloudera (CDH) technologies.</li><li>
Manage storage, performance tuning, and volume management for Hadoop clusters.</li><li>
Troubleshoot and resolve application and cluster issues, escalating when necessary.</li><li>
Handle cluster design, capacity planning, performance optimization, monitoring, and scaling.</li><li>
Perform standard system administration tasks, including user management, permissions, and upgrades.</li><li>
Monitor and resolve day-to-day cluster issues, ensuring SLA compliance.</li><li>
Support users with administrative needs and optimize job performance.</li><li>
Perform SQL queries and performance tuning across all levels.</li><li>
Collaborate with cross-functional teams to set up production environments and enable business solutions.</li><li>
Develop scripts to automate reporting and maintenance activities.</li><li>
Implement backup and recovery strategies using Cloudera Replication Manager.</li><li>
Address live performance and stability issues and prevent recurrence.</li><li>
Support data engineering efforts, ETL pipelines, and data science teams using Python and Scala.</li></ul><h3 class="jobSectionHeader"><b>
What We&rsquo;re Looking For</b></h3><ul><li>
Proven experience in Hadoop administration and Cloudera (CDH) technologies.</li><li>
Strong knowledge of cluster design, performance tuning, and troubleshooting.</li><li>
Proficiency in SQL and scripting for automation.</li><li>
Familiarity with backup/recovery strategies and operational best practices.</li><li>
Ability to support data engineering and data science teams.</li><li>
Strong problem-solving skills and ability to work under pressure.</li></ul><h3 class="jobSectionHeader"><b>
Why Join Us?</b></h3><ul><li>
Work on cutting-edge big data technologies in a collaborative environment.</li><li>
Opportunity to influence architecture and performance strategies.</li><li>
Be part of a team that values innovation, efficiency, and continuous improvement.</li></ul><div>
IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more at https://jobs.iqvia.com</div><div>
IQVIA is committed to integrity in our hiring process and maintains a zero tolerance policy for candidate fraud. All information and credentials submitted in your application must be truthful and complete. Any false statements, misrepresentations, or material omissions during the recruitment process will result in immediate disqualification of your application, or termination of employment if discovered later, in accordance with applicable law. We appreciate your honesty and professionalism.</div></div>

Cloudera Engineer

Exert Infotech LLC

<div>
 <p>
  📢 Hiring: Data Engineer (Entry-Level) &ndash; USA 🇺🇸
 </p>
 <p>
  <strong>
   🎓 Open to Dec 2025 &amp; May Graduates | Visa Sponsorship Available
  </strong>
 </p>
 <p>
  We are actively looking for
  <strong>
   motivated and detail-oriented Data Engineer graduates
  </strong>
  to join our growing team in the United States. If you are passionate about data, cloud technologies, and building scalable pipelines &mdash; this is a great opportunity to kickstart your career.
 </p>
 <p>
  🔹 Role: Data Engineer (Entry-Level)
 </p>
 <p>
  📍 Location: United States (Onsite / Hybrid / Remote options available)
 </p>
 <p>
  🎓 Eligibility: Graduating in
  <strong>
   Dec 2025 or May 2026
  </strong>
 </p>
 <p>
  💼 Job Type: Full-time
 </p>
 <p>
  🌍 Work Authorization:
  <strong>
   OPT / CPT / STEM OPT / GC/ US Citizen
  </strong>
 </p>
 <p>
  🔧 Key Responsibilities:
 </p>
 <ul>
  <li>
   Design, build, and maintain scalable
   <strong>
    data pipelines
   </strong>
  </li>
  <li>
   Work with large datasets using
   <strong>
    SQL, Python, or Spark
   </strong>
  </li>
  <li>
   Support
   <strong>
    ETL/ELT processes
   </strong>
   and data integration
  </li>
  <li>
   Collaborate with data analysts and business teams
  </li>
  <li>
   Ensure
   <strong>
    data quality, governance, and performance optimization
   </strong>
  </li>
 </ul>
 <p>
  🛠️ Required Skills:
 </p>
 <ul>
  <li>
   Strong knowledge of
   <strong>
    SQL &amp; Python
   </strong>
  </li>
  <li>
   Understanding of
   <strong>
    Data Structures &amp; Algorithms
   </strong>
  </li>
  <li>
   Familiarity with
   <strong>
    cloud platforms
   </strong>
   (AWS / Azure / GCP)
  </li>
  <li>
   Exposure to tools like
   <strong>
    Apache Spark, Hadoop, Snowflake
   </strong>
  </li>
  <li>
   Basic understanding of
   <strong>
    data warehousing concepts
   </strong>
  </li>
 </ul>
 <p>
  ⭐ Preferred Qualifications:
 </p>
 <ul>
  <li>
   Internship/project experience in data engineering or analytics
  </li>
  <li>
   Knowledge of
   <strong>
    Airflow, Kafka, or DBT
   </strong>
  </li>
  <li>
   Experience with
   <strong>
    real-time data processing
   </strong>
  </li>
 </ul>
 <p>
 </p>
</div>


Jr Data Engineer

PROZ TECHNOLOGIES

<p>Hello,<br/>Greetings from Proztec Qatar! I hope everything is going well with you.</p><p><b>JOB DESCRIPTION</b></p><p>The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and architectures to support data processing and analytics. The role focuses on handling large datasets, ensuring data quality, and enabling seamless integration across systems. The engineer will work closely with data analysts, data scientists, and business teams to deliver reliable and efficient data solutions.</p><p><b>DUTIES &amp; RESPONSIBILITIES</b></p><ul><li>Design, build, and maintain scalable ETL/ELT data pipelines</li><li>Process and manage large volumes of structured and unstructured data</li><li>Develop and optimize SQL queries for data extraction and transformation</li><li>Ensure data quality, integrity, and consistency across systems</li><li>Integrate data from multiple sources including APIs, databases, and cloud platforms</li><li>Monitor and troubleshoot data pipeline performance issues</li><li>Collaborate with data analysts and data scientists to support analytics and reporting needs</li><li>Implement data governance and security best practices</li><li>Maintain documentation for data flows, models, and pipelines</li><li>Optimize data storage and processing for performance and cost efficiency</li></ul><p><b>SKILLS &amp; ABILITIES</b></p><ul><li>Strong experience in SQL and database management</li><li>Hands-on experience with ETL/ELT processes and tools</li><li>Proficiency in Python for data processing and automation</li><li>Knowledge of Big Data technologies (e.g., Hadoop, Spark)</li><li>Experience with cloud data platforms (AWS, Azure, or GCP)</li><li>Strong problem-solving and analytical skills</li></ul><p><b>POTENTIAL BACKGROUND</b></p><ul><li>Minimum <b>4+ years of experience</b> in Data Engineering</li><li>Experience handling large-scale data processing and pipelines</li><li>Exposure to enterprise data architecture and analytics environments</li><li>Experience working with cloud-based data solutions is a plus</li></ul><p><b>CERTIFICATIONS (MANDATORY/PREFERRED)</b></p><ul><li>Google Professional Data Engineer &ndash; Preferred</li><li>Azure Data Engineer Associate &ndash; Preferred</li><li>AWS Data Analytics Certification &ndash; Preferred</li></ul><p><b>LANGUAGE REQUIREMENT</b></p><ul><li>Arabic or Non-Arabic Speaker</li></ul><p><b>WORK LOCATION</b></p><ul><li>Onshore &amp; Offshore</li></ul><p><b>SOFT SKILLS</b></p><ul><li>Strong analytical and problem-solving abilities</li><li>Good communication and collaboration skills</li><li>Attention to detail and data accuracy</li><li>Ability to manage multiple tasks and deadlines</li><li>Proactive and solution-oriented mindset</li></ul><p>If you&rsquo;re interested or have relevant experience, feel free to share your updated CV.</p><p>Job Type: Full-time</p><p>Pay: QAR15,000.00 - QAR18,000.00 per month</p><p>Work Location: In person</p>

Data Engineer

MASTER-WORKS

<div><p>Master-Works is seeking a highly skilled Data Engineer to join our team. The ideal candidate will develop, construct, test, and maintain data architectures such as databases and large-scale processing systems. You will be responsible for building data pipelines, ensuring data integrity, and enabling data accessibility to support our business analytics and decision-making processes.</p><p><b>
Responsibilities:</b></p><ul><li>
Design, build, and maintain efficient and scalable data pipelines and architectures.</li><li>
Develop ETL processes to collect, clean, and process data from various sources.</li><li>
Collaborate with data scientists, analysts, and stakeholders to meet data requirements.</li><li>
Optimize data pipeline performance and troubleshoot data issues as they arise.</li><li>
Ensure data security and compliance with organizational policies.</li><li>
Document data engineering processes and workflows.</li></ul><br>
<b>
Requirements</b><br>
<ul><li>
Bachelor's degree in Computer Science, Engineering, or related field.</li><li>
Minimum 3 years of experience in data engineering or related roles.</li><li>
Proficiency in programming languages such as Python, Java, or Scala.</li><li>
Experience with SQL and NoSQL databases.</li><li>
Familiarity with big data tools and platforms like Hadoop, Spark, Kafka, etc.</li><li>
Strong analytical and problem-solving skills.</li><li>
Ability to work collaboratively in a team-oriented environment.</li></ul></div>

Arpatech

<p><b>Role &amp; Responsibilities:</b></p><ul><li>Design and implement scalable ETL/ELT pipelines for data ingestion, transformation, and storage.</li><li>Optimize data workflows to improve performance and maintain high scalability.</li><li>Integrate data from multiple sources into centralized data platforms.</li><li>Architect and maintain databases, data lakes, and data warehouses for both structured and unstructured datasets.</li><li>Monitor and validate data to ensure accuracy, consistency, and completeness.</li><li>Implement data security, governance, and compliance controls aligned with industry standards.</li><li>Collaborate with data analysts, AI engineers, and cross-functional teams to gather and define data requirements.</li><li>Provide technical support for analytics, BI, and reporting platforms.</li><li>Evaluate new tools and technologies to enhance data architecture and performance.</li><li>Maintain detailed documentation and update technical guides regularly.</li></ul><p><b>Requirements:</b></p><ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Science, or a related discipline.</li><li>3&ndash;4 years of hands-on experience in building and managing data pipelines and data architectures.</li><li>Demonstrated experience designing and managing data pipelines and data architectures.</li><li>Strong knowledge of SQL and NoSQL databases, data modeling concepts, and schema design.</li><li>Hands-on expertise with data processing frameworks such as Apache Spark or Hadoop.</li><li>Experience working with major cloud platforms (AWS, Azure, or Google Cloud).</li><li>Proficiency in programming languages such as Python, Scala, or Java.</li></ul><p><b>Preferred Skills:</b></p><ul><li>Experience with data visualization tools (e.g., Power BI, Tableau).</li><li>Knowledge of streaming and real-time data technologies (e.g., Kafka, Flink).</li><li>Professional certifications in cloud data services (e.g., AWS Certified Data Analytics, Azure Data Engineer).</li></ul><p><b>Shift timings: 9 AM - 6 PM Karachi &amp; Islamabad (Onsite) &amp; Remote for other cities.</b></p><p>Work Location: Remote</p>

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p>TCS Walk-in Drive at Hyderabad- Synergy Park</p>
<p>
Date- 11-Apr-26</p>
<p>
JD</p>
<p>
</p><div><div><div><div><div>Skills and Experience Required</div><br>
</div><div><ul><li> 3+ years of hands-on experience working with Databricks, Apache Spark, or related big data platforms</li></ul>
<ul><li> Proficiency in programming languages such as Python, Scala, or SQL for data transformation and pipeline development</li></ul>
<ul><li> Hands-on experience with Spark SQL, Delta Lake, Lakeflow Spark Declarative Pipelines and Unity Catalog</li></ul>
<ul><li> Strong understanding of ETL/ELT workflows, data modeling, and data warehousing concepts</li></ul>
<ul><li> Experience with cloud platforms (Azure, AWS, or GCP)</li></ul>
<ul><li> Familiarity with CI/CD practices and version control tools such as Git</li></ul>
<ul><li> Knowledge of data governance, data quality, and security best practices</li></ul>
<ul><li> Excellent problem-solving, analytical, and communication skills.</li></ul>
<ul><li> Ability to work collaboratively in an agile team environment</li></ul>
<ul><li> Databricks certifications are preferred</li></ul><br>
</div></div><br>
<div><div><div>Responsibilities</div><br>
</div><div><ul><li> Implement data ingestion, transformation, and integration processes from various structured and unstructured data sources</li></ul>
<ul><li> Develop, maintain, and optimize scalable data pipelines and workflows on the Databricks platform</li></ul>
<ul><li> Collaborate with analysts and business stakeholders to understand data requirements and deliver solutions</li></ul>
<ul><li> Ensure data reliability, quality, and security across all data engineering processes</li></ul>
<ul><li> Troubleshoot, debug, and resolve data pipeline issues and performance bottlenecks</li></ul>
<ul><li> Document data engineering workflows and technical designs</li></ul>
<ul><li> Monitor and maintain data pipeline health, proactively addressing any potential issues</li></ul>
<ul><li> Stay up-to-date with emerging data engineering technologies and best practices, especially within the Databricks ecosystem</li></ul><br>
</div></div><br>
</div></div><br>
</div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>405018</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | Scala | SQL | Apache Spark</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Databricks Engineer

Ai Vantage

<p><b>Key Responsibilities</b></p><ul><li>Design, develop, and maintain <b>robust ETL/ELT data pipelines</b> using Python and AWS services</li><li>Build and optimize <b>data lakes, data warehouses, and data marts</b> on AWS</li><li>Ingest, transform, and process structured and unstructured data from multiple sources</li><li>Ensure <b>data quality, integrity, security, and compliance</b> with federal standards</li><li>Collaborate with data scientists, analysts, and application teams to support analytics and reporting</li><li>Optimize performance, cost, and scalability of data workflows in AWS</li><li>Implement <b>data governance, metadata management, and logging/monitoring</b> practices</li><li>Support documentation, data models, and technical design artifacts</li><li>Troubleshoot production issues and support ongoing enhancements</li></ul><p><b>Required Qualifications</b></p><ul><li><b>5+ years of hands-on experience</b> as a Data Engineer or similar role</li><li>Strong proficiency in <b>Python</b> for data processing and automation</li><li>Extensive experience with <b>AWS</b>, including services such as:</li><li>S3, EC2, Lambda</li><li>Glue, Athena, Redshift</li><li>EMR, CloudWatch (preferred)</li><li>Solid understanding of <b>SQL</b> and relational/non-relational databases</li><li>Experience building <b>batch and/or streaming data pipelines</b></li><li>Familiarity with <b>CI/CD pipelines</b>, version control (Git), and DevOps practices</li><li>Experience working in <b>federal or regulated environments</b></li></ul><p><b>Preferred Qualifications</b></p><ul><li><b>US Census Clearance</b> (active or previously held)</li><li>Experience with <b>big data technologies</b> (Spark, PySpark, Hadoop)</li><li>Knowledge of <b>data security, encryption, and access controls</b> in AWS</li><li>Exposure to data orchestration tools (Airflow, Step Functions, etc.)</li><li>Experience supporting <b>analytics, BI, or AI/ML workloads</b></li></ul><p><b>Nice to Have</b></p><ul><li>AWS Certification (Data Analytics, Solutions Architect, or Developer)</li><li>Experience with <b>Terraform or CloudFormation</b></li><li>Familiarity with federal data standards and compliance frameworks</li></ul><p>Job Types: Full-time, Contract</p><p>Pay: $95,000.00 - $110,000.00 per year</p><p>Benefits:</p><ul><li>401(k)</li><li>Dental insurance</li><li>Health insurance</li><li>Paid time off</li><li>Relocation assistance</li></ul><p>Education:</p><ul><li>Bachelor's (Required)</li></ul><p>Experience:</p><ul><li>Python: 3 years (Required)</li><li>R: 3 years (Required)</li><li>SQL: 3 years (Required)</li><li>ETL: 3 years (Required)</li><li>AWS: 3 years (Required)</li><li>Redshift: 3 years (Required)</li></ul><p>Work Location: Hybrid remote in Vienna, VA 22182</p>

Data Engineer- Local

Search 3490+ Hadoop engineer jobs near you this May. New roles added regularly across leading industries. Apply today.

3490 hadoop engineer jobs Near Me

Cloudera Engineer

Jr Data Engineer

Data Engineer

Data Engineer

Data Engineer

Databricks Engineer

Data Engineer- Local