big data engineer

Randstad Türkiye

<div>
 <p>
  We are looking for a
  <strong>
   "Senior - Mid Big Data Engineer
  </strong>
  " on behalf of our global business partner runs in
  <em>
   Telecommunications
  </em>
  Industry.
 </p>
 <p>
  <br/>
 </p>
 <p>
  About Role
 </p>
 <p>
  <br/>
 </p>
 <p>
  We are looking for a
  <strong>
   Senior&ndash;Mid Big Data Engineer
  </strong>
  to join our delivery-focused Big Data team. This role is fully aligned with production data migration and Big Data service deployment activities.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Key Responsibilities
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Execute data migration projects, ensuring data accuracy, performance, and operational stability.
  </li>
  <li>
   Deploy, configure, and operate Big Data services and platforms in live production environments.
  </li>
  <li>
   Install, configure, and maintain Big Data clusters, including Hadoop ecosystem components (HDFS, Hive, Spark, Flink, MapReduce).
  </li>
  <li>
   Perform DWS (Data Warehouse Service) deployments, including setup, configuration, tuning, and post-deployment support.
  </li>
  <li>
   Design, implement, and maintain ETL/ELT pipelines for production Data Warehouses and Data Lakes.
  </li>
  <li>
   Optimize and troubleshoot batch processing workloads using Hive, Spark, and related technologies.
  </li>
  <li>
   Implement and support data ingestion pipelines, including real-time components where applicable.
  </li>
  <li>
   Provide on-site and remote delivery support to international customers during deployment and migration phases.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Requirements
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <em>
    Required Qualifications
   </em>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   BSc or MSc degree in Computer Engineering, Computer Science, Software Engineering, or a related technical discipline.
  </li>
  <li>
   4&ndash;8 years of professional experience in Big Data Engineering, with a strong focus on delivery, data migration, and production operations.
  </li>
  <li>
   Strong experience with Spark, Flink, Hadoop, and related Big Data technologies.
  </li>
  <li>
   Proficiency in Python or Java.
  </li>
  <li>
   Solid experience with SQL development (MySQL, PostgreSQL).
  </li>
  <li>
   Hands-on experience with batch processing using Hive and Spark.
  </li>
  <li>
   Strong understanding of Data Warehouse and Data Lake architectures.
  </li>
  <li>
   Experience working in Unix/Linux environments.
  </li>
  <li>
   Ability to work in production environments with high availability and performance requirements.
  </li>
  <li>
   Strong communication skills in international delivery teams.
  </li>
  <li>
   Fluency in written and spoken English is mandatory.
  </li>
  <li>
   Willingness and flexibility to travel internationally.
  </li>
  <li>
   Strong sense of ownership for end-to-end delivery and production stability.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <em>
    Nice to Have
   </em>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Experience with real-time ingestion systems such as Kafka or RabbitMQ.
  </li>
  <li>
   Experience with monitoring, alerting, and performance tuning of Big Data platforms.
  </li>
  <li>
   Exposure to cloud-native Big Data services.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <em>
    Seniority Expectations
   </em>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Solid understanding of ETL/ELT methodologies and production best practices.
  </li>
  <li>
   Proven ability to design, deploy, and operate complex data pipelines in live environments.
  </li>
  <li>
   Ability to independently own delivery activities, guide implementation decisions, and mentor junior engineers.
  </li>
 </ul>
</div>


Big Data Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><div><b>Role:</b> <b>Databricks Engineer</b></div>
<div></div>
<div><b>Must-Have:</b></div>
<div><b>
1. Azure Data Bricks (Python)</b></div>
<div><b>
2. Pyspark</b></div>
<div><b>
3. ADLS</b></div>
<div></div>
<div><b>Responsibility:</b></div>
<ul>
<li>Designing and building Databricks data pipelines is required.</li>
<li>Experience in transforming the data using Azure Databricks &amp; Delta lake.</li>
<li>Hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes.</li>
<li>SQL experience, specifically to write complex, highly optimized queries across large volumes of data.</li>
<li>Experience in Azure DevOps CI/CD &ndash; Stories, Bugs, and Issue management.</li>
<li>Implement Integration solution in Microsoft Azure.</li>
<li>Performs data analysis required to troubleshoot data related issues and assist in the resolut</li></ul>
</div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>IT INFRASTRUCTURE SERVICES</div>
</div><div><div><b>Role</b></div>
<div>Engineer</div>
</div><div><div><b>Job Id</b></div>
<div>385636</div>
</div><div><div><b>Desired Skills</b></div>
<div>Azure | MySql
</div></div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Data Engineer

Mindstream

<p>We are seeking a highly skilled <b>Azure Data Engineer</b> with extensive experience in building, optimizing, and managing scalable data solutions on Microsoft Azure. The ideal candidate will have hands-on expertise in <b>Azure Databricks, Data Factory, Data Lake Storage</b>, and <b>Event Hub</b>, along with strong programming and data engineering skills.</p><p>Required Skills and Qualifications:</p><ul><li>8+ years of experience as an Azure Data Engineer or similar role.</li><li>Strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Event Hub.</li><li>Proficiency in programming languages such as PySpark, Scala, or SQL.</li><li>Experience with data modeling, data warehousing, and big data technologies.</li><li>Knowledge of Delta Lake and other data storage formats.</li><li>Familiarity with data integration tools and techniques.</li><li>Excellent problem-solving skills and attention to detail.</li><li>Knowledge of data governance and data quality best practices.</li><li>Strong communication and collaboration skills.</li><li>Certification in Microsoft Azure Data Engineering or irelated areas is a plus</li><li>Bachelor&rsquo;s degree in Computer Science, Information Technology, or a related field.</li></ul><p>Job Type: Full-time</p><p>Application Question(s):</p><ul><li>Do you have a minimum of 8 years of total experience as a Data Engineer or in a similar role?</li><li>How many years of hands-on experience do you have with Azure Databricks?</li><li>How many years of experience do you have working with Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS)?</li><li>Do you have experience with data modeling, data warehousing, and big data technologies?</li><li>What is your current and expected salary? Notice period?</li></ul>

Azure Data Engineer -

Citylogix

<div><p><b>About Citylogix</b></p><p>
Citylogix is a leading provider of data and analytics for smart city transportation infrastructure, leveraging LiDAR, 360&deg; imaging, and AI-powered analytics to create detailed digital maps, and provide predictive analytics for proactive asset management.</p><p><b><br>
About the role</b></p><p>
The DataOps Engineer position is central to developing sophisticated data processing pipelines that handle diverse data formats and volumes. This role involves designing and implementing scalable ETL/ELT workflows using modern big data frameworks and orchestration tools. The engineer will create reusable components and optimize processing efficiency to meet demanding performance requirements. The position requires deep technical expertise in distributed systems and data processing patterns. The successful candidate will work at the intersection of data engineering and operations, ensuring pipelines are both functionally robust and operationally excellent.</p><p></p><p><b><br>
What you'll do</b></p><ul><li>
Implement orchestration with Airflow/Prefect</li><li>
Build reusable components and shared libraries</li><li>
Optimize processing performance and costs</li><li>
Manage schema evolution and data versioning</li><li>
Integrate diverse data sources and formats</li><li>
Create monitoring dashboards and metrics</li></ul><p><b>
Qualifications</b></p><ul><li>
3+ years building production data pipelines</li><li>
Expertise in big data frameworks (Spark, Hadoop)</li><li>
Experience with workflow orchestration tools</li><li>
Strong Python/Scala/Java programming skills</li><li>
Understanding of distributed systems</li></ul></div>

DataOps Engineer

APPTESTIFY GLOBAL SERVICES PVT LTD

<p><b>Role: Databricks Engineer</b></p><p><b>Location:</b> Remote<br/><b>Experience:</b> 5+ Years</p><p><b>About the Role:</b></p><p>We are looking for an experienced <b>Databricks Engineer</b> with strong expertise in big data processing and analytics. The ideal candidate will work closely with data engineers, data scientists, and business stakeholders to design, develop, and optimize scalable data solutions using Databricks.</p><p><b>Key Responsibilities:</b></p><ul><li>Design, develop, and maintain scalable data pipelines using <b>Databricks</b></li><li>Work with <b>Apache Spark (PySpark/Scala)</b> for large-scale data processing</li><li>Optimize Databricks jobs for performance, cost, and reliability</li><li>Integrate data from multiple sources (structured &amp; unstructured)</li><li>Implement data transformation, cleansing, and validation processes</li><li>Collaborate with cross-functional teams to deliver data-driven solutions</li><li>Ensure data quality, security, and governance best practices</li><li>Troubleshoot and resolve data pipeline and performance issues</li></ul><p><b>Required Skills &amp; Qualifications:</b></p><ul><li>5+ years of experience in <b>Data Engineering / Big Data</b> roles</li><li>Strong hands-on experience with <b>Databricks</b></li><li>Proficiency in <b>Apache Spark, PySpark, or Scala</b></li><li>Experience with <b>SQL</b> and data modeling concepts</li><li>Familiarity with cloud platforms (<b>Azure / AWS / GCP</b>)</li><li>Experience working with <b>ETL/ELT pipelines</b></li><li>Knowledge of data lakes, Delta Lake, and big data ecosystems</li><li>Good understanding of data warehousing and analytics concepts</li></ul><p><b>Nice to Have:</b></p><ul><li>Databricks certifications</li><li>Experience with <b>Delta Live Tables</b> and <b>Unity Catalog</b></li><li>Exposure to CI/CD for data pipelines</li><li>Experience supporting analytics and ML workloads</li></ul><p>Job Types: Full-time, Contractual / Temporary<br/>Contract length: 12 months</p><p>Pay: ₹70,000.00 - ₹80,000.00 per month</p><p>Work Location: Remote</p>

Databricks Engineer/5+ years/Remote

<p>We are seeking a highly skilled <b>Azure Data Engineer</b> with extensive experience in building, optimizing, and managing scalable data solutions on Microsoft Azure. The ideal candidate will have hands-on expertise in <b>Azure Databricks, Data Factory, Data Lake Storage</b>, and <b>Event Hub</b>, along with strong programming and data engineering skills.</p><p>Required Skills and Qualifications:</p><ul><li>8+ years of experience as an Azure Data Engineer or similar role.</li><li>Strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Event Hub.</li><li>Proficiency in programming languages such as PySpark, Scala, or SQL.</li><li>Experience with data modeling, data warehousing, and big data technologies.</li><li>Knowledge of Delta Lake and other data storage formats.</li><li>Familiarity with data integration tools and techniques.</li><li>Excellent problem-solving skills and attention to detail.</li><li>Knowledge of data governance and data quality best practices.</li><li>Strong communication and collaboration skills.</li><li>Certification in Microsoft Azure Data Engineering or irelated areas is a plus</li><li>Bachelor&rsquo;s degree in Computer Science, Information Technology, or a related field.</li></ul><p>Job Type: Full-time</p><p>Application Question(s):</p><ul><li>Do you have a minimum of 8 years of total experience as a Data Engineer or in a similar role?</li><li>How many years of hands-on experience do you have with Azure Databricks?</li><li>How many years of experience do you have working with Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS)?</li><li>Do you have experience with data modeling, data warehousing, and big data technologies?</li><li>What is your current and expected salary?</li><li>What is your notice period?</li></ul>

Azure Data Engineer _

Datamatics Global Services Ltd

<div><h2 class="jobSectionHeader"><b>Job Title:</b><b> Data Engineer (2 Positions)</b></h2><p><b>
Experience:</b> 6&ndash;7 Years<br>
<b>Location:</b> Remote / Hybrid<br>
<b>Employment Type:</b> Full-Time</p><h3 class="jobSectionHeader"><b>
Job Summary</b></h3><p>
We are seeking talented and experienced <b>Data Engineers</b> with 6&ndash;7 years of hands-on experience in designing, developing, and maintaining large-scale data solutions. The ideal candidates will have a strong background in building <b>robust ETL frameworks</b>, <b>complex data pipelines</b>, and working with <b>big data technologies</b>. This role requires a blend of technical expertise, problem-solving skills, and the ability to work collaboratively with cross-functional teams to deliver reliable and scalable data systems supporting analytics and business intelligence.</p><h3 class="jobSectionHeader"><b>
Key Responsibilities</b></h3><ul><li><p>
Design, develop, and maintain <b>scalable ETL/ELT frameworks</b> and complex data pipelines.</p></li><li><p>
Build and optimize <b>data processing jobs</b> using big data technologies and modern data frameworks.</p></li><li><p>
Ensure <b>data accuracy, consistency, and reliability</b> across multiple data platforms.</p></li><li><p>
Collaborate with <b>data scientists, analysts, and business stakeholders</b> to transform business requirements into data-driven technical solutions.</p></li><li><p>
Troubleshoot, debug, and optimize existing workflows for <b>performance and scalability</b>.</p></li><li><p>
Implement best practices for <b>data governance, version control, and performance monitoring</b>.</p></li></ul><h3 class="jobSectionHeader"><b>
Required Skills &amp; Qualifications</b></h3><ul><li><p>
6&ndash;7 years of hands-on experience in <b>data engineering and ETL design</b>.</p></li><li><p>
Proficiency in <b>SQL</b> and strong experience with one or more ETL tools such as <b>Talend</b>, <b>Informatica</b>, or <b>dbt</b>.</p></li><li><p>
Expertise in <b>big data technologies</b> including <b>Apache Spark</b>, <b>Hadoop</b>, and <b>Kafka</b>.</p></li><li><p>
Solid programming skills in <b>Python</b> or <b>Scala</b>.</p></li><li><p>
Strong understanding of <b>data modeling</b>, <b>data integration</b>, and <b>data quality management</b>.</p></li><li><p>
Experience with <b>cloud data platforms</b> (AWS, Azure, or GCP) is a strong plus.</p></li><li><p>
Excellent problem-solving, analytical, and communication skills.</p></li></ul><h3 class="jobSectionHeader"><b>
Preferred Qualifications</b></h3><ul><li><p>
Experience working in <b>agile data environments</b>.</p></li><li><p>
Exposure to <b>data warehousing</b> or <b>data lake architectures</b>.</p></li><li><p>
Familiarity with <b>DevOps practices</b> and <b>CI/CD for data pipelines</b>.</p></li></ul><p>
</p><p>lhr1NSVLnW</p></div>

Search 10000+ Big data engineer jobs near you this January. New roles added regularly across leading industries. Apply today.

10000 big data engineer jobs NEAR_ME

Big Data Engineer

Data Engineer

Azure Data Engineer -

DataOps Engineer

Databricks Engineer/5+ years/Remote

Azure Data Engineer _

Data Engineer