lead data engineer

JPMorganChase

<div><b>JOB DESCRIPTION</b><p><br>
Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.</p><p>
As a Lead Data Engineer at JPMorgan Chase within the Consumer &amp; Community Banking, you play a crucial role in an agile team dedicated to improving, developing, and providing data collection, storage, access, and analytics solutions that are secure, stable, and scalable.</p><p><b>
Job responsibilities</b></p><ul><li>
Design and implement &lsquo;data models&rsquo; to support business requirements and analytics.</li><li>
Develop and maintain MLOps pipelines for automating the deployment and monitoring of machine learning models.</li><li>
Collaborate with data architects, data scientists, data engineers, and product owner to understand data needs and translate them into data models.</li><li>
Ensure data models and machine learning models are optimized for performance and scalability.</li><li>
Conduct data analysis and profiling to understand data quality and integrity.</li><li>
Develop and maintain CI/CD pipelines for machine learning projects.</li><li>
Document data models, metadata, and machine learning processes for reference and compliance purposes.</li></ul><p>
</p><p><b>Required qualifications, capabilities, and skills</b></p><ul><li><div>
Formal training or certification on software engineering concepts and 5+ years applied experience</div></li><li>
Hands on experience in Data Modeling and MLOps</li><li>
Strong idea on Data warehousing, Data lakes and their Architecture patterns</li><li>
Proficiency in data modeling tools such as ER/Studio, ERwin, or similar.</li><li>
Experience in deploying and managing machine learning models in production.</li><li>
Proficiency in programming languages such as Python, R, or Java.</li><li>
Experience with machine learning frameworks such as TensorFlow, PyTorch, or Scikit-learn.</li><li>
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.</li><li>
Strong understanding of DevOps practices and tools.</li><li>
Excellent analytical, problem-solving, and communication skills.</li></ul><div>
</div><b>ABOUT US</b></div>

Lead Data Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p><b>Lead Data Engineer</b></p>
<p><b>
Experience Range:</b><b> </b>10 - 18 years</p>
<p><b>
Location:</b><b> </b>Bengaluru, India</p>
<p><b>
Primary Skills Required:</b> Java/Python, Scala, Spark, Kafka, Airflow, SQL, Databricks, Snowflake, Hive, AWS</p>
<p><b>
Required Qualifications:</b></p>
<ul>
<li>Minimum of 8-10 years of relevant data science, Business Intelligence, or data analytics experience preferably with a digital media or digital advertising company</li>
<li>Experience delivering products in an agile software development environment including sprint work in Jira</li>
<li>Excellent interpersonal skills with the ability to collaborate and partner across multiple teams and organizations</li>
<li>Strong SQL experience including writing/optimizing complex queries against distributed data stores such as Aurora, Hadoop, Hive, Oracle, and Snowflake</li>
<li>Experience with data pipeline and workflow management tools: Apache NiFi or Apache Airflow</li>
<li>Expert level knowledge in at least one programming language such as Python, R, Scala, Java.</li>
<li>Demonstrated experience working with business intelligence tools such as MicroStrategy, Tableau, Business Objects, Looker, etc.</li>
</ul>
<p><b>Category Technologies</b></p>
<p><b>
Languages</b></p>
<p>
Scala, Python, SQL</p>
<p><b>
Data Processing</b></p>
<p>
Apache Spark, Flink, Airflow</p>
<p><b>
Platforms &amp; Tools</b></p>
<p>
Databricks, Hive, Presto, Snowflake</p>
<p><b>
Cloud</b></p>
<p>
AWS (S3, EMR, Glue, Lambda)</p>
<ul>
<li>Demonstrated ability to effectively communicate complex concepts to technical and unacquainted audiences</li>
<li>Experience in working with large datasets (Terabytes or more)</li>
<li>Strong presentation and documentation skills including experience working with Confluence, Power Point, and Lucid Chart</li>
<li>Strong analytical and critical thinking skills</li>
<li>Enjoy working collaboratively with a talented group of people to tackle challenging business problems so we all succeed (or fail fast) as a team.</li></ul><br>
<p><b>
Preferred Qualifications</b></p>
<ul>
<li>Experience with digital advertising systems and ecosystems</li>
<li>Experience using data analytics to triage and troubleshoot advertising workflows</li>
<li>Experience with network topologies, systems architecture overviews, and entity relationship diagrams (ERD)</li>
</ul></div></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Data Scientist</div>
</div><div><div><b>Job Id</b></div>
<div>375740</div>
</div><div><div><b>Desired Skills</b></div>
<div>AWS | Python | Scala | Spark | SQL | Hive</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

MakeMyTrip

<div>
 <p>
  <strong>
   Role:
  </strong>
  Lead Data Engineer
 </p>
 <p>
  <strong>
   Location:
  </strong>
  Bangalore
 </p>
 <p>
  <strong>
   Years of Experience:
  </strong>
  6 -8 Years
 </p>
 <p>
  <strong>
   About the function:
  </strong>
 </p>
 <p>
  At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We prioritize a tech-first mindset, where our engineering teams lead the charge in transforming the way people travel.
 </p>
 <p>
  Our culture encourages collaboration, creativity, and thought leadership, empowering engineers to challenge the status quo and develop impactful, game-changing solutions. At MMT, you'll work with the latest technologies, continually push boundaries, and have the chance to shape the future of travel.
 </p>
 <p>
  Join us and become part of a forward-thinking, tech-driven organization that thrives on innovation and continuous learning.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   About the team:
  </strong>
 </p>
 <p>
  MakeMyTrip as India&rsquo;s leading online travel company and provides petabytes of raw data which is helpful for business growth, analytical and machine learning needs.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Data Platform Team is a horizontal function at MakeMyTrip to support various LOBs (Flights, Hotels, Holidays, Ground) and works heavily on streaming datasets which powers personalized experiences for every customer from recommendations to in-location engagement.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Our team's key responsibilities are:
 </p>
 <ol>
  <li>
   Design, construct, and maintain robust data systems and architectures
  </li>
  <li>
   Develop and optimize data capture, storage, processing, serving, and querying platforms
  </li>
  <li>
   Create data products for personalization, recommendation, customer segmentation, and intelligence
  </li>
  <li>
   Enhance our Measurement platform for A/B experimentation
  </li>
  <li>
   Contribute to our Feature Store, an internal unified data analytics platform
  </li>
  <li>
   Participate in the development of our next-generation Travel Planner using Generative AI and Multi-Agent frameworks.
  </li>
  <li>
   Implement and optimize data solutions for travel-specific use cases, such as:
  </li>
  <li>
   Analyzing cross-city travel patterns to extend trip recommendations
  </li>
  <li>
   Identifying correlations between hotel bookings in different areas to suggest complementary destinations
  </li>
 </ol>
 <p>
  <br/>
 </p>
 <p>
  Required Skills and Experience:
 </p>
 <ul>
  <li>
   Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture
  </li>
  <li>
   At least 6+ years of hands-on experience in Spark/BigData Tech stack
  </li>
  <li>
   Expertise in stream processing engines like Spark Structured Streaming or Apache Flink
  </li>
  <li>
   Analytical processing on Big Data using Spark
  </li>
  <li>
   At least 4+ years of experience in Scala. Experience with Python will be a plus.
  </li>
  <li>
   Hands-on administration, configuration management, monitoring, performance tuning of Spark workloads, Distributed platforms, and JVM based systems
  </li>
  <li>
   At least 2+ years of cloud deployment experience &ndash; AWS | Azure | Google Cloud Platform
  </li>
  <li>
   2 or more product deployments of big data technologies &ndash; Business Data Lake, NoSQL databases etc
  </li>
  <li>
   Awareness and decision-making ability to choose among various big data, NoSQL, analytics tools and technologies
  </li>
  <li>
   Should have experience in architecting and implementing domain centric big data solutions
  </li>
  <li>
   Ability to frame architectural decisions and provide technology leadership &amp; direction
  </li>
  <li>
   Excellent problem solving, hands-on engineering, and communication skills
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <br/>
 </p>
 <p>
  At MakeMyTrip, we're committed to innovation and excellence in the travel industry. Join us in shaping the future of travel through data-driven solutions and advanced technologies. If you're passionate about leveraging data to create exceptional travel experiences, we want to hear from you!
 </p>
</div>


Lead Data  Engineer

<div>
 <p>
  <strong>
   Role:
  </strong>
  Lead Data Engineer
 </p>
 <p>
  <strong>
   Location: Gurgaon
  </strong>
 </p>
 <p>
  <strong>
   Years of Experience:
  </strong>
  6 -8 Years
 </p>
 <p>
  <strong>
   About the function:
  </strong>
 </p>
 <p>
  At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We prioritize a tech-first mindset, where our engineering teams lead the charge in transforming the way people travel.
 </p>
 <p>
  Our culture encourages collaboration, creativity, and thought leadership, empowering engineers to challenge the status quo and develop impactful, game-changing solutions. At MMT, you'll work with the latest technologies, continually push boundaries, and have the chance to shape the future of travel.
 </p>
 <p>
  Join us and become part of a forward-thinking, tech-driven organization that thrives on innovation and continuous learning.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   About the team:
  </strong>
 </p>
 <p>
  MakeMyTrip as India&rsquo;s leading online travel company and provides petabytes of raw data which is helpful for business growth, analytical and machine learning needs.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Data Platform Team is a horizontal function at MakeMyTrip to support various LOBs (Flights, Hotels, Holidays, Ground) and works heavily on streaming datasets which powers personalized experiences for every customer from recommendations to in-location engagement.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Our team's key responsibilities are:
 </p>
 <ol>
  <li>
   Design, construct, and maintain robust data systems and architectures
  </li>
  <li>
   Develop and optimize data capture, storage, processing, serving, and querying platforms
  </li>
  <li>
   Create data products for personalization, recommendation, customer segmentation, and intelligence
  </li>
  <li>
   Enhance our Measurement platform for A/B experimentation
  </li>
  <li>
   Contribute to our Feature Store, an internal unified data analytics platform
  </li>
  <li>
   Participate in the development of our next-generation Travel Planner using Generative AI and Multi-Agent frameworks.
  </li>
  <li>
   Implement and optimize data solutions for travel-specific use cases, such as:
  </li>
  <li>
   Analyzing cross-city travel patterns to extend trip recommendations
  </li>
  <li>
   Identifying correlations between hotel bookings in different areas to suggest complementary destinations
  </li>
 </ol>
 <p>
  <br/>
 </p>
 <p>
  Required Skills and Experience:
 </p>
 <ul>
  <li>
   Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture
  </li>
  <li>
   At least 6+ years of hands-on experience in Spark/BigData Tech stack
  </li>
  <li>
   Expertise in stream processing engines like Spark Structured Streaming or Apache Flink
  </li>
  <li>
   Analytical processing on Big Data using Spark
  </li>
  <li>
   At least 4+ years of experience in Scala. Experience with Python will be a plus.
  </li>
  <li>
   Hands-on administration, configuration management, monitoring, performance tuning of Spark workloads, Distributed platforms, and JVM based systems
  </li>
  <li>
   At least 2+ years of cloud deployment experience &ndash; AWS | Azure | Google Cloud Platform
  </li>
  <li>
   2 or more product deployments of big data technologies &ndash; Business Data Lake, NoSQL databases etc
  </li>
  <li>
   Awareness and decision-making ability to choose among various big data, NoSQL, analytics tools and technologies
  </li>
  <li>
   Should have experience in architecting and implementing domain centric big data solutions
  </li>
  <li>
   Ability to frame architectural decisions and provide technology leadership &amp; direction
  </li>
  <li>
   Excellent problem solving, hands-on engineering, and communication skills
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <br/>
 </p>
 <p>
  At MakeMyTrip, we're committed to innovation and excellence in the travel industry. Join us in shaping the future of travel through data-driven solutions and advanced technologies. If you're passionate about leveraging data to create exceptional travel experiences, we want to hear from you!
 </p>
</div>


ProClink

<div><div><b>Core Responsibilities:</b></div><div>
Lead end-to-end design, development, and delivery of complex cloud-based data pipelines.</div><div>
Collaborate with architects and stakeholders to translate business requirements into technical data solutions.</div><div>
Ensure scalability, reliability, and performance of data systems across environments.</div><div>
Provide mentorship and technical leadership to data engineering teams.</div><div>
Define and enforce best practices for data modeling, transformation, and governance.</div><div>
Optimize data ingestion and transformation frameworks for efficiency and cost management.</div><div>
Contribute to data architecture design and review sessions across projects.</div><div></div><div><b><br>
Qualifications:</b></div><div>
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Engineering, or related field.</div><div>
8+ years of experience in data engineering with proven leadership in designing cloud-native data systems.</div><div>
Strong expertise in Python, SQL, Apache Spark, and at least one cloud platform (Azure, AWS, or GCP).</div><div>
Experience with Big Data, DataLake, DeltaLake, and Lakehouse architectures</div><div>
Proficient in one or more database technologies (e.g. PostgreSQL, Redshift, Snowflake, and NoSQL databases).</div><div>
Ability to recommend and implement scalable data pipelines</div><div></div><div><b><br>
Preferred Qualifications:</b></div><div>
Cloud certification (AWS, Azure, or GCP).</div><div>
Experience with Databricks, Snowflake, or Terraform.</div><div>
Familiarity with data governance, lineage, and observability tools.</div><div>
Strong collaboration skills and ability to influence data-driven decisions across teams.</div></div><div></div>

Folio3

<div><div><p>Folio3 needs an expert Senior Data Engineer ready to drive our data strategy&mdash;from Snowflake/Databricks architecture and governance to leading complex multi-cloud migration projects.</p>
<h4 class="jobSectionHeader"><b>
Responsibilities:</b></h4>
<ul><li>Design end-to-end data architectures across Snowflake, Databricks, AWS, Azure, and GCP.</li>
Lead migration or modernization projects (on-prem cloud or single<li> multi-cloud).</li>
<li>Define data modeling standards, governance, and cost-optimization strategies.</li>
<li>Collaborate with solution architects, AI/ML teams, and business stakeholders.</li>
<li>Manage data reliability, observability, and scalability of the platform.</li>
<li>Mentor junior and mid-level engineers.</li>
<li>Stay current on modern data stack trends (Data Mesh, Lakehouse, AI Integration).</li>
</ul><h4 class="jobSectionHeader"><b>Requirements:</b></h4>
<ul><li>5-10+ years of progressive, hands-on experience in Data Engineering.</li>
<li>Design end-to-end data architectures across Snowflake, Databricks, AWS, Azure, and GCP.</li>
Lead migration or modernization projects (on-prem cloud or single<li> multi-cloud).</li>
<li>Define data modeling standards, governance, and cost-optimization strategies.</li>
<li>Collaborate with solution architects, AI/ML teams, and business stakeholders.</li>
<li>Manage data reliability, observability, and scalability of the platform.</li>
<li>Mentor junior and mid-level engineers.</li>
<li>Stay current on modern data stack trends (Data Mesh, Lakehouse, AI Integration).</li></ul></div></div>

Senior/Lead Data Engineer

Devgiri Softwares

<p><b>Job Title:</b> Lead Data Engineer / Database Administrator (DBA)<br/><b>Office: </b>Devgiri Softwares, T-21/1 STPI MIDC Chikalthana, Aurangabad &ndash; 431003, Maharashtra, India<br/><b>Department:</b> Data &amp; Analytics<br/><b>Client: </b>A leader in software quality and security management<br/><b>Reports to: </b>Head of Data / CTO</p><p><b>About the Company</b></p><p>We are hiring this position for our client which is a leader in software quality and security management, offering a comprehensive suite of tools that enhance testing, strengthen security, and accelerate product delivery. Our unified platform empowers development teams to build reliable, high-quality software trusted worldwide.</p><p><b>Job Summary</b></p><p>The <b>Lead Data Engineer / Database Administrator (DBA)</b> is a senior technical leader responsible for owning the design, performance, and scalability of the internal data warehouse and production databases. This role will lead the data engineering function, mentor junior data engineers, and ensure the reliability, performance, and quality of data pipelines across the organization. This is a <b>hands-on leadership position</b> requiring deep expertise in SQL, AWS infrastructure, ETL design, and BI tooling.</p><p><b>Key Responsibilities</b></p><ul><li>Lead and mentor a small team of data engineers, promoting technical excellence and best practices.</li><li>Own and manage <b>AWS-based data infrastructure</b> (data warehouse and ETL systems), including provisioning, performance tuning, and cost optimization.</li><li>Design, implement, and maintain <b>end-to-end ETL pipelines</b> to support data ingestion, transformation, and integration from internal systems and third-party tools.</li><li>Optimize <b>queries and indexes</b> for production application databases to ensure fast, reliable access.</li><li>Triage and resolve <b>data integrity issues</b> across the warehouse and source systems.</li><li>Partner with <b>BI analysts and stakeholders</b> to enable high-quality reporting and analytics.</li><li>Support <b>data tooling and BI platforms</b> such as Yellowfin, Tableau, Power BI, and others.</li><li>Ensure <b>secure and performant connectivity</b> between CData drivers and the data warehouse.</li></ul><p><b>Requirements</b></p><ul><li><b>5+ years</b> of experience in data engineering, data infrastructure, or database administration roles.</li><li><b>Expert-level SQL skills</b>, with strong experience in relational database performance tuning and optimization.</li><li><b>Hands-on experience managing AWS infrastructure</b>, including <b>RDS, S3, EC2, and IAM</b>.</li><li>Proven ability to design and maintain <b>scalable, maintainable ETL pipelines and data workflows</b>.</li><li>Experience owning both <b>production and warehouse environments</b> in a high-volume data environment.</li><li>Strong <b>communication and collaboration skills</b> with cross-functional teams.</li></ul><p><b>Preferred Qualifications</b></p><ul><li>Prior experience in a <b>team lead or mentorship capacity</b> over other data engineers.</li><li>Experience with <b>BI tools</b> like Yellowfin, Tableau, Looker, or equivalent.</li><li>Familiarity with <b>version-controlled data workflows</b> (e.g., dbt, Airflow).</li><li>Knowledge of <b>data security, compliance, and governance</b> best practices.</li><li>Exposure to <b>scripting languages like Python</b> for ETL tasks and automation.</li></ul><p><b>How to Apply:</b> Please send your resume and a brief summary of your most impactful data infrastructure project to info@devgirisoft<b>.com</b></p><p>Job Types: Full-time, Walk-In</p><p>Work Location: In person</p>

Lead Data Engineer / Database Administrator (DBA)

Search 10000+ Lead data engineer jobs near you this November. New roles added regularly across leading industries. Apply today.

10000 lead data engineer jobs NEAR_ME

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Senior/Lead Data Engineer

Lead Data Engineer / Database Administrator (DBA)