data engineering lead

Persistent Systems

<div>
 <p>
  <strong>
   About Position:
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  We are seeking Data Engineering Lead with hands scrum, product owner, etc.,
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   <strong>
    Role: Data Engineering Lead
   </strong>
  </li>
  <li>
   <strong>
    Location: All Persistent Locations
   </strong>
  </li>
  <li>
   <strong>
    Experience: 10 to 12 years
   </strong>
  </li>
  <li>
   <strong>
    Job Type: Full Time Employment
   </strong>
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   What You'll Do:
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Define and execute the product vision and roadmap for the Compliance Insights platform.
  </li>
  <li>
   Collaborate with cross-functional teams to align data solutions with compliance and business needs.
  </li>
  <li>
   Deliver dashboards, analytics, and alerts to monitor distributor performance and risk.
  </li>
  <li>
   Ensure data governance, privacy, and regulatory compliance across all solutions.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Expertise You'll Bring:
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   5+ years in data product management, engineering, or analytics.
  </li>
  <li>
   Strong proficiency in Azure, Databricks, Snowflake, and Power BI.
  </li>
  <li>
   Deep understanding of data governance, privacy, and compliance principles.
  </li>
  <li>
   Experience with Agile/Scrum and cross-functional stakeholder management.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Benefits:
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Competitive salary and benefits package
  </li>
  <li>
   Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  </li>
  <li>
   Opportunity to work with cutting-edge technologies
  </li>
  <li>
   Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  </li>
  <li>
   Annual health check-ups
  </li>
  <li>
   Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Values-Driven, People-Centric &amp; Inclusive Work Environment:
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   We support hybrid work and flexible hours to fit diverse lifestyles.
  </li>
  <li>
   Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
  </li>
  <li>
   If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Let&rsquo;s unleash your full potential at Persistent - persistent.com/careers
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <em>
    &ldquo;Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.&rdquo;
   </em>
  </strong>
 </p>
</div>


Data Engineering Lead

Continental

<div></div><div><div><div><div><div><div><div><p>Your tasks
</p><div><div><ul><li>Govern data acquisition and ingestion architecture for enterprise-wide data &amp; analytics integration.</li><li>Establish reusable, scalable, and governed interfaces to all source systems across business domains.</li><li>Define standards and ensure engineering quality across ingestion pipelines and upstream data flows.</li><li>Act as escalation and design authority for ingestion, unstructured data, and advanced analytics integration points.</li><li>Oversees ingestion and integration design across 100+ data sources.</li><li>Supports 25+ data engineering and data science professionals with ingestion architecture and troubleshooting.</li><li>Interfaces with source system experts, data scientists, platform architects, and functional IT stakeholders.</li></ul><p></p><p><br>
Main Tasks</p><ul><li>Define ingestion frameworks for batch, streaming, and APIs.</li><li>Establish standards for JSON, CSV, XML, and unstructured data.</li><li>Govern manual uploads and exception workflows.</li><li>Collaborate with system owners to define interface specifications.</li><li>Manage schema evolution and API reliability.</li><li>Align ingestion architecture with platform and business requirements.</li><li>Collaborate on ingestion for data science and ML pipelines</li><li>Ensure robust API and event-driven integration for AI/LLM use cases.</li><li>Support complex acquisition scenarios with scalability requirements.</li><li>Review high-risk ingestion pipelines for performance and security.</li><li>Support data engineers on error handling, retries, and load orchestration.</li><li>Ensure ingestion aligns with governance and architecture.</li><li>Maintain ingestion libraries and templates.</li><li>Promote reuse and automation across engineering teams.</li><li>Lead best practices in TDD, code reviews, and pipeline testing.</li><li>Maintain architectural blueprints, templates, and best practices.</li><li>Publish design guidelines and coding standards.</li><li>Create re-usable architecture patterns for lakehouse environments.</li><li>Monitor usage and implement auto-scaling policies.</li><li>Analyze and optimize cluster configurations for cost-efficiency.</li><li>Provide cost transparency and usage reporting to stakeholders.</li></ul><br>
<p></p>
<p>
</p></div></div></div><div><p>Your profile
</p><div><div><p>Degree in Computer Science or related field; certifications in Databricks or Microsoft Azure preferred.</p><p>
6&ndash;10 years in data engineering with strong focus on enterprise-scale data &amp; analytics integration, including ML and LLM scenarios.</p><p>
Experience building robust ingestion frameworks and reusable components.</p><p>
Track record of architectural ownership and peer enablement with diverse teams.</p><p>
Experience working in international teams across multiple time zones and cultures, preferably with teams in India, Germany, and the Philippines.</p><br>
<p>
</p></div></div></div><div><p>Our offer
</p><div><div><p>The well-being of our employees is important to us. That's why we offer exciting career prospects and support you in achieving a good work-life balance with additional benefits such as:</p><ul><li>
Training opportunities</li><li>
Mobile and flexible working models</li><li>
Sabbaticals</li></ul><p>
and much more...</p><p>
Sounds interesting for you? Click here to find out more.</p><p></p><p><br>
Diversity, Inclusion &amp; Belonging are important to us and make our company strong and successful. We offer equal opportunities to everyone - regardless of age, gender, nationality, cultural background, disability, religion, ideology or sexual orientation.</p><div></div><p>
Ready to drive with Continental? Take the first step and fill in the online application.</p><br>
<p>
</p></div></div></div><div><p>About us
</p><div><div><p>Continental develops pioneering technologies and services for sustainable and connected mobility of people and their goods. Founded in 1871, the technology company offers safe, efficient, intelligent, and affordable solutions for vehicles, machines, traffic and transportation. In 2023, Continental generated sales of &euro;41.4 billion and currently employs around 200,000 people in 56 countries and markets.</p><p>
 Guided by the vision of being the customer's first choice for material-driven solutions, the ContiTech group sector focuses on development competence and material expertise for products and systems made of rubber, plastics, metal, and fabrics. These can also be equipped with electronic components in order to optimize them functionally for individual services. ContiTech's industrial growth areas are primarily in the areas of energy, agriculture, construction, and surfaces. In addition, ContiTech serves the automotive and transportation industries as well as rail transport.</p><p>
The IT Digital and Data Services Competence Center of ContiTech caters to all the Business Areas in ContiTech and responsible among other on areas of Data &amp; Analytics, Web and Mobile Software Development and AI</p><p>
The team for Data services specializes in all platforms, business applications and products in the domain of data and analytics, covering the entire spectrum including AI, machine learning, data science, data analysis, reporting and dashboarding.</p><p><br>
</p></div></div></div><div><p><b>
</b></p></div></div><div><div><div><div><h2 class="jobSectionHeader"><b>Keyfacts
</b></h2><div><div>Job ID
<br>
<b>REF87520Q</b>
</div><p>Location
<br>
<b>Bengaluru</b>
</p><p></p><p>Leadership level
<br>
<b>Leading Self</b>
</p><p>Job flexibility
<br>
<b>Hybrid Job</b>
</p><div><div><div>Legal Entity
<br>
<b>ContiTech India Pvt. Ltd.</b></div></div></div></div></div></div></div></div></div></div></div></div></div><p></p>

IT engineer Data Engineering - Tech Lead

Deloitte

<div>
 <strong>
  Data Engineering Tech Lead, Cairo, Egypt
  <br/>
  <br/>
 </strong>
 <strong>
  Connect to your career at Deloitte
  <br/>
  <br/>
 </strong>
 Deloitte, established globally in 1845, is the world&rsquo;s largest and leading professional services firm, providing Audit &amp; Assurance, Tax &amp; Legal and Consulting and related services to public and private clients spanning multiple industries. Present in more than 150 countries, Deloitte is distinct in its ability to help clients solve their most complex problems, from strategy to implementation.
 <br/>
 <br/>
 Deloitte innovation hub (DIH) is a strategic initiative established by Deloitte North &amp; South Europe (NSE) to support our ambition to become the leading business transformation partner of choice for our clients and to expand and scale our delivery footprint across EMEA. With access to a scaled, diverse, highly skilled, motivated, and engaged workforce, DIH is delivering complex technical solutions for clients&rsquo; most complex business problems, across portfolios that include &lsquo;Strategy &amp; Transactions&rsquo;, &lsquo;Customer&rsquo;, &lsquo;Engineering, AI &amp; Data, &lsquo;Enterprise, Technology &amp; Performance&rsquo; and &lsquo;Cyber&rsquo;. DIH is aiming to become the destination for top talents in Egypt for a long, exciting career.
 <br/>
 <br/>
 We invest in outstanding people of diverse talents and backgrounds and empower them to achieve more than they could elsewhere. Our work combines advice with action and integrity. We believe that when our clients and society are stronger, so are we. Our organization has grown in scale and diversity, providing services across the region, with our shared culture remaining the same. We aim to help clients realize their ambitions, make a positive difference in society, and maximize the success of our people. This drive fuels the commitment and humanity that run deep through our every action.
 <br/>
 <br/>
 <strong>
  Connect to your opportunity
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Identify and solve complex problems using a structured and logical approach.
  </li>
  <li>
   Stay up to date on the latest data engineering technologies and trends.
  </li>
  <li>
   Work with other engineering teams to integrate data engineering solutions with other systems.
  </li>
  <li>
   Maintain and optimize data systems to ensure high availability and performance.
  </li>
  <li>
   Design and implement data pipelines to collect, transform, and load data into data warehouses and data lakes.
  </li>
  <li>
   Gather requirements from stakeholders and translate them into technical specifications.
  </li>
  <li>
   Lead a team of data engineers in the design, development, and implementation of data engineering solutions.
  </li>
  <li>
   Manage functional and non-functional requirements and have a deep understanding of systems engineering methodologies.
  </li>
  <li>
   Build and maintain positive relationships with stakeholders, and to effectively communicate technical concepts to non-technical audiences.
  </li>
  <li>
   Manage multiple projects simultaneously in a highly organized and efficient manner.
  </li>
  <li>
   Think creatively and come up with new solutions to problems.
  </li>
  <li>
   Communicate effectively with technical and non-technical audiences, both verbally and in writing.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Technical Skills
  <br/>
  <br/>
 </strong>
 <strong>
  Connect to your skills and professional experience
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   6 - 10 years of relevant experience.
  </li>
  <li>
   Cloud computing platforms: AWS/Azure/GCP
  </li>
  <li>
   Programming languages: Python/Java/Scala &amp; Unix Shell scripting
  </li>
  <li>
   Data warehouse technologies: Redshift/Snowflake/Big Query
  </li>
  <li>
   Data lake technologies: Hadoop, Apache Beam, Spark, and Hive
  </li>
  <li>
   Orchestration: Airflow/Control-M/(Any Orchestration tool)
  </li>
  <li>
   Machine learning frameworks: TensorFlow, PyTorch, and scikit-learn
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Connect to your service line - Technology &amp; Transformation
  <br/>
  <br/>
 </strong>
 Distinctive thinking, deep expertise, and collaborative working. That&rsquo;s what connects us. That&rsquo;s what makes us Deloitte. If you want to help solve some of the biggest challenges around, join us. Together, we&rsquo;ll make an impact that matters.
 <br/>
 <br/>
 <strong>
  Personal independence
  <br/>
  <br/>
 </strong>
 Regulation and controls are standard practice in our industry and Deloitte is no exception. These controls provide important legal protection for both you and the firm. We are subject to several audit regulations, one of which requires that certain colleagues abide by specific personal independence constraints. This can mean that you and your "Immediate Family Members" are not permitted to hold certain financial interests (shares, funds, bonds etc.) with audit clients of the firm. The recruitment team will provide further detail as you progress through the recruitment process.
 <br/>
 <br/>
 <strong>
  Connect to your Industry
  <br/>
  <br/>
 </strong>
 &ldquo;What attracted me to Deloitte were the endless opportunities and the collective experience of other like-minded individuals. Deloitte&rsquo;s clients include many of the world&rsquo;s largest organisations; I wanted to be part of a team that made a difference that I could be proud of.&rdquo;
 <br/>
 <br/>
 <ul>
  <li>
   Dan, Technology and Transformation
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Our commitment to you
  <br/>
  <br/>
 </strong>
 Making an impact is more than just what we do: it&rsquo;s why we&rsquo;re here. So we work hard to create an environment where you can experience a purpose you believe in, the freedom to be you, and the capacity to go further than ever before.
 <br/>
 <br/>
 We want you. The true you. Your own strengths, perspective, and personality. So, we&rsquo;re nurturing a culture where everyone belongs, feels supported and heard, and is empowered to make a valuable, personal contribution. You can be sure we&rsquo;ll take your wellbeing seriously, too. Because it&rsquo;s only when you&rsquo;re comfortable and at your best that you can make the kind of impact you, and we, live for.
 <br/>
 <br/>
 Your expertise is our capability, so we&rsquo;ll make sure it never stops growing. Whether it&rsquo;s from the complex work you do, or the people you collaborate with, you&rsquo;ll learn every day. Through world-class development, you&rsquo;ll gain invaluable technical and personal skills. Whatever your level, you&rsquo;ll learn how to lead.
 <br/>
 <br/>
 <strong>
  Connect to your next step
  <br/>
  <br/>
 </strong>
 A career at Deloitte is an opportunity to develop in any direction you choose. Join us and you&rsquo;ll experience a purpose you can believe in and an impact you can see. You&rsquo;ll be free to bring your true self to work every day. And you&rsquo;ll never stop growing, whatever your level.
 <br/>
 <br/>
</div>


Deloitte Innovation Hub I Data Engineering Tech Lead, Cairo, Egypt

LatentView Analytics

<p></p><div><div><div>About the Company: Databrick</div><div>
Databricks is a unified data and AI platform built on a lakehouse architecture, which combines features of both data warehouses and data lakes.</div><div></div><div><b><br>
Designation:</b> <b>Assistant Manager - Data Engineering</b><br>
<b>Experience: 5 to 7 years</b><br>
<b>Location: Bengaluru, Karnataka , India (BLR)</b></div><div><b><br>
Job Description:</b></div><div>
Lead Data Engineer with strong technical skills</div><div></div><div><b><br>
Responsibilities:</b></div><div></div><div><br>
Role Summary</div><div></div><div><br>
Data Engineering Lead with experience in designing and managing large-scale data solutions. The role involves leading the development of data ingestion pipelines on Databricks, leveraging the Medallion Architecture (Bronze, Silver, Gold layers) to process marketing data.</div><div></div><div><br>
 The person will also drive process improvements, enforce data security and compliance standards, and foster best practices within the team.</div><div></div><div><br>
Key Responsibilities</div><div></div><div><br>
Design, build, and optimize ETL pipelines using Azure Databricks to support marketing analytics and reporting.</div><div></div><div><br>
Manage data workflows across Bronze, Silver, and Gold layers following the Databricks Medallion Architecture.</div><div></div><div><br>
Collaborate closely with clients, analysts, data scientists, and business stakeholders to translate business needs into scalable data solutions.</div><div></div><div><br>
Act as the primary point of contact for clients and business stakeholders, ensuring timely delivery of high-quality solutions.</div><div></div><div><br>
Lead and mentor the team, establish best practices, and drive process improvements for standard team engagements.</div><div></div><div><br>
Ensure data governance, security, and compliance are maintained across the platform.</div><div></div><div><br>
Enable marketing analytics use cases by building pipelines that track customer journeys, campaign effectiveness, and credit allocation to products.</div><div></div><div><br>
Required Skills</div><div>
Strong expertise in SQL, PySpark, and Python.</div><div>
Advanced knowledge of Azure Databricks, including performance tuning and large-scale data pipeline development.</div><div></div><div><br>
Proven experience in data engineering, ETL pipeline design, and big data processing</div><div></div><div><br>
Strong communication and stakeholder management skills.</div><div></div><div><br>
Domain experience in Marketing Data and Analytics is a plus.</div><div></div><div><br>
Good-to-Have Skills</div><div></div><div><br>
Knowledge of Generative AI and AI/BI solutions in Databricks.</div><div>
Experience with Power BI for data visualization and business intelligence reporting.</div><div></div><div><b><br>
Skills:</b></div><div>
5 to 7 years in the Data Engineering domain</div><div>
Data Engineering, ETL pipeline design, and big data processing - (Databricks, SQL, PySpark), Knowledge of Generative AI and AI/BI solutions in Databricks., Databricks, PySpark, SQL</div></div></div>
<br><div><div><b>Job Snapshot</b></div><div><div><div>
Updated Date</div><div>
07-11-2025</div></div><div><div>
Job ID</div><div>
J_4361</div></div><div><div>
Location</div>
Bengaluru, Karnataka, India
</div><div><div>Experience</div><div>
5 - 7 Years</div></div><div><div>
Employee Type</div><div>
Permanent</div></div></div></div>

Assistant Manager - Data Engineering

JP Techno Park

<p><b>Job Title:</b> &ensp;&ensp;&ensp;&ensp;&ensp;Tech Lead Data Engineering (DBT)</p><p><b>Location:</b> &ensp;&ensp;&ensp;&ensp; Chennai (On-Site)</p><p><b>Experience:</b> &ensp;&ensp;&ensp;7+ Years</p><p><b>Position Type:</b> Full-Time</p><p><b>Shift Timings: </b>2 - 11 PM</p><p><b>Skillset: &ensp;&ensp;&ensp;&ensp;&ensp; </b>Data Engineering, ETL Pipelines, DBT (Data Build Tool / Data Built Tool), Python, SQL</p><p><b>About the Role: </b>We are seeking an experienced Data Engineering Lead (DBT Tech Lead) to design, build, and lead scalable data transformation and pipeline solutions within a modern data stack environment. The ideal candidate will have deep experience in ETL and Data Engineering with recent hands-on expertise in DBT (Data Build Tool) for data modeling, orchestration, and transformation. This role requires a strong command of SQL, data pipeline optimization, and the ability to lead end-to-end data initiatives that power analytics and business intelligence platforms.</p><p><b>Key Responsibilities</b></p><ul><li>Lead the design, development, and maintenance of data pipelines and ETL workflows.</li><li>Build, optimize, and manage data transformation models using DBT (Cloud or Core).</li><li>Collaborate with data architects and analysts to define data models, schemas, and lineage.</li><li>Ensure high-quality data delivery by implementing best practices for testing, versioning, and documentation within DBT.</li><li>Work with modern data warehouses (e.g., Snowflake, BigQuery, Redshift, Databricks) for transformation and analytics.</li><li>Drive continuous improvement in data architecture, performance tuning, and data governance.</li><li>Provide technical leadership, mentorship, and guidance to junior data engineers.</li><li>Partner with cross-functional teams to translate business requirements into scalable data solutions.</li></ul><p><b>Required Skills &amp; Experience</b></p><ul><li>8+ years of experience in Data Engineering, ETL, and pipeline development.</li><li>2+ years of recent hands-on experience with DBT (Data Build Tool) for transformation and modeling.</li><li>Strong proficiency in SQL (advanced query optimization, data modeling, performance tuning).</li><li>Hands-on experience with at least one modern cloud data warehouse (Snowflake, BigQuery, Redshift, Databricks).</li><li>Proficiency with data pipeline orchestration tools (Airflow, Prefect, or similar).</li><li>Understanding of data warehousing concepts, data quality frameworks, and modern data stack.</li><li>Strong analytical, problem-solving, and troubleshooting skills.</li><li>Excellent communication and team collaboration abilities.</li></ul><p><b>Nice to Have</b></p><ul><li>Experience with Python or Spark for advanced data processing.</li><li>Exposure to data observability tools (e.g., Great Expectations, Monte Carlo).</li><li>Knowledge of Git-based CI/CD workflows for DBT deployment.</li></ul><p>Job Type: Full-time</p><p>Pay: &#8377;2,500,000.00 - &#8377;3,000,000.00 per year</p><p>Experience:</p><ul><li>Lead Data Engineering: 10 years (Required)</li><li>DBT: 10 years (Required)</li><li>Data Build Tool: 10 years (Required)</li><li>DBT Lead: 10 years (Required)</li><li>ETL: 10 years (Required)</li><li>Pipeline Development: 10 years (Required)</li><li>SQL: 10 years (Required)</li><li>Data warehouse: 10 years (Required)</li><li>Snowflake: 10 years (Required)</li><li>BigQuery: 10 years (Required)</li><li>Redshift: 10 years (Required)</li><li>Data pipeline orchestration: 10 years (Required)</li><li>Airflow: 10 years (Required)</li><li>Python : 10 years (Required)</li><li>Data observability: 10 years (Required)</li></ul><p>Work Location: In person</p>

Tech Lead Data Engineering (DBT)

<div><p><b>Line of Service
</b></p>Advisory
<p></p><p><b>Industry/Sector
</b></p>Technology
<p></p><p><b>Specialism
</b></p>Advisory - Other
<p></p><p><b>Management Level
</b></p>Manager
<p></p><p><b>Job Description &amp; Summary
</b></p>As a Data Engineering Manager, you will lead the design, development, and optimization of modern data platforms and pipelines on Azure and Databricks. You will oversee a team of data engineers and collaborate with cross-functional stakeholders to deliver scalable, secure, and high-performing data solutions that enable advanced analytics, AI, and business insights for enterprise clients.
<br>
This role requires deep expertise in cloud data architecture, hands-on experience with Azure data services (including Microsoft Fabric), and advanced proficiency in Databricks for batch and real-time data engineering. You will also be responsible for mentoring team members, driving technical excellence, and aligning data engineering initiatives with business strategy.
<p></p><h3 class="jobSectionHeader"><b>Key Responsibilities
</b></h3><ul><li>Lead the end-to-end delivery of data engineering projects, ensuring alignment with business goals and technical standards.
</li><li>Architect and oversee the implementation of scalable data pipelines across structured, semi-structured, and unstructured data sources.
</li><li>Guide the adoption of best practices in data ingestion, transformation, and orchestration using Azure Data Factory, Synapse, and Microsoft Fabric.
</li><li>Drive performance optimization and scalability of ETL/ELT processes using Databricks (PySpark, SQL, Delta Lake).
</li><li>Establish and enforce data governance, quality, lineage, and observability frameworks.
</li><li>Collaborate with solution architects and business leaders to define modern data architectures and ensure compliance with security and privacy regulations.
</li><li>Facilitate technical workshops, stakeholder engagements, and roadmap planning sessions.
</li><li>Mentor and develop junior engineers, fostering a culture of innovation, accountability, and continuous learning.
</li></ul><h3 class="jobSectionHeader"><b>Required Skills &amp; Experience
</b></h3><ul><li><b>7&ndash;10 years </b>of experience in data engineering, with at least <b>3 years in a leadership or managerial role </b>.
</li><li>Proven track record of delivering enterprise-grade data solutions in consulting or large-scale environments.
</li><li>Advanced hands-on experience with:
<ul><li><b>Azure Data Platform </b>: Data Factory, Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Event Hub/IoT Hub, Azure Functions.
</li><li><b>Databricks </b>: PySpark, Spark SQL, Delta Lake, Unity Catalog, Databricks Workflows.
</li></ul></li><li>Strong proficiency in <b>Python and SQL </b>for large-scale data processing.
</li><li>Expertise in data modeling, medallion architecture, and lakehouse principles.
</li><li>Familiarity with CI/CD pipelines, DevOps practices, and version control systems (e.g., Git, Azure DevOps).
</li><li>Experience implementing data governance and observability tools.
</li><li>Strategic mindset with the ability to balance technical depth and business impact.
</li></ul><p></p><p><b>Education </b><i>(if blank, degree and/or field of study not specified)
</i></p>Degrees/Field of Study required:
<p></p>Degrees/Field of Study preferred:
<p></p><p><b>Certifications </b><i>(if blank, certifications not specified)
</i></p><p></p><p><b>Required Skills
</b></p><p></p><p><b>Optional Skills
</b></p>Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Analytical Thinking, Apache Hadoop, Azure Data Factory, Coaching and Feedback, Communication, Creativity, Data Anonymization, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling, Data Pipeline, Data Quality, Data Transformation {+ 24 more}
<p></p><p><b>Desired Languages </b><i>(If blank, desired languages not specified)
</i></p><p></p><p><b>Travel Requirements
</b></p>Not Specified
<p></p><p><b>Available for Work Visa Sponsorship?
</b></p>No
<p></p><p><b>Government Clearance Required?
</b></p>No
<p></p><p><b>Job Posting End Date</b></p></div><p></p>

ETIC, Data Engineer, Manager

Codvo.ai

<div><div><div><div><b>Job Title: Data &amp; Databricks Practice Lead</b></div><div><b>
Location: Remote</b></div><div></div><p><b><br>
About Us</b></p><p>
At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.</p><div></div><div><b><br>
Role Summary</b></div><div>
We are looking for a dynamic and visionary Practice Lead to build and scale our Data &amp; AI capabilities with a strong focus on Databricks, Apache Spark, Iceberg, Azure Data Fabric, Amazon EMR, and Redshift. This role is pivotal in driving Lakehouse architecture adoption, cloud-native modernization, and ML engineering across industries such as Oil &amp; Gas, Medtech, Retail CPG, and Fintech.</div><div>
You will lead a cross-functional team of architects, engineers, and ML specialists to deliver high-impact solutions that combine technical excellence, cost efficiency, and governance maturity.</div><div><b>
Key Responsibilities</b></div><div>
Strategic Leadership &amp; Practice Growth</div><ul><li>Define and execute the strategic roadmap for the Data &amp; AI practice, aligning with evolving trends in Lakehouse, cloud-native platforms, and AI engineering.</li><li>Build reusable solution accelerators (e.g., Iceberg ingestion templates, Spark ETL frameworks, MLflow pipelines).</li><li>Establish and manage strategic partnerships with Databricks, AWS, Azure, and other ecosystem players.</li><li>Represent the practice in industry forums, client workshops, and thought leadership initiatives.</li></ul><div>
Technical Architecture &amp; Delivery Oversight</div><ul><li>Architect scalable Lakehouse solutions using Delta Lake or Iceberg, optimized for performance and cost.</li><li>Lead the design of unified batch + streaming pipelines using Spark Structured Streaming and Scala.</li><li>Oversee multi-cloud data platform modernization using Azure Data Fabric, EMR, and Redshift.</li><li>Guide implementation of data governance frameworks using Unity Catalog, Azure Purview, and Iceberg metadata.</li></ul><div>
Team Leadership &amp; Capability Building</div><ul><li>Mentor and grow a high-performing team of data engineers, ML engineers, and platform specialists.</li><li>Define career paths, training plans, and certification goals aligned with Databricks, AWS, and Azure.</li><li>Foster a culture of innovation, experimentation, and continuous improvement.</li></ul><div>
Client Engagement &amp; Business Impact</div><ul><li>Engage with clients to understand business challenges and translate them into scalable data solutions.</li><li>Lead solutioning, proposal development, and delivery for strategic engagements.</li><li>Ensure delivery excellence through performance optimization (Photon, EMR Autoscaling) and cost engineering.</li></ul><div><b>
Required Skills &amp; Experience</b></div><ul><li>10+ years of experience in data engineering, architecture, and platform modernization.</li><li>3+ years of hands-on experience with Databricks, Apache Spark, Iceberg, and Scala.</li><li>Deep expertise in cloud-native data platforms (Azure Data Fabric, Amazon EMR, Redshift).</li><li>Proven track record in building ML pipelines, implementing MLOps (MLflow), and integrating Redshift ML.</li><li>Strong understanding of data governance, observability, and schema evolution.</li><li>Excellent leadership, communication, and stakeholder management skills.</li></ul><div><b>
Preferred Qualifications</b></div><ul><li>Certifications in Databricks, Azure Data Engineering, or AWS Big Data.</li><li>Experience in vertical-specific data solutions (e.g., predictive maintenance in Oil &amp; Gas, real-time analytics in Retail).</li><li>Familiarity with data mesh architectures, time travel, and audit compliance frameworks.</li></ul><div><b>
Why Join Us?</b></div><ul><li>Be at the forefront of Lakehouse innovation and AI-driven transformation.</li><li>Work with cutting-edge technologies and shape the future of data platforms.</li><li>Lead a high-impact practice with global reach and industry relevance.</li></ul></div></div></div><p></p>

Data & Databricks Practice Lead (India - Remote)

Search 10000+ Data engineering lead jobs near you this November. New roles added regularly across leading industries. Apply today.