data engineering lead

ViratLab Advanced Technologies

Job OverviewViratLab Advanced Technologies is looking for an experienced Data Engineering Director to lead our enterprise data infrastructure and analytics initiatives. You will oversee scalable cloud-based data platforms, manage a high-performing engineering team, and drive data strategy across multiple business operations.This is a senior leadership role for someone who combines strong technical expertise with strategic decision-making and team leadership.Responsibilities<ul><li>Lead and manage enterprise data engineering projects</li><li>Build scalable ETL pipelines and cloud data architectures</li><li>Oversee data warehousing, governance, and analytics platforms</li><li>Mentor and lead Data Engineers and Analytics teams</li><li>Collaborate with executive leadership on business intelligence strategy</li><li>Ensure performance, security, and reliability of data systems</li></ul>Qualifications<ul><li>6+ years of experience in Data Engineering or Analytics</li><li>Strong experience with AWS, Azure, Snowflake, Databricks, or similar platforms</li><li>Leadership experience managing technical teams</li><li>Strong knowledge of SQL, Python, cloud infrastructure, and data pipelines</li><li>Excellent communication and stakeholder management skills</li></ul>الراتب المدفوع: QAR٣٠٬٠٠٠٫٠٠&nbsp;لكل شهرموقع العمل: بشكل شخصي

Data Engineering Director

Chubb Insurance

<div>By joining Chubb as Lead Data Engineer for our North America Finance &amp; Actuarial data platform, you'll set the engineering direction for a portfolio of strategic applications &mdash; Atlas, BAR, CDW, Posting, and Regulatory Reporting &mdash; that directly underpin financial, actuarial, claims, and regulatory decision-making across the enterprise. This is a technical leadership role: you'll define and drive engineering standards, architect and implement no-touch data pipelines and integrations, and transform the way our engineering squads deliver by embedding AI-assisted development, modern DevOps practices, and cloud-first design into everything we build. You'll influence and guide a team of data engineers across multiple squads, provide hands-on technical leadership on the most complex initiatives, and serve as the senior engineering voice in cross-functional conversations with architects, platform teams, and business stakeholders. 
Responsibilities Include:
<ul><li>Define and drive the engineering strategy for the Finance &amp; Actuarial data platform, establishing standards, patterns, and best practices across all squads.
</li><li>Architect and implement no-touch, automated data pipelines and integrations that minimize manual intervention, reduce operational risk, and improve reliability at scale.
</li><li>Lead the adoption of AI-assisted development practices &mdash; including AI-augmented code generation, pipeline automation, anomaly detection, and intelligent data quality monitoring &mdash; to accelerate delivery and reduce toil.
</li><li>Provide hands-on technical leadership on high-complexity initiatives, including cloud migration (Azure Synapse / Databricks / Snowflake), ETL modernization, and replatforming efforts.
</li><li>Evaluate and recommend modern tooling, frameworks, and architectural patterns; build the business case and lead adoption across engineering squads.
</li><li>Partner with the data reliability engineering and enhancement squad leads to ensure engineering standards are embedded in day-to-day delivery &mdash; from design through deployment and operations.
</li><li>Establish CI/CD pipelines, automated testing frameworks, and deployment standards that enable consistent, high-quality releases across Atlas, BAR, CDW, Posting, and Regulatory Reporting.
</li><li>Lead root cause analysis and resolution for the most complex data engineering issues, driving permanent fixes over tactical workarounds.
</li><li>Mentor and develop engineers across squads; build a culture of engineering excellence, continuous improvement, and accountability.
</li><li>Translate complex technical strategies into clear communications for executive stakeholders, including the Head of Data, North America, Head of Data Engineering, North America. and senior business leaders.
</li><li>Maintain and evolve technical documentation, architecture decision records, and engineering runbooks as living assets.
</li><li>Stay current on emerging data engineering technologies and bring relevant innovations into the team's delivery model.</li></ul></div>
 <div><ul><li>Bachelor's degree required in Computer Science, Computer Information Systems, Information Systems, Information Technology, Computer Engineering, or equivalent work experience.
</li><li>12+ years of progressive data engineering experience, including hands-on ETL/ELT development, data warehouse design, and enterprise data pipeline delivery.
</li><li>8+ years of experience with ETL development tools and concepts, with deep expertise in Informatica / IICS.
</li><li>5+ years of experience with cloud data platforms including Azure (Synapse Analytics, Azure Data Factory, Azure Databricks) and Snowflake.
</li><li>Strong hands-on proficiency in Databricks (Delta Lake, Spark, notebooks, workflows) and Snowflake (data sharing, Snowpark, dynamic tables).
</li><li>3+ years of experience with job scheduling tools such as Autosys or comparable distributed schedulers.
</li><li>3+ years of scripting experience in Python, Shell, or comparable languages for pipeline automation and tooling.
</li><li>Demonstrated ability to architect and deliver no-touch, fully automated data pipelines in an enterprise environment.
</li><li>Proven track record of driving engineering transformation &mdash; adopting modern practices (CI/CD, infrastructure-as-code, automated testing, AI-assisted tooling) in a large, complex data organization.
</li><li>Strong understanding of data warehousing concepts including dimensional modeling, data lineage, data quality frameworks, and enterprise DW architecture.
</li><li>Experience leading or influencing cross-functional engineering teams; prior people management experience a plus.
</li><li>Excellent communication skills &mdash; able to translate engineering complexity into clear, credible language for both technical teams and executive stakeholders.
</li><li>Insurance industry experience preferred; P&amp;C domain knowledge (financial reporting, actuarial data, claims, regulatory/bureau reporting) a strong plus.
</li><li>Location: must be based in New Jersey or the Greater Philadelphia area.
</li></ul>The pay range for the role is $152,900 to $221,100. The specific offer will depend on an applicant&rsquo;s skills and other factors. This role may also be eligible to participate in a discretionary annual incentive program. Chubb offers a comprehensive benefits package, more details on which can be found on our careers website. The disclosed pay range estimate may be adjusted for the applicable geographic differential for the location in which the position is filled.</div>
 <div><div>Chubb is a world leader in insurance. With operations in 54 countries, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance, and life insurance to a diverse group of clients. The company is distinguished by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength, underwriting excellence, superior claims handling expertise and local operations globally. 
</div><div></div> 
<div>At Chubb, we are committed to equal employment opportunity and compliance with all laws and regulations pertaining to it. Our policy is to provide employment, training, compensation, promotion, and other conditions or opportunities of employment, without regard to race, color, religious creed, sex, gender, gender identity, gender expression, sexual orientation, marital status, national origin, ancestry, mental and physical disability, medical condition, genetic information, military and veteran status, age, and pregnancy or any other characteristic protected by law. Performance and qualifications are the only basis upon which we hire, assign, promote, compensate, develop and retain employees. Chubb prohibits all unlawful discrimination, harassment and retaliation against any individual who reports discrimination or harassment.</div></div>

AVP, Lead Data Engineer

Honor

<div><div>Honor Technology's mission is to change the way society cares for older adults. As a leader in aging care innovation, Honor provides the technology, tools, and services that empower older adults to live life on their own terms. Honor's growing portfolio includes its consumer care brand, Home Instead, Inc., the world's leading provider of in-home care for older adults. With a global franchise network and more than 100,000 Care Pros, Home Instead delivers over 50 million hours of personalized care annually.

Together, Honor and Home Instead are setting a new standard for aging in place, backed by powerful technology, compassionate care, and a commitment to aging on your own terms.

Join us to create a new and better aging experience for our clients, their families, and our Care Professionals.</div><h3 class="jobSectionHeader">
About Us</h3>

Our mission is simple&mdash;we're changing the way we care for our parents so they can live safely at home as they age. But how we accomplish our mission is anything but simple. Every day, we're solving complex problems that don't come with a playbook. Sound exciting? If you're someone who shares our core values&mdash;Own the Outcome, Solve with Empathy, and Act with Honor&mdash;let's talk.

Founded in 2014, Honor is one of the fastest-growing non-medical home care companies in the U.S. We combine innovative technology with the local, personal touch of our partner agencies to transform a $30B industry that touches millions of families. Our platform powers everything from caregiver operations and workforce management to business intelligence, forecasting, and machine learning.

At Honor, we're not building technology for technology's sake. We're building technology that helps people deliver better care.
<h3 class="jobSectionHeader">
The Opportunity</h3>

We're looking for a Staff Data Engineer to help shape the future of Honor's data platform.

This role is focused on building the foundational data platform that powers analytics, machine learning, operational decision-making, and emerging AI capabilities across Honor. As a senior technical leader, you will define architecture, drive platform strategy, and lead the implementation of scalable systems that make trusted data accessible across the organization.

This is an opportunity to join at a pivotal point in our evolution. We are modernizing our data platform, investing in cloud-native AWS services, and building the governance and data access capabilities needed to support the next generation of AI-powered and agentic workflows. You'll tackle complex technical challenges, influence company-wide architecture decisions, and help define how data is consumed across the business.
<h3 class="jobSectionHeader">
What You'll Do</h3>
<h4 class="jobSectionHeader">Build and Evolve Our AWS-Native Data Platform</h4>
<ul><li>Lead the architecture and development of scalable, secure, and cost-efficient data platforms on AWS.</li>
<li>Architect and optimize our Data Warehouse to support growing analytical, operational, and AI-driven workloads.</li>
<li>Define and implement Infrastructure-as-Code standards using AWS CDK.</li>
</ul><h4 class="jobSectionHeader">Own Data Orchestration and Data Engineering Foundations</h4>
<ul><li>Design and operate scalable orchestration frameworks using Airflow and FiveTran.</li>
<li>Partner with the Data Analytics team to establish data modeling standards and transformation practices using dbt.</li>
<li>Build reusable, maintainable data pipelines and workflows that enable rapid development and reliable operation.</li>
</ul><h4 class="jobSectionHeader">Enable Trusted Data Access Through Governance and AI Readiness</h4>
<ul><li>Establish governance, metadata, lineage, and access patterns that make data discoverable, trustworthy, and easy to use.</li>
<li>Help define how both employees and AI-powered systems safely access and leverage company data.</li>
<li>Build the foundations that enable self-service analytics and future agentic workflows across the organization.</li>
</ul><h4 class="jobSectionHeader">Drive Reliability, Observability, and Operational Excellence</h4>
<ul><li>Establish monitoring, alerting, and observability standards using Datadog and modern platform engineering practices.</li>
<li>Build scalable data quality frameworks that ensure confidence in business-critical data.</li>
<li>Continuously improve platform reliability, performance, and cloud cost efficiency.</li>
</ul><h4 class="jobSectionHeader">Lead Through Technical Influence and Partnership</h4>
<ul><li>Partner closely with Data Science, Analytics, Product, and Engineering teams to solve complex business problems through data.</li>
<li>Provide technical leadership, architectural guidance, and mentorship across the data organization.</li>
<li>Influence long-term platform strategy and engineering best practices across multiple teams.</li>
</ul><h3 class="jobSectionHeader">What We're Looking For</h3>
<ul><li>8&ndash;10+ years of experience building and operating large-scale data platforms, pipelines, and warehouses in cloud environments, with deep expertise in AWS.</li>
<li>Proven track record leading complex technical initiatives and influencing architecture across teams.</li>
<li>Strong software engineering fundamentals and experience building production-grade systems.</li>
<li>Deep expertise in modern data warehousing, ELT/ETL architectures, and data platform design.</li>
<li>Experience operating data platforms with a focus on reliability, observability, data quality, and cost optimization.</li>
<li>Proven ability to leverage modern AI-assisted and agentic development tools to architect, build, and operate production-grade systems.</li>
<li>Experience partnering with data scientists, analysts, product managers, and software engineers to deliver business impact.</li>
<li>Demonstrated ability to navigate ambiguity, drive alignment, and lead through influence rather than authority.</li>
<li>Passion for building platforms that empower others and scale organizational impact.</li>
</ul><h3 class="jobSectionHeader">Preferred Qualifications</h3>
<ul><li>Strong hands-on experience with Python, Amazon Redshift, AWS-native ETL technologies (including ZeroETL and DMS), Airflow, dbt, Datadog, Fivetran, and AWS CDK.</li>
<li>Experience designing data governance, metadata, lineage, or self-service data platforms.</li>
<li>Experience supporting AI, machine learning, or agentic workflow initiatives.</li>
<li>Experience leading platform modernization efforts in high-growth environments.</li>
<li>Experience as a Staff Engineer, Principal Engineer, Technical Lead, or Engineering Manager.</li>
</ul><h3 class="jobSectionHeader">What's Next?</h3>

Sound like a fit? Apply below!

#LI-AN1<div>
At Honor, we put people first. Our leadership culture is guided by Leadership Principles that prioritize integrity, compassion, and excellence. We offer a unique opportunity to lead with purpose and make a meaningful impact no matter your role.

Honor is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy), national origin, age, disability, genetic information, political affiliation or belief.</div></div>

Staff Data Platform Engineer

The Hartford

<div><h2 class="jobSectionHeader">Job Details</h2>
<div><div><div>Location:</div>
<div>Hartford, CT</div>
</div><div><div>Category:</div><div>
Data Engineering</div>
</div><div><div>Employment Type:</div>
<div>Full time
</div></div><div><div>Job Ref:</div><div>
R2625593-168</div>
</div></div><div><div>Sr Staff Data Engineer - GE07DE
We&rsquo;re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals &ndash; and to help others accomplish theirs, too. Join our team as we help shape the future. 
Join our team as a Senior Staff AI Data Engineer and lead the charge in developing cutting-edge AI solutions and data engineering strategies. Embrace our core values of innovation, collaboration, and excellence as you unlock unparalleled growth opportunities in the dynamic field of AI and data engineering. Shape the future of technology with us! Apply now to be part of our innovative journey and make a significant impact!
This role will have a Hybrid work schedule, with the expectation of working in an office location (Hartford, CT; Chicago, IL; Columbus, OH; and Charlotte, NC) 3 days a week (Tuesday through Thursday).
Primary Job Responsibilities<ul><li>
Lead the implementation of AI data pipelines integrating structured, semi-structured, and unstructured data to support AI and agentic solutions, including preprocessing techniques such as extraction, chunking, embedding, and grounding (e.g., RAG, retrieval frameworks)</li><li>
Develop AI-driven data systems that enhance data capabilities while ensuring adherence to industry best practices</li><li>
Implement and optimize Retrieval-Augmented Generation (RAG) architectures and integrate them with enterprise data platforms</li><li>
Design, build, and optimize scalable batch and streaming data pipelines with a focus on performance, resiliency, and operational efficiency</li><li>
Develop and maintain real-time data streaming pipelines using technologies such as Snowpipe</li><li>
Develop data domains and data products to support reporting, analytics, AI/ML, and data science use cases</li><li>
Ensure the reliability, availability, and scalability of data pipelines through monitoring, alerting, and incident management</li><li>
Implement reliability engineering best practices, including fault tolerance, redundancy, and disaster recovery</li><li>
Drive engineering discipline across data platforms, including observability, data quality, lineage, and governance</li><li>
Collaborate with DevOps and infrastructure teams to enable seamless deployment and operation of data systems</li><li>
Partner with cross-functional teams to integrate data and AI solutions into business processes and enterprise systems</li><li>
Provide architectural leadership in partnership with Data Architects, including defining technical standards and influencing enterprise-wide practices</li><li>
Develop and integrate graph database solutions to support complex data relationships within AI systems</li><li>
Apply GenAI approaches to insurance-specific data use cases and challenges</li><li>
Lead the development of AI-ready data foundations that support scalable, production-grade solutions</li><li>
Ensure data platforms remain resilient, governed, and cost-efficient, aligned with enterprise cloud and data strategies</li><li>
Mentor junior engineers and contribute to communities of practice, promoting best practices, reusable patterns, and engineering standards</li><li>
Stay current with advancements in GenAI and apply relevant technologies and methodologies to platform evolution</li></ul>
Skills<ul><li>
Strong technical expertise in AI-driven data solutions leveraging modern cloud platforms</li><li>
Deep expertise in core data engineering, including advanced SQL, data modeling, and query performance tuning</li><li>
Strong experience in ETL/ELT architecture, orchestration frameworks, and pipeline optimization</li><li>
Experience working across teams with strong communication and stakeholder management skills</li><li>
Proven ability to mentor and develop AI and data engineering talent</li><li>
Knowledge of emerging AI and data engineering design patterns</li><li>
Strong planning, organization, and execution capabilities</li><li>
Ability to lead in a lean, agile, and fast-paced environment, leveraging Scaled Agile practices</li><li>
Strong analytical and problem-solving skills with the ability to translate business requirements into technical solutions</li><li>
Demonstrated leadership capability to own architecture decisions and drive cross-team alignment</li><li>
Effective collaboration, decision-making, and relationship-building skills</li><li>
Strong interpersonal skills with the ability to provide thought leadership in a dynamic environment</li></ul>
Qualifications<ul><li>
Candidates must be authorized to work in the US without company sponsorship. The company will not support the STEM OPT I-983 Training Plan endorsement for this position.</li><li>
Bachelor&rsquo;s degree in Computer Science, Artificial Intelligence, or a related field</li><li>
8+ years of data engineering experience with deep expertise in SQL, data modeling, and large-scale data processing systems</li><li>
Proven experience designing and optimizing ETL/ELT pipelines and orchestration frameworks in enterprise environments</li><li>
Experience supporting Generative AI data engineering use cases</li><li>
Hands-on experience implementing production-ready, enterprise-grade GenAI data solutions</li><li>
Experience implementing RAG pipelines, including retrieval, chunking, embedding, and grounding techniques</li><li>
Experience operationalizing GenAI pipelines in production environments</li><li>
Hands-on experience with cloud ecosystems (AWS, GCP, Azure, Snowflake) and Python-based data engineering stacks</li><li>
Proven ability to deliver resilient, governed, and cost-efficient data platforms at scale</li><li>
Experience with vector databases and graph databases, including design and optimization</li><li>
Experience working with unstructured data for GenAI applications</li><li>
Experience implementing data governance practices, including data quality, lineage, and data cataloging at scale</li><li>
Proficiency in building AI data pipelines that integrate structured and unstructured data with preprocessing techniques</li><li>
Strong programming skills in Python</li><li>
Strong communication skills and ability to explain technical concepts to a broad set of stakeholders</li></ul>
Preferred Qualifications<ul><li>
Experience designing multi-cloud or hybrid AI data solutions</li><li>
AI-related certifications</li><li>
Experience in the P&amp;C insurance industry</li><li>
Contributions to open-source AI projects or research in Generative AI</li></ul>
Compensation
The listed annualized base pay range is primarily based on analysis of similar positions in the external market. Actual base pay could vary and may be above or below the listed range based on factors including but not limited to performance, proficiency and demonstration of competencies required for the role. The base pay is just one component of The Hartford&rsquo;s total compensation package for employees. Other rewards may include short-term or annual bonuses, long-term incentives, and on-the-spot recognition. The annualized base pay range for this role is:
$135,040 - $202,560
Equal Opportunity Employer/Sex/Race/Color/Veterans/Disability/Sexual Orientation/Gender Identity or Expression/Religion/Age</div></div></div>

Senior Staff AI Data Engineer - Hybrid

Capital One

<div>Lead Data Engineer
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 4 years of experience in application development (Internship experience does not apply)</li><li>
At least 2 years of experience in big data technologies</li><li>
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)</li></ul>
Preferred Qualifications:<ul><li>
7+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
4+ year experience working on real-time data and streaming applications</li><li>
4+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
4+ years of data warehousing experience (Redshift or Snowflake)</li><li>
4+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li><li>
Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities beyond basic code completion</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
Sales Territory: $179,400 - $204,700 for Lead Data Engineer 

New York, NY: $215,200 - $245,600 for Lead Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</div>

Lead Data Engineer

Shell Energy Retail

<div>Texas, United States of America 
 
Job Family Group:
Information Technology (IT) 
 
Worker Type:
Regular 
 
Posting Start Date:
June 11, 2026 
 
Business Unit:
Projects and Technology 
 
Experience Level:
Experienced Professionals 
 
Job Description:
What&rsquo;s the role
Shell is seeking a Sr. AI &amp; Data Engineer &ndash; Trading Analytics (also known internally as Data Engineering Lead) to join its team in Houston, TX. This role is ideal for an AI Engineer with a strong foundation in data engineering who can design and deliver AI-driven front-office analytics and GenAI/agentic solutions, collaborating closely with traders and trading analysts.
Shell Trading &amp; Supply is one of the world&rsquo;s leading energy and commodity trading organizations, operating across crude, refined products, gas, LNG, power, and environmental products. Trading sits at the heart of Shell&rsquo;s energy transition, requiring rapid, data‑driven decision making under complex market conditions. Within Trading &amp; Supply, the Crude &amp; Products business plays a critical commercial role, operating in highly regulated, fast‑moving markets where high‑quality analytics, data engineering, and AI are key competitive differentiators. Our focus is to deliver secure, reliable, and trader‑centric digital solutions that simplify workflows, enhance insight, and drive commercial value without compromising risk, safety, or controls.
As a Sr. AI &amp; Data Engineer in Trading Analytics, you will work directly with front‑office teams to design, build, and productionize AI‑driven analytics over market pricing and fundamental data. You will combine Databricks‑based data engineering, statistical and econometric techniques, and modern GenAI/agentic workflows to deliver insight at speed. This is a hands‑on individual contributor role with a strong bias toward practical delivery. You will operate in a high‑touch, hybrid model, iterating rapidly with users on‑desk, while engineering solutions to production‑grade standards using modern CI/CD and governance practices. Also, this role is rapid prototyping, iterative learning, and incremental production hardening, balanced with adherence to engineering, security, and governance frameworks to maintain speed and reliability.
Accountabilities:
Front‑Office Analytics &amp; Insight
<ul><li>Design, build, and deliver AI‑driven analytics for traders and analysts, including seasonality analysis, correlation studies, regression models, forecasting, and scenario modelling over market pricing and fundamentals data
</li><li>Work closely with traders and analysts to translate ambiguous business questions into clear analytical problem statements and working solutions
</li><li>Clearly communicate analytical outputs and AI‑generated insights to commercial stakeholders in a concise and actionable manner
</li></ul>Data Engineering &amp; Platforms
<ul><li>Build and maintain scalable, reusable data pipelines on Databricks using PySpark/Spark, SQL, Delta Lake, and Unity Catalog
</li><li>Support ingestion, modelling, and transformation of large‑scale time‑series pricing and fundamentals datasets
</li><li>Optimize pipelines for performance, reliability, and cost efficiency, following platform and data governance standards
</li></ul>AI, GenAI &amp; Agentic Solutions
<ul><li>Build and enhance GenAI and agent‑based solutions to support trading analytics, including:
<ul><li>Retrieval‑Augmented Generation (RAG)
</li><li>Prompt engineering
</li><li>Agent orchestration using frameworks such as LangGraph
</li><li>Tool calling and guardrails
</li></ul></li><li>Integrate LLM‑based workflows with structured trading and market data to augment analysis, insight generation, and decision support
</li><li>Prototype solutions quickly, gather user feedback, and help harden selected use cases for production deployment
</li></ul>Production, Quality &amp; Operations
<ul><li>Contribute to production‑ready analytics and AI solutions with testing, documentation, versioning, and basic observability
</li><li>Follow established CI/CD and DevOps practices, including use of Git‑based workflows and automated testing
</li><li>Support governance requirements such as PII handling, data lineage, and auditability in line with Trading &amp; Supply standards
</li></ul>What you bring
<ul><li>Must have legal authorization to work in the US on a full-time basis for anyone other than current employer
</li><li>Bachelor&rsquo;s degree or equivalent relevant years of experience
</li><li>At least 7 years of relevant experience
</li><li>Hands‑on experience with Databricks and/or Spark (PySpark, SQL, Delta Lake; Unity Catalog desirable)
</li><li>Proven data engineering skills, including pipeline development, data modelling, and performance optimization
</li><li>Solid foundation in statistics, econometrics, or data science, with experience applying these techniques to time‑series or market‑style datasets
</li><li>Practical experience building or contributing to LLM‑based solutions, including prompt engineering and retrieval‑based approaches
</li><li>Familiarity with GenAI frameworks and tooling (e.g., LangGraph or similar orchestration patterns)
</li><li>Experience working in collaborative engineering teams using Git and CI/CD pipelines
</li><li>Strong communication skills and the ability to work directly with analysts, traders, and other business stakeholders
</li></ul>Additional Preferred Qualifications
<ul><li>Exposure to commodity or financial trading environments
</li><li>Understanding of market fundamentals, supply‑demand dynamics, or risk concepts
</li><li>Experience with MLflow, feature stores, or vector databases
</li><li>Familiarity with working in regulated or risk‑sensitive environments
</li></ul>What we offer
The base salary range for this position is $149,000 - $223,000 per year . Individual pay will be based on various factors, such as relevant work experience, education, certifications, skill level, seniority, and internal equity.
For regular full-time or regular part-time employees of the Company (participating companies as listed in the Summary Plan Description), insurance coverage options include medical, dental, vision coverage, life Insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs. Employees also participate in a company pension plan and a 401(k) plan. Paid leave includes up to 6 weeks of paid vacation time, up to 11 paid holidays, and parental leave offering 16 weeks of paid leave for birthing parents, and 8 weeks of paid leave for non-birthing parents.
Additionally, employees are eligible for short-term disability leave for up to 26 weeks at 100% or 50% of base pay as well as Long-Term Disability insurance. Shell also offers other compensation such financial reimbursement for adoption, wellness, education, and personal learning expenses, and some roles are eligible for discretionary long-term incentives. For interns, eligible benefits include medical, dental, and vision coverage, life insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs; participation in a 401(k) plan; and paid leave for up to 11 paid holidays. Additional information on Shell&rsquo;s US benefit programs can be found at https://www.shell.us/careers/about-careers-at-shell/rewards-and-benefits.html .
You bring your skills and experience to Shell and in return you work with talented, committed people on one of the most important challenges facing our planet. You&rsquo;ll have the opportunity to develop the skills you need to grow in an environment where we value honesty, integrity, and respect for one another. You&rsquo;ll be able to balance your priorities as you become the best version of yourself.
<ul><li>Progress as a person as we work on the energy transition together
</li><li>Continuously grow the transferable skills you need to get ahead
</li><li>Work at the forefront of technology, trends, and practices
</li><li>Collaborate with experienced colleagues with unique expertise
</li><li>Achieve your balance in a values-led culture that encourages you to be the best version of yourself
</li><li>Benefit from flexible working hours, and the possibility of remote/mobile working
</li><li>Perform at your best with a competitive starting salary and annual performance related salary increase &ndash; our pay and benefits packages are considered to be among the best in the world.
</li><li>Take advantage of paid parental leave, including for non-birthing parents
</li><li>Join an organization working to become one of the most diverse and inclusive in the world. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation, and life experiences to apply
</li><li>Grow as you progress through diverse career opportunities in national and international teams
</li><li>Gain access to a wide range of training and development programs
</li></ul>We'd like you to know that Shell has a bold goal: to become one of the world&rsquo;s most diverse and inclusive companies. You can get to know more about how we're working towards that goal, click here .
Shell in The United States
Shell has been in the US for more than 100 years, leading the sector in energy, petrochemicals and refined products. Today, we provide millions of Americans with the energy needed to heat and cool their homes and power the economy.
We operate in all 50 states, from our Deepwater platforms in the Gulf of America to the Pennsylvania Chemicals complex and our miles of pipelines throughout the US.
We reach our customers through our 13,000 branded retail stations, and we are number 1 in gasoline sales. We also own the #1 brand of motor oil in the U.S. &ndash; Pennzoil&reg; &ndash; made from natural gas.
We are excited to play a key role in the move to net carbon emissions while providing the oil and gas needed by society for many decades to come.
<ul><li>- 
</li></ul> 
DISCLAIMER:
Please note: We occasionally amend or withdraw Shell jobs and reserve the right to do so at any time, including prior to the advertised closing date. Before applying, you are advised to read our data protection policy. This policy describes the processing that may be associated with your personal data and informs you that your personal data may be transferred to Shell/Shell Group companies around the world. The Shell Group and its approved recruitment consultants will never ask you for a fee to process or consider your application for a career with Shell. Anyone who demands such a fee is not an authorised Shell representative and you are strongly advised to refuse any such demand. Shell participates in E-Verify. All qualified applicants will receive consideration for employment without regard to race, color, sex, national origin, age, religion, disability, sexual orientation, gender identity, protected veteran status, citizenship, genetic information or other protected status under federal, state or local laws. Shell is an Equal Opportunity Employer - Minorities/Females/Veterans/Disability. As a US Federal Contractor, hiring selections are subject to periodic audit review and documentation of your selections should be maintained for a period of three calendar years. It is the policy of Shell in the U.S. (&ldquo;Shell&rdquo;) to provide equal opportunity to all individuals, employees and all qualified applicants for employment consistent with employment requirements and qualifications. Shell prohibits discrimination based on race, color, sex, national origin, age, religion, disability, sexual orientation, gender identity, veteran status, citizenship, genetic information, or other protected status under federal, state or local laws. All employees are expected to support this policy and contribute to an environment of equal opportunity. If you need an accommodation for a disability during the resourcing process, please speak with an HR representative.</div>

Sr. AI & Data Engineer–Trading Analytics

LocationLab Systems & Analytics

Chief Technology Officer (CTO) &ndash; Location Intelligence &amp; Data SystemsAbout the OpportunityWe are seeking an exceptional Chief Technology Officer (CTO) to lead the technology vision of a fast-growing Location Intelligence and Analytics company. This is a high-impact leadership role where you will define architecture, scale engineering teams, and drive innovation in geospatial analytics, AI-driven insights, and data platforms.If you are passionate about building scalable systems, leading high-performance teams, and shaping the future of location-based intelligence, this role offers the opportunity to make a strategic impact at the executive level.What You&rsquo;ll Do<ul><li>Define and lead the overall technology strategy and roadmap</li><li>Architect scalable, cloud-based data and geospatial platforms</li><li>Oversee development of analytics, AI, and location intelligence systems</li><li>Lead engineering, data science, and product technology teams</li><li>Ensure security, performance, and reliability across all systems</li><li>Collaborate with executive leadership on product direction and growth strategy</li><li>Evaluate and implement emerging technologies in AI, GIS, and big data</li><li>Manage technical budgeting, vendor selection, and infrastructure scaling</li></ul>What We&rsquo;re Looking For<ul><li>Proven experience as CTO, VP Engineering, or senior technical leader</li><li>Strong background in cloud computing (AWS, Azure, or GCP)</li><li>Experience with GIS, geospatial systems, or location-based platforms</li><li>Deep understanding of data engineering, AI/ML systems, and distributed architecture</li><li>Proven ability to scale engineering teams in fast-growing environments</li><li>Strong leadership, communication, and strategic thinking skills</li><li>Experience working in SaaS, analytics, or enterprise tech environments</li></ul>Why This Role Is ExcitingThis is a rare opportunity to lead the technology direction of a company operating at the intersection of AI, data analytics, and location intelligence. You will have full influence over architecture decisions, product scalability, and long-term technical strategy in a high-growth environment.Call to ActionIf you're ready to build and lead cutting-edge technology at scale, we encourage you to apply today. We are actively interviewing top-tier candidates.Pay: QAR35,000.00 - QAR70,000.00 per monthWork Location: In person

Chief Technology Officer (CTO)

Search 10000+ Data engineering lead jobs near you this June. New roles added regularly across leading industries. Apply today.