lead data engineer

National Grid

<div><div><div><div><h3 class="jobSectionHeader">About us</h3></div><div>
At National Grid, we keep people connected and society moving. But it&rsquo;s so much more than that National Grid supplies us with the environment to make it happen. As we generate momentum in the energy transition for all, we don&rsquo;t plan on leaving any of our customers in the dark. So, join us as a Lead Data Engineer and find your superpower.
We want to find an innovative, adaptable, and results-oriented Lead Data Engineer for our IT &amp; Digital department. This position can be located in Waltham, MA, Brooklyn, NY, or Syracuse, NY (candidates may also reside in either Connecticut, New Jersey, New Hampshire, Pennsylvania, Rhode Island, Vermont, Maine or the UK). If you yearn to be innovative, contribute new ideas, and play a critical part on our team, we want to hear from you!
National Grid is hiring a Lead Data Engineer for our IT and Digital team. This role is designated as hybrid, with an expectation of one or two days per month in one of our offices. Requirements may vary based on business needs and company policy.
</div></div><div><div><h3 class="jobSectionHeader">Job Purpose</h3></div><div>
As Lead Data Engineer, you will shape Customer Domain data capabilities to meet business objectives. You will lead the design and implementation of Customer Data solutions, provide technical guidance for related programs and products, and oversee end-to-end development of the Customer data platform.</div></div><div><div><h3 class="jobSectionHeader">
Key Accountabilities</h3></div><div><div>
Set the Data &amp; AI Strategy 
<ul><li>Execute and evolve a multi-year data, analytics, and AI strategy aligned to National Grid Enterprise architecture team to support digital priorities</li><li>Continuously adapt the strategy as technology and AI capabilities evolve to maximize value realization</li><li>Establish a federated data and analytics model that enables speed, consistency, and business ownership</li></ul> 

Enable Trusted, Governed Data 
<ul><li>Lead data governance, quality, and stewardship in partnership with IT and business leaders</li><li>Ensure data is accessible, reliable, secure, and compliant with regulatory, privacy, and cybersecurity requirements</li><li>Co-lead a Data Governance Council that drives accountability and standards</li></ul> 

Deliver Analytics, AI &amp; Business Insight 
<ul><li>Oversee development of analytics, reporting, machine learning, and AI solutions that deliver actionable insight</li><li>Advance predictive and prescriptive analytics to support safety, asset health, leak detection, capital planning, and workforce optimization</li><li>Guide responsible adoption of Generative AI and automation to improve productivity and decision-making</li></ul> 

Translate Data into Business Value 
<ul><li>Serve as a trusted partner to executives and business leaders&mdash;translating complex data into clear, compelling insights</li><li>Lead enterprise dashboards, KPIs, and performance reporting tied to safety, reliability, efficiency, and customer outcomes</li><li>Build self-service analytics capabilities and data literacy across the organization</li></ul> 

Lead People &amp; Change 
<ul><li>Build, lead, and develop a high-performing team of data scientists, engineers, analysts, and visualization experts</li><li>Foster a culture of curiosity, innovation, and continuous improvement</li><li>Partner closely with Process Improvement, Change Management, and IT to ensure adoption and sustained impact</li></ul></div></div></div><div><div><h3 class="jobSectionHeader">
Qualifications</h3></div><div>
Key Skills &amp; Technologies
Programming: Python, SQL<ul><li>.</li>
Cloud Platforms: Azure (Preferred), AWS, Google Cloud (GCP)<li>.</li>
Databases &amp; Warehouses: Snowflake, SQL/NoSQL databases<li>.</li>
Tools: Matillion, CDC (Qlik, SSIS), Power B<li>i</li></ul>
Required
Bachelor&rsquo;s or master&rsquo;s degree in data science, Computer Science, Analytics, Engineering, Information Systems, or related field is preferre<ul><li>d</li>
10+ years of experience leading data, analytics, or AI initiatives in complex organization<li>s</li>
5+ years of people leadership experienc<li>e</li>
Proven expertise in enterprise data strategy, analytics, and governanc<li>e</li>
Strong technical fluency across data platforms, analytics tools, and AI/ML concept<li>s</li>
Ability to influence senior leaders and translate technical concepts for non-technical audience<li>s</li></ul>
Preferred
Utility, energy, or infrastructure industry experienc<ul><li>e</li>
Advanced degree or relevant certifications (AI/ML, cloud, data engineering<li>)</li>
Familiarity with Agile/Scrum and formal change management methodologie<li>s</li></ul>
How You&rsquo;ll Work
Highly collaborative, enterprise-facing leadership rol<ul><li>e</li>
Hybrid with strong partnership across Operations, IT, Process Improvement, and executive leadershi<li>p</li></ul>
Don&rsquo;t meet every single requirement? Studies have shown that women and people of colour are less likely to apply for jobs unless they meet every single qualification. At National Grid, we are committed to building a diverse, inclusive, and authentic workplace for everyone. So, if you&rsquo;re excited about this role but your experience or qualifications don&rsquo;t match the job description exactly, we encourage you to apply anyway. You might just be the right person for our growing business in this role or another one.
#LI-MB2
#LI-HYBRID</div></div></div>
Salary
Waltham: $142,000 - $166,000 a year
Brooklyn: $152,000 - $178,000 a year
Syracuse: $126,000 - $148,000 a year
National Grid utilizes an assessment that evaluates the job qualifications/characteristics using AI or statistically based scoring. For more information, please view NYC Local Law 144.
This position has a career path which provides for advancement opportunities within and across bands as you develop and evolve in the position; gaining experience, expertise and acquiring and applying technical skills. Candidates will be assessed and provided offers against the minimum qualifications of this role and their individual experience.
National Grid is committed to providing equal employment opportunities to all employees and applicants for employment regardless of protected class. We do not discriminate on the basis of race, color, religion, sex (including pregnancy, gender identity, and sexual orientation), national origin, age, disability, genetic information, or any other protected status in accordance with applicable federal, state, and local laws. National Grid maintains affirmative action programs for individuals with disabilities and protected veterans.
Our employment practices are designed to ensure that all individuals are treated fairly and with respect throughout the hiring process and during employment. National Grid complies with all applicable federal, state, and local anti-discrimination laws. We are dedicated to fostering a workplace that is free from unlawful discrimination and harassment, and we encourage a culture of respect for all.</div>

Lead Data Engineer

ACR Technology Inc

We&rsquo;re Hiring: Lead Data EngineerLocation: California, USA (Bay Area &ndash; Local Candidates Only) - OnsiteEmployment Type: W2 Only - NO H1Experience: 6+ Years of Genuine Hands-on Experience RequiredWe are seeking an experienced, hands-on Senior Data Engineer to design, build, and scale modern data platforms supporting enterprise analytics, business intelligence, and healthcare data integrations.This role involves working with SQL Server, Azure, Databricks, Snowflake, and Python in real-world production environments, with a strong focus on cloud modernization and scalable data architecture.Key Responsibilities:-Design and maintain scalable ETL/ELT pipelines across cloud platformsLead migration of on-prem SQL Server workloads to Azure (ADF, Synapse, ADLS, Fabric)Architect and optimize data warehouses, data marts, and lakehouse architecturesWork with healthcare data systems (EHR, HL7, FHIR, HIPAA-compliant environments)Develop integrations using REST APIs, CDC, and event-driven architecturesImplement dimensional modeling and performance tuning strategiesBuild batch and streaming pipelines using Spark and KafkaCollaborate with BI, ML, and business stakeholdersEstablish monitoring, data quality checks, and CI/CD processesCore Skills:-Advanced SQL and performance tuningAzure (ADF, Synapse, Azure SQL, ADLS, Fabric)Databricks, Snowflake, BigQueryPython (PySpark), ScalaSpark (batch &amp; streaming), KafkaETL tools (ADF, SSIS, Airflow, dbt)BI tools (Power BI preferred)DevOps and data governance best practicesNice to have: Healthcare domain experience, Databricks administration, real-time architecture experience, ML pipeline exposure.Interested candidates (local to Bay Area only, with 6+ years of genuine experience) may share their resume at:devang@acrtechnology.comPay: $55.00 - $65.00 per hourWork Location: In person

EARTH & ESTATES LLP

We&rsquo;re Hiring: Lead Data Engineer Location: California, USA (Bay Area &ndash; Local Candidates Only) Employment Type: W2 Only (All Visas Accepted Except H1) Experience: 6+ Years of Genuine Hands-on Experience RequiredWe are seeking an experienced, hands-on Senior Data Engineer to design, build, and scale modern data platforms supporting enterprise analytics, business intelligence, and healthcare data integrations. This role involves working with SQL Server, Azure, Databricks, Snowflake, and Python in real-world production environments, with a strong focus on cloud modernization and scalable data architecture.Key Responsibilities:-Design and maintain scalable ETL/ELT pipelines across cloud platformsLead migration of on-prem SQL Server workloads to Azure (ADF, Synapse, ADLS, Fabric)Architect and optimize data warehouses, data marts, and lakehouse architecturesWork with healthcare data systems (EHR, HL7, FHIR, HIPAA-compliant environments)Develop integrations using REST APIs, CDC, and event-driven architecturesImplement dimensional modeling and performance tuning strategiesBuild batch and streaming pipelines using Spark and KafkaCollaborate with BI, ML, and business stakeholdersEstablish monitoring, data quality checks, and CI/CD processesCore Skills:-Advanced SQL and performance tuningAzure (ADF, Synapse, Azure SQL, ADLS, Fabric)Databricks, Snowflake, BigQueryPython (PySpark), ScalaSpark (batch &amp; streaming), KafkaETL tools (ADF, SSIS, Airflow, dbt)BI tools (Power BI preferred)DevOps and data governance best practicesInterested candidates (local to Bay Area only, with 6+ years of genuine experience) may share their resume at:devang@acrtechnology.comJob Types: Full-time, ContractPay: $55.00 - $65.00 per hourWork Location: In person

American Red Cross

<div><h1 class="jobSectionHeader">Please use Google Chrome or Mozilla Firefox when accessing Candidate Home.</h1><h1 class="jobSectionHeader">
By joining the American Red Cross you will touch millions of lives every year and experience the greatness of the human spirit at its best. Are you ready to be part of the world's largest humanitarian network?</h1><h1 class="jobSectionHeader">
Join us&mdash;Where your Career is a Force for Good!</h1>
Job Description:
WHY CHOOSE US? 
Joining The American Red Cross is like nothing else &ndash; it&rsquo;s as much something you feel as something you do. You become a vital part of the world&rsquo;s largest humanitarian network. Joining a team of welcoming individuals who are exceptional, yet unassuming. Diverse, yet uncompromising in unity. You grow your career within a movement that matters, where success is measured in people helped, communities made whole, and individuals equipped to never stop changing lives and situations for the better. 
 
When you choose to be a force for good, you&rsquo;ll have mentors who empower your growth along a purposeful career path. You align your life&rsquo;s work with an ongoing mission that&rsquo;s bigger than all of us. As you care for others, you&rsquo;re cared for with competitive compensation and benefits. You join a community that respects who you are away from work as much as what you do while at work. 
 
WHAT YOU NEED TO KNOW ABOUT THE JOB: 
The Enterprise Data &amp; Analytics Team is a full-stack Data Engineering team supporting mission-transforming work through data at the American Red Cross. As a result, we are hiring a Lead Data Engineer for one of our highly dynamic product teams to help do this exciting work! 
 
As a Lead Data Engineer for the American Red Cross, you will be part of our Enterprise Data Analytics team that is modernizing and transforming our data and reporting capabilities across multiple verticals by implementing a new modernized data architecture and technical stack. 
 
The Lead Data Engineer will help develop, test, maintain and support an enterprise data warehouse system and corresponding data and will be responsible for database design and implementation of agreed upon standards. This position requires an innovative engineer who is passionate about data, data quality and automation. The ideal candidate will possess strong data warehousing experience and the ability to develop and deploy scalable data pipelines that make data management and analytics/reporting faster, more insightful, and more efficient. 
 
This is a fully remote position that can work from home within the United States. You must be available five days per week during designated East Coast work hours. Some travel will be required to attend in-person meetings.<div> 
WHERE YOUR CAREER IS A FORCE FOR GOOD (Key Responsibilities): 
<ul><li>Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision making across the organization.</li><li>Build and implement scalable solutions that align to our data governance standards and architectural roadmap for data integrations, data storage, reporting, and analytic solutions.</li><li>Design, develop, and test data integration solutions. Write, automate and document unit/integration/functional tests.</li><li>Manage automated deployments using Git pipelines, ensuring code changes are efficiently version-controlled and deployed.</li><li>Collaborate with multiple teams to streamline deployment workflows, monitor and troubleshoot pipelines for reliability and performance.</li><li>Perform data analysis required to troubleshoot data-related issues by building a data quality framework and assist in the resolution of data issues.</li><li>Serve as tech lead by mentoring less experienced members of the team through code reviews, pair programming and similar hands-on interactions.</li></ul> 

Scope: Individual contributor that works under limited supervision. Apply subject matter knowledge. Capacity to understand specific needs or requirements to apply skills/knowledge. 
 
Qualified candidates must be authorized to work in the United States. The American Red Cross does not sponsor employment visas. 
 
WHAT YOU NEED TO SUCCEED (required/minimum qualifications): 
<ul><li>Education*: 4-year college degree or equivalent combination of education and experience. Prefer academic backgrounds in Computer Science, Engineering, Mathematics, or related technical field.</li><li>10 years of relevant work experience in data engineering, business intelligence or related field.</li><li>Experience with cloud-based databases, specifically AWS technologies (e.g., Redshift (preferred), RDS, S3, EC2, EKS, Zero ETL)</li><li>Advanced experience using SQL queries as well as writing and optimizing SQL queries in a business environment with large-scale, complex datasets.</li><li>Experience with a variety of database technologies and data warehouse schema design patterns (snowflake and star in particular).</li><li>Proficient in object-oriented programming (current hands on coding experience in Python is required).</li><li>Excellent data analysis and problem-solving skills.</li><li>Experience with DevOps methodologies and tools (e.g., Git, Artifactory, etc.).</li><li>Proficient in use of AI (Gitlab Duo, Gemini, or similar) for coding efficiency.</li><li>Experience in daily Engineering operations, support, and issue resolution.</li><li>Experience with Agile software development methodologies.</li></ul></div><ul><li>Self-motivated with the ability to work independently and as part of a team</li><li>Strong professionalism, interpersonal, written/verbal communication, and problem-solving skills.</li></ul><div> 
WHAT WILL GIVE YOU THE COMPETITIVE EDGE (Preferred Qualifications): 
<ul><li>Experience with Informatica (Power Center, IDMC, IDQ, MFT) or similar software solutions is preferred.</li><li>Apache Airflow, Mage, or similar orchestration service experience desired.</li><li>AWS services (S3, Postgres, IAM) experience desired.</li></ul></div><ul><li>Experience with DBT is preferred.</li><li>A sense of unparalleled passion, energy, and eagerness to contribute to and support the mission of the Red Cross.</li></ul> 
<ul><li>Combination of candidate&rsquo;s education and general experience satisfies requirements so long as the total years equate to description&rsquo;s minimum education and general experience years combined (Management experience cannot be substituted).</li></ul> 
+++++++++++++++++++++++++++++ 
PAY INFORMATION: The annual salary range for this position is $140K - $150K. We do not offer an annual bonus for this role. 
 
Note that American Red Cross salaries are aligned to the specific geographic location in which the work is primarily performed. Other factors that may be used to determine your actual salary may include your specific skills, how many years of experience you have, and comparisons to other employees already in this role. **We will review specific salary information at the time of phone screening based upon your location &amp; experience.** 
 
This job will be posted for a minimum of five business days and extended if the applicant pool needs to be expanded 
 
BENEFITS FOR YOU: 
As a mission-based organization, we believe our team needs great support to do great work. Our comprehensive package includes: 
<ul><li>Medical, Dental Vision plans</li><li>Health Spending Accounts &amp; Flexible Spending Accounts</li><li>PTO: Starting at 19 days a year; based on type of job and tenure</li><li>Holidays: 11 paid holidays comprised of six core holidays and five floating holidays</li><li>401K with up to 6% match</li><li>Paid Family Leave</li><li>Employee Assistance</li><li>Disability and Insurance: Short + Long Term</li><li>Service Awards and recognition</li></ul> 
- 
Physical Requirements 
 
Physical requirements are those present in normal office environment conditions. Operational flexibility is required to meet sudden and unpredictable needs. Ability to use a personal computer, applicable software, and office equipment for sustained periods of time. May include sitting for long periods of time, driving a vehicle, and working under challenging conditions. 
 
DISCLAIMER: The above statements are intended to describe the general nature and level of work being performed by individuals assigned to this position. They are not intended to be construed as an exhaustive list of responsibilities, duties and skills required of personnel so classified.
LI-EH1<h2 class="jobSectionHeader">
Apply now! Joining our team will provide you with the opportunity to
</h2><h2 class="jobSectionHeader">make your career a force for good!</h2>
The American Red Cross is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected veteran status, age, or any other characteristic protected by law. 
Qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers, San Diego Fair Chance Ordinance, the California Fair Chance Act and any other applicable state and local laws. 
AmeriCorps, the federal agency that brings people together through service, and its partners &mdash; the Peace Corps, AmeriCorps Alums, National Peace Corps Association, and the Service Year Alliance &mdash; launched Employers of National Service to connect national service alumni with opportunities in the workforce. American Red Cross is proud to be an EONS partner and share our employment opportunities with the network of organizations. 
Interested in Volunteering? Visit redcross.org/volunteertoday to learn more, including our most-needed volunteer positions.
To view the EEOC Summary of Rights, click here: Summary of Rights</div>

The State Bar of California

<div>Office of Information Technology
Annual Salary Range Lead IT Analyst: $112,497 - $149,972
FLSA Exempt / Union Represented
This position allows for up to four days of remote work per week 
 
About the Office
The Office of Information Technology (IT) is responsible for enabling State Bar&rsquo;s internal and external stakeholders by the management, implementation, and maintenance of an organization's technology to support of State Bar&rsquo;s mission and goals. The office&rsquo;s primary goals are to build and maintain functional capabilities, to support innovation and to ensure that all systems are running smoothly, efficiently, and securely to support the needs of the organization and its stakeholders.
Job Overview
The Office of Information Technology is seeking a Lead Data Engineer to join our dynamic team at the State Bar of California. In this role, you will define and drive the modernization of our data infrastructure using Microsoft cloud technologies. As the technical authority for the Bar&rsquo;s data platform, you will lead the development of scalable, automated data pipelines, establish governance standards, and guide cross-functional teams to deliver data driven solution that support Analytics, AI, compliance, and operational efficiency.
The Ideal Candidate
The ideal candidate is a hands-on technical leader with experience in building scalable, cloud-based data solutions. This individual brings a strong understanding of modern data architectures, data integration patterns, and secure design principles and is capable of driving architectural decisions that align with long-term business goals.
They have demonstrated success in leading cross-functional collaboration, setting standards for data quality and governance, and building reusable data frameworks that support analytics, automation, and decision making.
A clear understanding of compliance standards (e.g.,PII, PCI, HIPAA, CPRA) and experience applying those principles in large scale environments is essential. Microsoft certification in one or more of the following is strongly desired: Azure Data Engineer Associate; Power BI Data Analyst Associate; Azure Solutions Architect Expert; or any other data analysis-related certifications.
Definition
With minimum direction, the Lead IT Analyst provides technical leadership and direction for major IT projects, and/or serves as the technical authority for one or more related functions, including: network operating systems; software applications; data analytics applications, project/program management; product management; desktop support; system engineering; network infrastructure; database management; cloud services administration; and web server management. The Lead IT Analyst performs advanced, highly specialized IT work involving the business requirements, analysis, product roadmaps, planning, project management, architecture, designing, implementation, maintenance, troubleshooting, and/or enhancement of complex IT systems and procedures, and may serve in a lead capacity over other IT analysts and support staff.
Distinguishing Characteristics
The Lead IT Analyst is the highest level in the IT Analyst series and may be assigned to a function as an individual technical expert, project team leader. When assigned as a technical expert, performs work requiring a very high level of technical knowledge of a specific area, or ability to integrate at a high level the knowledge of several areas, while working with a significant amount of independent authority and judgment. When assigned as a project team leader, manages and provides technical leadership of projects involving large-scale, complex, and highly analytical tasks. When assigned as a supervisor, may perform work comparable to a project team leader, but with direct supervision over subordinate IT analysts and support staff.
The Lead IT Analyst is distinguished from the Senior IT Analyst in that the former performs the most complex IT operations and applications-related duties, provides technical leadership and direction to lower-level IT staff, and assumes responsibility for completion of major IT projects in accordance with the State Bar&rsquo;s needs. The Lead IT Analyst also provides strategic input and guidance within the incumbent&rsquo;s area of specialization.
Role-Specific of Essential Duties
Duties may include, but are not limited to the following:
<ul><li>Lead the design, development, and maintenance of scalable data pipelines using Azure Data Factory, Synapse Analytics, and Data Lake Storage to ingest, transform, and publish structured and unstructured data.
</li><li>Drive the automation of end-to-end and event-driven workflows using Azure Logic Apps, ensuring real-time or scheduled data synchronization and integration with external systems.
</li><li>Direct enterprise-level data modeling and transformation efforts to support reporting, dashboards, and analytics, including validation and quality checks to ensure consistency and reliability.
</li><li>Guide and collaborate with IT and business teams to gather data requirements, define transformation logic, and develop shared documentation such as the data dictionaries.
</li><li>Develop and oversee enhancements of the Azure-based data architecture, focusing on scalability, reusability, and long-term maintainability.
</li><li>Establish and implement data governance standards, including metadata management, lineage tracking, and data privacy and security controls aligned with organizational compliance needs.
</li><li>Optimize datasets for Power BI and promote self-service analytics through clean, reusable data models and standardized practices.
</li><li>Manage, monitor, troubleshoot, and tune pipeline performance, proactively resolving issues and establishing observability standards for operational reliability.
</li><li>Ensure comprehensive documentation and lead knowledge transfer efforts to support long-term IT business and user sustainability and system adoption.
</li><li>Maintain and support databases for custom and legacy applications, including performance tuning, backup and recovery, indexing, and monitoring.
</li><li>Spearhead the optimization of stored procedures, ETL jobs, and scheduled tasks, ensuring efficiency and reliability across both modern and legacy environments.
</li><li>Partner with application teams to troubleshoot and resolve data-related issues, implement fixes, and ensure data integrity in legacy platforms.
</li><li>Lead enterprise data migration efforts aligning strategies for access control, security, and compliance as data moves from legacy to modern platforms.
</li><li>Build and maintain an enterprise data dictionary and catalog to improve data discoverability and consistency across the organization.
</li><li>Lead and implement data security and compliance standards, across the Bar&rsquo;s data footprint.
</li></ul>Examples of Essential Duties
When assigned to the IT Application Engineering, Product Management, or Program Management Teams, duties may include, but are not limited to the following:
<ul><li>Analyzes and evaluates existing IT applications, products, and systems for cost effective and efficient operation, and identifies opportunities for modifications and improvements; prepares feasibility studies and project proposals accordingly.
</li><li>Plans, designs, tests, develops, and integrates solutions based on operational needs to support the business roadmap.
</li><li>Determines project schedules and allocation of resources for projects; determines operating characteristics, requirements; monitors the utilization of resources to ensure optimal effectiveness and efficiency; resolves production issues; and ensures projects, tasks and other activities are completed on schedule and in a timely and efficient manner.
</li><li>Monitors and maintains existing IT applications and products to ensure optimal functionality.
</li><li>Acts as the leader, supervisor, and primary point of contact for their assigned team.
</li><li>Coordinates closely with other IT staff and business partners to accomplish the collective goals and objectives of assigned programs, projects, and activities.
</li><li>Develops, maintains, and enforces various standards, best practices, procedures, policies and standard operating processes.
</li><li>Serves as the subject matter expert, mentor, guide in their respective area of expertise.
</li></ul>When assigned to the IT Operations and Infrastructure Team Duties may include, but are not limited to the following:
<ul><li>Supports the IT Director and IT Management team in the development, planning, estimating, and implementation of goals, objectives, and other activities for modifications and improvements.
</li><li>Acts as the leader, supervisor, and primary point of contact for the IT Operations and Infrastructure Team.
</li><li>Oversees the desktop support team and/or infrastructure team to ensure that all known incidents and Zendesk tickets are accurately identified and assigned efficiently; ensures that any tickets that cannot be resolved within agreed timeframes are properly escalated.
</li><li>Oversees the desktop support team and/or infrastructure team, and manages the ticket queue and incoming requests related to IT issues.
</li><li>Administers and supports configurations and maintains records of end-user&rsquo;s equipment. Endpoints include laptops, mobile devices, printers, AV systems, and other related peripherals.
</li><li>Oversees the infrastructure configuration and management to support State Bar data retention, security, business continuity, disaster recovery planning/testing, and information risk management policies.
</li><li>Coordinates closely with IT Application Engineering, IT PMO, and IT Product Management teams to accomplish the goals and objectives of assigned programs, projects, and activities.
</li><li>Collaborates with end-users and the system engineer team to ensure optimal functionality and system effectiveness.
</li></ul>Role Specific Employment Standards
Knowledge of:
<ul><li>Advanced functions of computer information systems, including the core hardware and software components that comprise complex IT systems and networks, as well as personal computer applications, word processing, and spreadsheet programs.
</li><li>Analysis and evaluation techniques to plan, design, integrate, implement, maintain and troubleshoot complex IT systems and networks.
</li><li>Techniques and practices of supervision, leadership, project management, and training.
</li><li>Project management and information systems development, design, and maintenance.
</li><li>Technical, operational, and programming problem-solving analysis.
</li><li>Principles of Agile application development methodologies.
</li><li>Problem identification, analysis and evaluation.
</li><li>Principles of effective writing and verbal presentation.
</li></ul>Desired Knowledge:
<ul><li>Proficient in building scalable data pipelines using Azure Data Factory, Synapse Analytics, Azure Data Lake, and Logic Apps.
</li><li>Strong SQL skills with experience in data transformation, validation, and optimization for reporting and analytics.
</li><li>Skilled in dimensional modeling and modern data platform design to support dashboarding and analytical use cases.
</li><li>Familiar with data quality frameworks, including validation, anomaly detection, and exception handling processes.
</li><li>Experience with metadata management, data cataloging, and governance tools such as Azure Purview (or equivalents).
</li><li>Familiarity with CI/CD practices and version control systems such as Git.
</li><li>Demonstrated ability to translate business needs into technical requirements and collaborate effectively across IT and business teams.
</li><li>Strong communication, documentation, and stakeholder engagement skills to support alignment and knowledge sharing.
</li><li>Data engineering languages such as Python.
</li><li>Knowledge of data security best practices including encryption, data masking.
</li><li>Familiarity with data visualization tool Power BI.
</li><li>Technical, operational, and programming problem-solving analysis.
</li><li>Problem identification, analysis and evaluation.
</li><li>Principles of effective writing and verbal presentation.
</li></ul>Ability to:
<ul><li>Exercise independent judgement, decisiveness, and creativity in designing, planning, troubleshooting, and integration of complex systems or networks based on the potential benefits and/or consequences.
</li><li>Analyze, evaluate, present and recommend technology methodologies and solutions.
</li><li>Solve problems with minimal disruption or impact to the organization business functions.
</li><li>Develop technology guidelines and standards.
</li><li>Develop alternative solutions within established guidelines and standards.
</li><li>Prioritize competing requests for service.
</li><li>Develop policies, procedures and standards relevant to the area of expertise.
</li><li>Interpret and implement IT policies, procedures, and standards.
</li><li>Operate modern office equipment including computer hardware, software, and internet and web-based applications.
</li><li>Compile data and prepare narrative and statistical reports.
</li><li>Communicate clearly and concisely, both orally and in writing.
</li><li>Establish and maintain effective interpersonal relationships at all organizational levels as well as with the public.
</li><li>Maintain the confidentiality of information.
</li></ul>General Employment Standards
Knowledge of:
<ul><li>Advanced functions of computer information systems, including the core hardware and software components that comprise complex IT systems and networks, as well as personal computer applications, word processing, and spreadsheet programs.
</li><li>Analysis and evaluation techniques to plan, design, integrate, implement, maintain and troubleshoot complex IT systems and networks.
</li><li>Techniques and practices of supervision, leadership, project management, and training.
</li><li>Project management and information systems development, design, and maintenance.
</li><li>Technical, operational, and programming problem-solving analysis.
</li><li>Principles of Agile application development methodologies.
</li><li>Problem identification, analysis and evaluation.
</li><li>Principles of effective writing and verbal presentation.
</li></ul>Ability to:
<ul><li>Exercise independent judgement, decisiveness, and creativity in designing, planning, troubleshooting, and integration of complex systems or networks based on the potential benefits and/or consequences.
</li><li>Analyze, evaluate, present and recommend technology methodologies and solutions.
</li><li>Solve problems with minimal disruption or impact to the organization business functions.
</li><li>Determine the systems or networking requirements to plan for or enhance the core data processing needs for the system or network.
</li><li>Develop technology guidelines and standards.
</li><li>Develop alternative solutions within established guidelines and standards.
</li><li>Direct, schedule, and orchestrate the installation, maintenance, and enhancements of complex IT systems and networks.
</li><li>Prioritize competing requests for service.
</li><li>Develop policies, procedures and standards relevant to the area of expertise.
</li><li>Interpret and implement IT policies, procedures, and standards.
</li><li>Plan, schedule, make work assignments, set priorities, train, mentor, evaluate, and select staff;
</li><li>Operate modern office equipment including computer hardware, software, and internet and web-based applications.
</li><li>Compile data and prepare narrative and statistical reports.
</li><li>Appropriately respond to requests and inquiries from the public, State Bar members, or other departments.
</li><li>Communicate clearly and concisely, both orally and in writing.
</li><li>Establish and maintain effective interpersonal relationships at all organizational levels as well as with the public.
</li><li>Maintain the confidentiality of information.
</li></ul>Minimum Qualifications
Education:
<ul><li>Bachelor&rsquo;s degree in computer science or a closely related field that develops skills related to the essential duties, or equivalent academic achievement.
</li></ul>Experience:
<ul><li>Five (5) years of experience at the advanced journey-level in the information systems field including system analysis, business process design, development and implementation of business application solutions or IT project management, of which at least one (1) year was in a lead capacity.
</li></ul>License, Certificate, Registration Requirements:
<ul><li>Possession of one or more approved information technology certificates and/or completion of other approved technology-related training may substitute for some or all of the required education.
</li></ul>Applicants who meet the Minimum Qualifications will be required to successfully complete the State Bar&rsquo;s selection process for this classification.
About the State Bar
The State Bar of California&rsquo;s mission is to protect the public and includes the primary functions of licensing, regulation, and discipline of attorneys; the advancement of the ethical and competent practice of law; and support of efforts for greater access to, and inclusion in, the legal system.
Our Values
Clarity | Investing in Our People | Excellence | Respect | Growth Mindset 
DEI Statement
We are a diverse, equitable, and inclusive workplace where all of our employees and prospective employees experience fairness, dignity, and respect.</div>

Capital One

<div>Lead Data Engineer
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 4 years of experience in application development (Internship experience does not apply)</li><li>
At least 2 years of experience in big data technologies</li><li>
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)</li></ul>
Preferred Qualifications:<ul><li>
7+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
4+ year experience working on real-time data and streaming applications</li><li>
4+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
4+ years of data warehousing experience (Redshift or Snowflake)</li><li>
4+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
Chicago, IL: $179,400 - $204,700 for Lead Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</div>

Cushman & Wakefield

<div>Job Title
Lead Data Engineer
Job Description Summary
Job Description
The Lead Data Engineer helps architect and lead the development of enterprise-scale data platforms and advanced analytics solutions across multiple business units and subject areas. In addition, they assist the project delivery team with scoping and planning integration projects and contribute to the design, implementation, and support of the data artifacts in the data lakehouse and databases. This role combines deep technical expertise with leadership and mentoring responsibilities, driving innovation and best practices across the data engineering function. 
 
Key Responsibilities<ul><li>
Support the Solution and Data Architect(s) to help lead the design, development, and optimization of scalable data platforms and analytics solutions that support global data strategy.</li><li>
Architect and implement robust, scalable, metadata-driven pipelines in Databricks using Delta Lake, Unity Catalog, and declarative workflows.</li><li>
Oversee the development and maintenance of Azure SQL database objects using advanced T-SQL for data quality and insight generation.</li><li>
Drive performance, reliability and observability of real-time data processing using Spark Structured Streaming and Change Data Feed strategies.</li><li>
Own CI/CD processes and infrastructure automation using Databricks Asset Bundles, Azure DevOps, and Infrastructure as Code.</li><li>
Define and enforce standards for reusable, metadata-driven integration patterns, including Unity Catalog governance, Declarative Pipeline design, and data quality across the engineering team.</li><li>
Manage and mentor a small team of data engineers, providing technical leadership, pair programming support, conducting design/code reviews, guiding technical decisions and aligning data engineering efforts with strategic goals</li><li>
Collaborate with cross-functional stakeholders to translate business and technical requirements into scalable data solutions, assisting the project delivery team to scope, plan and deliver new and enhanced data integrations</li><li>
Champion innovation, best practices, and continuous improvement in data engineering, while mentoring team members and fostering technical growth.</li><li>
Evaluate and introduce emerging technologies to enhance platform capabilities</li></ul> 
Essential Knowledge &amp; Experience<ul><li>
Extensive hands-on experience (6+ years) in cloud-native data engineering, including 3+ years with Databricks and Delta Lake in Azure, combined with good (2+ years) in a technical leadership or architecture role.</li><li>
Deep practical experience of the Databricks ecosystem including Delta Lake, Unity Catalog, Declarative Pipelines, Spark Structured Streaming, Change Data Feed, Serverless SQL, and Cluster management &amp; optimization.</li><li>
Expert-level SQL skills, with a track record of designing performant queries, optimizing data models, and driving insight generation from large datasets.</li><li>
Proficiency in multiple programming languages used in data engineering and analytics (e.g., PySpark, Scala, R, Python), with experience mentoring others in their use.</li><li>
Deep understanding of cloud-native data architecture, including Lakehouse design principles, data integration patterns, and automation strategies.</li><li>
Proven ability to design and deliver scalable, production-grade data pipelines, with a focus on reliability, maintainability, and performance.</li><li>
Strong experience with CI/CD, version control (Git), ideally including Databricks Asset Bundles, and Infrastructure as Code, leading DevOps practices in data engineering teams.</li><li>
Skilled in requirements gathering and solution design, translating business needs into technical specifications and guiding teams through delivery.</li><li>
Demonstrated leadership in troubleshooting and resolving complex data and code issues, driving root cause analysis and long-term fixes.</li><li>
Excellent communication and stakeholder engagement skills, with experience presenting architectural decisions, documenting processes, and influencing cross-functional teams.</li><li>
Commitment to continuous improvement, staying current with emerging technologies and fostering a culture of learning and innovation within the team.</li></ul> 
Desirable Knowledge &amp; Experience<ul><li>
Hands-on experience with machine learning pipelines or integrating data engineering with advanced analytics and AI workflows.</li><li>
Experience designing and implementing data mesh or domain-oriented data architectures in large-scale environments.</li><li>
Test-driven development using common testing frameworks (e.g. pytest, nUnit, tSQLt, nBI, etc.)</li><li>
Exposure to real-time integrations or IoT solutions e.g. Event Hubs, Service Bus, IoT and Event Grid in Azure; IoT Core, PubSub in Google Cloud; etc.</li><li>
Familiarity with data governance frameworks, including data lineage, cataloging, and compliance (e.g., GDPR, HIPAA).</li><li>
Background in delivering data-driven solutions for commercial real estate applications</li><li>
Degree in IT, Engineering, computer sciences, business IT degree or in any quantitative discipline</li></ul> 
Skills &amp; Personal Qualities:<ul><li>
Strong communicator in English, both verbal and written, with the ability to engage effectively across global teams and all levels of the organisation.</li><li>
Analytical and curious mindset, driven to solve complex problems and understand intricate technical systems and architectures.</li><li>
Organised and detail-oriented, with a diligent, quality-focused approach and a strong sense of ownership.</li><li>
Collaborative and proactive, able to build relationships, resolve conflicts, and contribute meaningfully within cross-functional teams.</li><li>
Adaptable and dependable, capable of managing multiple priorities, meeting deadlines, and working independently or as part of a team.</li><li>
Continuous learner, demonstrating initiative in technical self-improvement and staying current with evolving tools and practices.</li></ul> 

Cushman &amp; Wakefield also provides eligible employees with an opportunity to enroll in a variety of benefit programs, generally including health, vision, and dental insurance, flexible spending accounts, health savings accounts, retirement savings plans, life, and disability insurance programs, and paid and unpaid time away from work. In addition to a comprehensive benefits package, Cushman and Wakefield provide eligible employees with competitive pay, which may vary depending on eligibility factors such as geographic location, date of hire, total hours worked, job type, business line, and applicability of collective bargaining agreements. 

The compensation that will be offered to the successful candidate will depend on factors such as whether the position is covered by a collective bargaining agreement, the geographic area in which the work will be performed, market pay rates in that area, and the candidate&rsquo;s experience and qualifications. 

The company will not pay less than minimum wage for this role. 

The compensation for the position is: $ 86,615.00 - $101,900.00
Cushman &amp; Wakefield is an Equal Opportunity employer to all protected groups, including protected veterans and individuals with disabilities. Discrimination of any type will not be tolerated.
In compliance with the Americans with Disabilities Act Amendments Act (ADAAA), if you have a disability and would like to request an accommodation in order to apply for a position at Cushman &amp; Wakefield, please call the ADA line at 1-888-365-5406 or email HRServices@cushwake.com. Please refer to the job title and job location when you contact us.
INCO: &ldquo;Cushman &amp; Wakefield&rdquo;</div>

Search 10000+ Lead data engineer jobs near you this March. New roles added regularly across leading industries. Apply today.

10000 lead data engineer jobs Near Me

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer