data engineer

machine learning engineer Jobs in San Francisco

machine learning engineer

data analyst

lead data engineer

senior data engineer Jobs in San Francisco

senior data engineer

cloud data engineer

ROLLER

<div>
 <strong>
  About ROLLER
  <br/>
  <br/>
 </strong>
 ROLLER is not your average software-as-a-service company. With a global presence in over 30 countries, we're here to bring some excitement to the leisure and attractions industry and make a difference! Our mission is to help businesses operate smoothly and create fun and memorable guest experiences by providing seamless ticketing, point-of-sale, self-serve kiosks, memberships and digital waiver processes.
 <br/>
 <br/>
 But here's the best part: our team. We're a group of 300+ highly passionate, enthusiastic, and down-to-earth professionals located all around the world who are all working together to build something truly remarkable. We're aiming high and believe that the possibilities are endless. As we continue to grow globally, we're excited to write our success story and have fun along the way.
 <br/>
 <br/>
 We genuinely love what we do, and we're looking for like-minded people to join us on this amazing journey. If you're ready to be part of a dynamic team and make a real impact, come aboard, and let's create some unforgettable experiences together at ROLLER!
 <br/>
 <br/>
 <strong>
  About the Role
  <br/>
  <br/>
 </strong>
 We are seeking a highly technical, hands-on
 <strong>
  Senior
 </strong>
 <strong>
  Data Engineer
 </strong>
 to architect and scale our data infrastructure from the ground up. As a core member of the data function within our Business Technology team, you will be responsible for building the pipelines and models that power smarter decision-making and operational efficiency across the entire organization.
 <br/>
 <br/>
 In this foundational role, you will build &amp; architect the
 <strong>
  modern data stack
 </strong>
 , ensuring our infrastructure is robust, automated, and governed. You collaborate as a technical partner with
 <strong>
  GTM
 </strong>
 <strong>
  ,Product, Finance, P&amp;C
 </strong>
 to build high-performance data models and pipelines that transform raw data into actionable cross-functional insights.
 <br/>
 <br/>
 Joining ROLLER at this pivotal growth stage, you will have the opportunity to make an outsized impact on our technical landscape, directly influencing how we process data to deliver world-class experiences for our customers globally.
 <br/>
 <br/>
 <strong>
  What You'll Do
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   <strong>
    Scalable Architecture:
   </strong>
   Design and implement robust Data Modeling and Architecture strategies that support high-volume data processing and maintain long-term scalability.
  </li>
  <li>
   <strong>
    Cloud Ecosystem:
   </strong>
   Develop and manage end-to-end data pipelines using Google Cloud Platform services, specifically leveraging Cloud Run, Cloud Function for compute, BigQuery for storage, and Cloud Composer (Airflow) for orchestration.
  </li>
  <li>
   <strong>
    Transformation Excellence:
   </strong>
   Build, maintain, and document complex data transformation layers using DBT (Data Build Tool) to ensure high data quality and reliability.
  </li>
  <li>
   <strong>
    Infrastructure as Code:
   </strong>
   Automate the provisioning of cloud resources using Terraform and streamline deployment workflows via GitHub Actions CI/CD pipelines.
  </li>
  <li>
   <strong>
    Cloud Data Warehousing:
   </strong>
   Demonstrate expert-level proficiency in managing and optimizing Cloud Data Warehouses, such as Snowflake &amp; BigQuery.
  </li>
  <li>
   <strong>
    Team Collaboration:
   </strong>
   Partner with cross-functional stakeholders to build and scale high-performing data infrastructure that supports engineering, analytics, and Data Program needs.
  </li>
  <li>
   <strong>
    Stack Management:
   </strong>
   Architect and maintain a modern data stack by implementing best-in-class tools including Snowflake, Bigquery, dbt, Fivetran, Looker, Tableau and Airflow.
  </li>
  <li>
   <strong>
    Pipeline Engineering:
   </strong>
   Develop scalable ETL/ELT workflows and robust data models to deliver real-time analytics and unified business reporting.
  </li>
  <li>
   <strong>
    Data Visualization: Create and maintain intuitive, high-performance Looker dashboards will be an added advantage.
    <br/>
    <br/>
   </strong>
  </li>
 </ul>
 <strong>
  About You
  <br/>
  <br/>
 </strong>
 You are a technical builder who views data as a competitive advantage. You thrive in fast-paced environments and have a proven track record of engineering scalable data foundations from the ground up. Equal parts
 <strong>
  architect and analytical problem-solver
 </strong>
 , you excel at balancing long-term technical vision with the daily hands-on execution of complex pipelines.
 <br/>
 <br/>
 You are energized by the full lifecycle of data&mdash;moving beyond just writing code to actively leading
 <strong>
  project discovery and analysis
 </strong>
 alongside cross-functional partners. You take pride in enabling GTM, Product, Finance &amp; P&amp;C teams through clear insights and high-performance systems. Most importantly, you are excited to act as a founding technical force for a high-growth SaaS company that is transforming the guest experience for attractions businesses globally.
 <br/>
 <br/>
 <ul>
  <li>
   <strong>
    5+ years of experience
   </strong>
   in Data &amp; Analytics or Data Engineering with a focus on Scalable cloud driven data pipeline build
  </li>
  <li>
   Proven experience in dimensional modeling (Star/Snowflake schema) and designing architectures that support both historical reporting and real-time needs.
  </li>
  <li>
   Expert-level proficiency in Snowflake or BigQuery, including performance tuning, cost optimization, and access control (RBAC).
  </li>
  <li>
   Hands-on experience with Google Cloud Platform services, specifically Cloud Function, Cloud Run for containerized workloads and Cloud Composer for orchestration.
  </li>
  <li>
   Through hands-on experience of dbt (Data Build Tool) to manage transformations, including writing custom macros, implementing tests, and generating documentation.
  </li>
  <li>
   Solid experience using Terraform to provision cloud resources, ensuring that infrastructure is version-controlled and reproducible.
  </li>
  <li>
   Proficiency in GitHub Actions to automate testing and deployment pipelines for data models and infrastructure.
  </li>
  <li>
   Ability to design high-performance dashboards that prioritize user experience and fast load times.
  </li>
  <li>
   Experience collaborating with Finance, GTM, and Product to define key metrics (like CAC, LTV, or Churn) and codifying them into the data layer.
  </li>
  <li>
   Familiarity with data ingestion tools like Fivetran , Airbyte, Workato, Mulesoft to sync data from various SaaS platforms into the warehouse.
  </li>
  <li>
   Operates as a full-stack Data Engineer with the technical authority to architect and build entire data lifecycles, from raw source ingestion to high-impact data visualization.
  </li>
  <li>
   <strong>
    Familiarity with business-critical systems
   </strong>
   like Salesforce, Chargbee, Gainsight, and product analytics tools.
  </li>
  <li>
   <strong>
    Strong communicator
   </strong>
   with a track record of working across technical and non-technical teams to drive alignment.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Preferred Qualifications
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Experience partnering with IT or Business Technology teams to drive cross-functional outcomes.
  </li>
  <li>
   Exposure to customer success and revenue workflows, such as onboarding journeys, renewal metrics, or support analytics.
  </li>
  <li>
   Familiarity with AI/ML pipelines and experimentation frameworks that support data-driven innovation.
   <br/>
   <br/>
  </li>
 </ul>
 Perks!
 <br/>
 <br/>
 <ul>
  <li>
   You'll get to work on a category-leading product that customers love in a fun, high-growth industry! Check our Capterra and G2 reviews.
  </li>
  <li>
   4 ROLLER Recharge days per year (When we hit our goals each quarter, we take a well-earned day off together to relax, recharge, and celebrate our wins).
  </li>
  <li>
   Engage in our 'Vibe Tribe' - led by our team members; you can contribute to company-wide initiatives directly. Regular events and social activities, fundraising &amp; cause-related campaigns...you name it. We're willing to make it happen!
  </li>
  <li>
   Team Member Assistance Program to proactively support our team's health and wellbeing - access to coaching, education modules, weekly webinars, and more.
  </li>
  <li>
   16 weeks paid Parental Leave for primary carers and 4 weeks paid Parental Leave for secondary carers.
  </li>
  <li>
   Work with a driven, fun, and switched-on team that likes to raise the bar in all we do!
  </li>
  <li>
   Individual learning &amp; development budget plus genuine career growth opportunities as we continue to expand!
   <br/>
   <br/>
  </li>
 </ul>
 What You Can Expect
 <br/>
 <br/>
 <ul>
  <li>
   <strong>
    Initial call with our Talent Acquisition Manager
   </strong>
   You'll have an initial call with our Talent Acquisition Manager to chat through some of your experience to date, salary expectations and you can check off any initial questions you might have.
  </li>
  <li>
   <strong>
    Interview with the Hiring Manager
   </strong>
   You'll get to meet with the hiring manager to learn more about the role &amp; ROLLER whilst also talking through your experience in more detail.
  </li>
  <li>
   <strong>
    Loop Interviews
   </strong>
   This is where you will get to meet our wider ROLLER team to do a 'vibe check' on us to make sure our culture &amp; vibe meet what you are looking for!
  </li>
  <li>
   <strong>
    Offer
   </strong>
   If all lights are green and the fit feel right, we'll conduct reference checks and you'll receive an offer to join!
  </li>
 </ul>
</div>


Data Engineer

EARTH & ESTATES LLP

<p><b>We&rsquo;re Hiring: </b>Lead Data Engineer<br/><b>Location</b>: California, USA (Bay Area &ndash; Local Candidates Only)<br/><b>Employment Type</b>: W2 Only (All Visas Accepted Except H1)<br/><b>Experience</b>: 6+ Years of Genuine Hands-on Experience Required</p><p>We are seeking an experienced, hands-on Senior Data Engineer to design, build, and scale modern data platforms supporting enterprise analytics, business intelligence, and healthcare data integrations.<br/>This role involves working with SQL Server, Azure, Databricks, Snowflake, and Python in real-world production environments, with a strong focus on cloud modernization and scalable data architecture.</p><p><b>Key Responsibilities:-</b></p><p>Design and maintain scalable ETL/ELT pipelines across cloud platforms</p><p>Lead migration of on-prem SQL Server workloads to Azure (ADF, Synapse, ADLS, Fabric)</p><p>Architect and optimize data warehouses, data marts, and lakehouse architectures</p><p>Work with healthcare data systems (EHR, HL7, FHIR, HIPAA-compliant environments)</p><p>Develop integrations using REST APIs, CDC, and event-driven architectures</p><p>Implement dimensional modeling and performance tuning strategies</p><p>Build batch and streaming pipelines using Spark and Kafka</p><p>Collaborate with BI, ML, and business stakeholders</p><p>Establish monitoring, data quality checks, and CI/CD processes</p><p><b>Core Skills:-</b></p><p>Advanced SQL and performance tuning</p><p>Azure (ADF, Synapse, Azure SQL, ADLS, Fabric)</p><p>Databricks, Snowflake, BigQuery</p><p>Python (PySpark), Scala</p><p>Spark (batch &amp; streaming), Kafka</p><p>ETL tools (ADF, SSIS, Airflow, dbt)</p><p>BI tools (Power BI preferred)</p><p>DevOps and data governance best practices</p><p>Interested candidates (local to Bay Area only, with 6+ years of genuine experience) may share their resume at:<b>devang@acrtechnology.com</b></p><p>Job Types: Full-time, Contract</p><p>Pay: $55.00 - $65.00 per hour</p><p>Work Location: In person</p>

Lead Data Engineer

Qcells

<div><p><b>Description</b>
</p><h3 class="jobSectionHeader"><b>POSITION DESCRIPTION:</b></h3><p>
We are seeking a <b>Lead Data Engineer</b> to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational systems, and establishing robust data models within a modern lakehouse architecture.</p><p>
The ideal candidate brings deep SQL and Python expertise, extensive experience with distributed data platforms, and strong knowledge of data architecture, governance, and performance optimization. This individual will serve as a technical leader and mentor, partnering closely with architects, analysts, application teams, and business stakeholders to deliver reliable, scalable, and well-governed enterprise data solutions.</p><h3 class="jobSectionHeader"><b>
RESPONSIBILITIES</b></h3><ul><li>
Lead the design, development, and optimization of scalable data pipelines supporting ingestion, transformation, and enterprise-wide data consumption.</li><li>
Architect and implement enterprise-grade ETL/ELT frameworks using Azure Fabric or comparable cloud data platforms.</li><li>
Oversee and optimize data integrations from ERP (NetSuite/SAP), CRM (Salesforce), internal systems, APIs, and third-party data sources.</li><li>
Design and govern high-quality, scalable data models supporting analytics, reporting, operational systems, and advanced use cases.</li><li>
Partner with Data Architects to define and implement lakehouse patterns, Delta Lake strategies, medallion architecture, and domain-driven design principles.</li><li>
Establish and enforce data quality frameworks, validation standards, lineage tracking, and observability practices.</li><li>
Drive performance optimization, scalability, reliability, and cost governance across cloud environments.</li><li>
Provide technical leadership and mentorship to data engineers; conduct design reviews and enforce engineering best practices.</li><li>
Collaborate cross-functionally with analysts, application teams, and business stakeholders to translate requirements into scalable data solutions.</li><li>
Lead MDM, metadata management, governance, and data standardization initiatives.</li><li>
Oversee CI/CD automation, DevOps integration, testing frameworks, and monitoring strategies for data workflows.</li><li>
Evaluate emerging technologies and recommend platform improvements aligned with enterprise strategy.</li></ul><h3 class="jobSectionHeader"><b>
MINIMUM QUALIFICATIONS</b></h3><ul><li>
10+ years of experience in data engineering, data architecture, or related roles.</li><li>
Proven experience leading large-scale data platform initiatives in cloud environments.</li><li>
Extensive hands-on experience with Azure data services (Data Lake, Data Factory, Fabric, Synapse, or similar).</li><li>
Advanced proficiency in SQL and Python; experience with Spark or distributed processing frameworks.</li><li>
Deep experience designing and implementing enterprise ETL/ELT frameworks.</li><li>
Strong expertise in data modeling (dimensional modeling, star schema, lakehouse/Delta modeling).</li><li>
Experience integrating complex enterprise systems (ERP, CRM, operational platforms).</li><li>
Strong understanding of data governance, metadata management, MDM, and data quality frameworks.</li><li>
Experience with performance tuning, workload optimization, and cloud cost management.</li><li>
Demonstrated ability to lead technical teams, conduct architecture reviews, and mentor engineers.</li><li>
Strong problem-solving, debugging, and system design skills.</li><li>
Travel may be required up to 5%, depending on business needs.</li></ul><h3 class="jobSectionHeader"><b>
PREFERRED QUALIFICATIONS</b></h3><ul><li>
Experience with Delta Tables, Snowflake, Synapse, or comparable cloud data platforms.</li><li>
Experience with event-driven and streaming architectures (Kafka, Event Hub, streaming pipelines).</li><li>
Familiarity with finance, operations, energy, or ERP-driven data domains.</li><li>
Experience designing API-based data integrations and modern integration patterns.</li><li>
Azure certifications (Data Engineer Associate, Solutions Architect, or equivalent).</li><li>
Experience enabling analytics teams, data science workflows, or ML pipelines.</li><li>
Experience implementing enterprise data security and compliance frameworks.</li></ul><br>
Hanwha Q CELLS Technologies, Inc. a subsidiary of Hanwha Q CELLS, one of the world&acute;s largest and most recognized photovoltaic manufacturers for its high-performance, high-quality solar cells and modules. It is headquartered in Seoul, South Korea (Global Executive HQ) Talheim, Germany (Technology &amp; Innovation HQ) and Santa Clara, CA, USA (HW and SW Product Development HQ). Through its growing global business network spanning Europe, North America, Asia, South America, Africa, and the Middle East, the company provides excellent services and long-term partnerships to its customers in the utility, commercial, government, and residential markets. Hanwha Q CELLS is a flagship company of Hanwha Group, a FORTUNE Global 500 firm and a Top 7 business enterprise in South Korea.<br>
<br>
<div><div><div><br>
<b>PHYSICAL, MENTAL &amp; ENVIRONMENTAL DEMANDS:</b><br>
To comply with the Rehabilitation Act of 1973 the essential physical, mental and environmental requirements for this job are listed below. These are requirements <i>normally expected</i> to perform <i>regular</i> job duties. Incumbent must be able to successfully perform all of the functions of the job with or without reasonable accommodation.</div></div><div><div><div><div><b><br>
Mobility</b></div></div><br>
<div><div><br>
Standing</div><div><br>
20% of time</div></div><br>
<div><div><br>
Sitting</div><div><br>
70% of time</div></div><br>
<div><div><br>
Walking</div><div><br>
10% of time</div></div><br>
<div><div><br>
<b>
Strength</b></div></div><br>
<div><div><br>
Pulling</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Pushing</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Carrying</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Lifting</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
<b>
Dexterity</b> <b>(F = Frequently, O = Occasionally, N = Never)</b></div></div><br>
<div><div><br>
Typing</div><div><br>
F</div></div><br>
<div><div><br>
Handling</div><div><br>
F</div></div><br>
<div><div><br>
Reaching</div><div><br>
F</div></div></div><div><div><div><b><br>
Agility</b> <b>(F = Frequently, O = Occasionally, N = Never)</b></div></div><br>
<div><div><br>
Turning</div><div><br>
F</div></div><br>
<div><div><br>
Twisting</div><div><br>
F</div></div><br>
<div><div><br>
Bending</div><div><br>
O</div></div><br>
<div><div><br>
Crouching</div><div><br>
O</div></div><br>
<div><div><br>
Balancing</div><div><br>
N</div></div><br>
<div><div><br>
Climbing</div><div><br>
N</div></div><br>
<div><div><br>
Crawling</div><div><br>
N</div></div><br>
<div><div><br>
Kneeling</div><div><br>
N</div></div></div></div></div><div></div><p><br>
The salary range is required by the California Pay Transparency Act and may differ depending on the location of those candidates hired nationwide. Actual compensation is influenced by a wide array of factors including but not limited to, skill set, education, licenses and certifications, essential job duties and requirements, and the necessary experience relative to the job&rsquo;s minimum qualifications.</p>
<ul><li>This target salary range is for CA positions only and should not be interpreted as an offer of compensation.</li></ul>
You may view your privacy rights by reviewing Qcells' Privacy Policy or by contacting our HR team for a copy.</div>

SS&C

<div><div>As a leading financial services and healthcare technology company based on revenue, SS&amp;C is headquartered in Windsor, Connecticut, and has 27,000+ employees in 35 countries. Some 20,000 financial services and healthcare organizations, from the world's largest companies to small and mid-market firms, rely on SS&amp;C for expertise, scale, and technology.</div><div></div><div>
Job Description</div><div></div><div>
Lead Data Engineer (SS&amp;C Technologies, Inc.; San Francisco, CA): The Lead Data Engineer is based at SS&amp;C&rsquo;s office in San Francisco, CA with a telecommuting benefit. The incumbent must reside within commuting distance from SS&amp;C&rsquo;s San Francisco office. The Data Engineer will join a team that creates a leading cloud platform with the latest big data, cloud native and machine learning technologies. Specific responsibilities will include: Build and implement models in a production environment for a revenue-driving product; Create and maintain overall optimal data pipeline architecture; Assemble large, complex data sets that meet functional / non-functional business requirements; Manage data migrations/conversions and troubleshooting data processing issues; Create the pipeline for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources; Build large scale data platform infrastructures to power other products; Lead a squad (feature team) to deliver strategic client features including data movement and data synchronization; and Work with other architect engineers to propose architecture designs that will solve a business problem with bigger impact and reduce technical debts in the long run.</div><div></div><div>
Minimum requirements: Master&rsquo;s degree or foreign equivalent in Computer Science, Data Analytics, Information Technology Management, or related field, plus 3 years of pre- or post-Master&rsquo;s experience in any occupation in which the required experience is gained.</div><div></div><div>
Alternate Education and Experience: Bachelor&rsquo;s degree or foreign equivalent in Computer Science, Data Analytics, Information Technology Management, or related field, plus 6 years of experience in any occupation in which the required experience is gained.</div><div></div><div>
Must have: Master programming skills in Python and SQL. Deep knowledge of big data platforms technologies including Spark, Hive, Airflow, Data Hub, Delta Lake or Iceberg. Strong algorithm &amp; data structure basis. Experience leading a team technically to deliver large business features. Great architecture principles and decision-making skills. Strong problem-solving skills with a can-do attitude. Great software engineering best practices with git and version control systems. Solid communication skills to explain complex data pipelines to both technical and non-technical people. Excellent writing and documenting skills.</div><div></div><div>
Salary: $194,834.00 to $210,000.00 per year.</div><div></div><div>
Apply online at <div>https://www.ssctech.com/about-us/careers</div> or send resume to: Angela Lamar, Talent Acquisition, SS&amp;C Technologies, Inc., <div>alamar@sscinc.com</div>. Ref: 00087619. An EOE.</div><div></div><div>
#LI-DNI</div><div></div><div>
Unless explicitly requested or approached by SS&amp;C Technologies, Inc. or any of its affiliated companies, the company will not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services.</div>
SS&amp;C offers excellent benefits including health, dental, 401k plan, tuition and professional development reimbursement plan.<div>
SS&amp;C Technologies is an Equal Employment Opportunity employer and does not discriminate against any applicant for employment or employee on the basis of race, color, religious creed, gender, age, marital status, sexual orientation, national origin, disability, veteran status or any other classification protected by applicable discrimination laws.</div><div></div>
Salary is determined by various factors including, but not limited to, relevant work experience, job related knowledge, skills, abilities, business needs, and geographic regions.<div></div>
California: Salary range for the position: 194,834 USD to 210,000 USD.</div><div></div>

Lead Data Engineer (SS&C Technologies, Inc.; San Francisco, CA): Ref 00087619

The State Bar of California

<div><p><b>Office of Information Technology
</b></p><p>Annual Salary Range Lead IT Analyst: $112,497 - $149,972
</p><p>FLSA Exempt / Union Represented
</p><p>This position allows for up to four days of remote work per week<br>
</p><p><br>
<b>About the Office
</b></p><p>The Office of Information Technology (IT) is responsible for enabling State Bar&rsquo;s internal and external stakeholders by the management, implementation, and maintenance of an organization's technology to support of State Bar&rsquo;s mission and goals. The office&rsquo;s primary goals are to build and maintain functional capabilities, to support innovation and to ensure that all systems are running smoothly, efficiently, and securely to support the needs of the organization and its stakeholders.
</p><p><b>Job Overview
</b></p><p>The Office of Information Technology is seeking a Lead Data Engineer to join our dynamic team at the State Bar of California. In this role, you will define and drive the modernization of our data infrastructure using Microsoft cloud technologies. As the technical authority for the Bar&rsquo;s data platform, you will lead the development of scalable, automated data pipelines, establish governance standards, and guide cross-functional teams to deliver data driven solution that support Analytics, AI, compliance, and operational efficiency.
</p><p><b>The Ideal Candidate
</b></p><p>The ideal candidate is a hands-on technical leader with experience in building scalable, cloud-based data solutions. This individual brings a strong understanding of modern data architectures, data integration patterns, and secure design principles and is capable of driving architectural decisions that align with long-term business goals.
</p><p>They have demonstrated success in leading cross-functional collaboration, setting standards for data quality and governance, and building reusable data frameworks that support analytics, automation, and decision making.
</p><p>A clear understanding of compliance standards (e.g.,PII, PCI, HIPAA, CPRA) and experience applying those principles in large scale environments is essential. Microsoft certification in one or more of the following is strongly desired: Azure Data Engineer Associate; Power BI Data Analyst Associate; Azure Solutions Architect Expert; or any other data analysis-related certifications.
</p><p><b>Definition
</b></p><p>With minimum direction, the Lead IT Analyst provides technical leadership and direction for major IT projects, and/or serves as the technical authority for one or more related functions, including: network operating systems; software applications; data analytics applications, project/program management; product management; desktop support; system engineering; network infrastructure; database management; cloud services administration; and web server management. The Lead IT Analyst performs advanced, highly specialized IT work involving the business requirements, analysis, product roadmaps, planning, project management, architecture, designing, implementation, maintenance, troubleshooting, and/or enhancement of complex IT systems and procedures, and may serve in a lead capacity over other IT analysts and support staff.
</p><p><b>Distinguishing Characteristics
</b></p><p>The Lead IT Analyst is the highest level in the IT Analyst series and may be assigned to a function as an individual technical expert, project team leader. When assigned as a technical expert, performs work requiring a very high level of technical knowledge of a specific area, or ability to integrate at a high level the knowledge of several areas, while working with a significant amount of independent authority and judgment. When assigned as a project team leader, manages and provides technical leadership of projects involving large-scale, complex, and highly analytical tasks. When assigned as a supervisor, may perform work comparable to a project team leader, but with direct supervision over subordinate IT analysts and support staff.
</p><p>The Lead IT Analyst is distinguished from the Senior IT Analyst in that the former performs the most complex IT operations and applications-related duties, provides technical leadership and direction to lower-level IT staff, and assumes responsibility for completion of major IT projects in accordance with the State Bar&rsquo;s needs. The Lead IT Analyst also provides strategic input and guidance within the incumbent&rsquo;s area of specialization.
</p><p><b>Role-Specific of Essential Duties
</b></p><p>Duties may include, but are not limited to the following:
</p><ul><li>Lead the design, development, and maintenance of scalable data pipelines using Azure Data Factory, Synapse Analytics, and Data Lake Storage to ingest, transform, and publish structured and unstructured data.
</li><li>Drive the automation of end-to-end and event-driven workflows using Azure Logic Apps, ensuring real-time or scheduled data synchronization and integration with external systems.
</li><li>Direct enterprise-level data modeling and transformation efforts to support reporting, dashboards, and analytics, including validation and quality checks to ensure consistency and reliability.
</li><li>Guide and collaborate with IT and business teams to gather data requirements, define transformation logic, and develop shared documentation such as the data dictionaries.
</li><li>Develop and oversee enhancements of the Azure-based data architecture, focusing on scalability, reusability, and long-term maintainability.
</li><li>Establish and implement data governance standards, including metadata management, lineage tracking, and data privacy and security controls aligned with organizational compliance needs.
</li><li>Optimize datasets for Power BI and promote self-service analytics through clean, reusable data models and standardized practices.
</li><li>Manage, monitor, troubleshoot, and tune pipeline performance, proactively resolving issues and establishing observability standards for operational reliability.
</li><li>Ensure comprehensive documentation and lead knowledge transfer efforts to support long-term IT business and user sustainability and system adoption.
</li><li>Maintain and support databases for custom and legacy applications, including performance tuning, backup and recovery, indexing, and monitoring.
</li><li>Spearhead the optimization of stored procedures, ETL jobs, and scheduled tasks, ensuring efficiency and reliability across both modern and legacy environments.
</li><li>Partner with application teams to troubleshoot and resolve data-related issues, implement fixes, and ensure data integrity in legacy platforms.
</li><li>Lead enterprise data migration efforts aligning strategies for access control, security, and compliance as data moves from legacy to modern platforms.
</li><li>Build and maintain an enterprise data dictionary and catalog to improve data discoverability and consistency across the organization.
</li><li>Lead and implement data security and compliance standards, across the Bar&rsquo;s data footprint.
</li></ul><p><b>Examples of Essential Duties
</b></p><p>When assigned to the IT Application Engineering, Product Management, or Program Management Teams, duties may include, but are not limited to the following:
</p><ul><li>Analyzes and evaluates existing IT applications, products, and systems for cost effective and efficient operation, and identifies opportunities for modifications and improvements; prepares feasibility studies and project proposals accordingly.
</li><li>Plans, designs, tests, develops, and integrates solutions based on operational needs to support the business roadmap.
</li><li>Determines project schedules and allocation of resources for projects; determines operating characteristics, requirements; monitors the utilization of resources to ensure optimal effectiveness and efficiency; resolves production issues; and ensures projects, tasks and other activities are completed on schedule and in a timely and efficient manner.
</li><li>Monitors and maintains existing IT applications and products to ensure optimal functionality.
</li><li>Acts as the leader, supervisor, and primary point of contact for their assigned team.
</li><li>Coordinates closely with other IT staff and business partners to accomplish the collective goals and objectives of assigned programs, projects, and activities.
</li><li>Develops, maintains, and enforces various standards, best practices, procedures, policies and standard operating processes.
</li><li>Serves as the subject matter expert, mentor, guide in their respective area of expertise.
</li></ul><p>When assigned to the IT Operations and Infrastructure Team Duties may include, but are not limited to the following:
</p><ul><li>Supports the IT Director and IT Management team in the development, planning, estimating, and implementation of goals, objectives, and other activities for modifications and improvements.
</li><li>Acts as the leader, supervisor, and primary point of contact for the IT Operations and Infrastructure Team.
</li><li>Oversees the desktop support team and/or infrastructure team to ensure that all known incidents and Zendesk tickets are accurately identified and assigned efficiently; ensures that any tickets that cannot be resolved within agreed timeframes are properly escalated.
</li><li>Oversees the desktop support team and/or infrastructure team, and manages the ticket queue and incoming requests related to IT issues.
</li><li>Administers and supports configurations and maintains records of end-user&rsquo;s equipment. Endpoints include laptops, mobile devices, printers, AV systems, and other related peripherals.
</li><li>Oversees the infrastructure configuration and management to support State Bar data retention, security, business continuity, disaster recovery planning/testing, and information risk management policies.
</li><li>Coordinates closely with IT Application Engineering, IT PMO, and IT Product Management teams to accomplish the goals and objectives of assigned programs, projects, and activities.
</li><li>Collaborates with end-users and the system engineer team to ensure optimal functionality and system effectiveness.
</li></ul><p><b>Role Specific Employment Standards
</b></p><p>Knowledge of:
</p><ul><li>Advanced functions of computer information systems, including the core hardware and software components that comprise complex IT systems and networks, as well as personal computer applications, word processing, and spreadsheet programs.
</li><li>Analysis and evaluation techniques to plan, design, integrate, implement, maintain and troubleshoot complex IT systems and networks.
</li><li>Techniques and practices of supervision, leadership, project management, and training.
</li><li>Project management and information systems development, design, and maintenance.
</li><li>Technical, operational, and programming problem-solving analysis.
</li><li>Principles of Agile application development methodologies.
</li><li>Problem identification, analysis and evaluation.
</li><li>Principles of effective writing and verbal presentation.
</li></ul><p>Desired Knowledge:
</p><ul><li>Proficient in building scalable data pipelines using Azure Data Factory, Synapse Analytics, Azure Data Lake, and Logic Apps.
</li><li>Strong SQL skills with experience in data transformation, validation, and optimization for reporting and analytics.
</li><li>Skilled in dimensional modeling and modern data platform design to support dashboarding and analytical use cases.
</li><li>Familiar with data quality frameworks, including validation, anomaly detection, and exception handling processes.
</li><li>Experience with metadata management, data cataloging, and governance tools such as Azure Purview (or equivalents).
</li><li>Familiarity with CI/CD practices and version control systems such as Git.
</li><li>Demonstrated ability to translate business needs into technical requirements and collaborate effectively across IT and business teams.
</li><li>Strong communication, documentation, and stakeholder engagement skills to support alignment and knowledge sharing.
</li><li>Data engineering languages such as Python.
</li><li>Knowledge of data security best practices including encryption, data masking.
</li><li>Familiarity with data visualization tool Power BI.
</li><li>Technical, operational, and programming problem-solving analysis.
</li><li>Problem identification, analysis and evaluation.
</li><li>Principles of effective writing and verbal presentation.
</li></ul><p>Ability to:
</p><ul><li>Exercise independent judgement, decisiveness, and creativity in designing, planning, troubleshooting, and integration of complex systems or networks based on the potential benefits and/or consequences.
</li><li>Analyze, evaluate, present and recommend technology methodologies and solutions.
</li><li>Solve problems with minimal disruption or impact to the organization business functions.
</li><li>Develop technology guidelines and standards.
</li><li>Develop alternative solutions within established guidelines and standards.
</li><li>Prioritize competing requests for service.
</li><li>Develop policies, procedures and standards relevant to the area of expertise.
</li><li>Interpret and implement IT policies, procedures, and standards.
</li><li>Operate modern office equipment including computer hardware, software, and internet and web-based applications.
</li><li>Compile data and prepare narrative and statistical reports.
</li><li>Communicate clearly and concisely, both orally and in writing.
</li><li>Establish and maintain effective interpersonal relationships at all organizational levels as well as with the public.
</li><li>Maintain the confidentiality of information.
</li></ul><p><b>General Employment Standards
</b></p><p>Knowledge of:
</p><ul><li>Advanced functions of computer information systems, including the core hardware and software components that comprise complex IT systems and networks, as well as personal computer applications, word processing, and spreadsheet programs.
</li><li>Analysis and evaluation techniques to plan, design, integrate, implement, maintain and troubleshoot complex IT systems and networks.
</li><li>Techniques and practices of supervision, leadership, project management, and training.
</li><li>Project management and information systems development, design, and maintenance.
</li><li>Technical, operational, and programming problem-solving analysis.
</li><li>Principles of Agile application development methodologies.
</li><li>Problem identification, analysis and evaluation.
</li><li>Principles of effective writing and verbal presentation.
</li></ul><p>Ability to:
</p><ul><li>Exercise independent judgement, decisiveness, and creativity in designing, planning, troubleshooting, and integration of complex systems or networks based on the potential benefits and/or consequences.
</li><li>Analyze, evaluate, present and recommend technology methodologies and solutions.
</li><li>Solve problems with minimal disruption or impact to the organization business functions.
</li><li>Determine the systems or networking requirements to plan for or enhance the core data processing needs for the system or network.
</li><li>Develop technology guidelines and standards.
</li><li>Develop alternative solutions within established guidelines and standards.
</li><li>Direct, schedule, and orchestrate the installation, maintenance, and enhancements of complex IT systems and networks.
</li><li>Prioritize competing requests for service.
</li><li>Develop policies, procedures and standards relevant to the area of expertise.
</li><li>Interpret and implement IT policies, procedures, and standards.
</li><li>Plan, schedule, make work assignments, set priorities, train, mentor, evaluate, and select staff;
</li><li>Operate modern office equipment including computer hardware, software, and internet and web-based applications.
</li><li>Compile data and prepare narrative and statistical reports.
</li><li>Appropriately respond to requests and inquiries from the public, State Bar members, or other departments.
</li><li>Communicate clearly and concisely, both orally and in writing.
</li><li>Establish and maintain effective interpersonal relationships at all organizational levels as well as with the public.
</li><li>Maintain the confidentiality of information.
</li></ul><p><b>Minimum Qualifications
</b></p><p>Education:
</p><ul><li>Bachelor&rsquo;s degree in computer science or a closely related field that develops skills related to the essential duties, or equivalent academic achievement.
</li></ul><p>Experience:
</p><ul><li>Five (5) years of experience at the advanced journey-level in the information systems field including system analysis, business process design, development and implementation of business application solutions or IT project management, of which at least one (1) year was in a lead capacity.
</li></ul><p>License, Certificate, Registration Requirements:
</p><ul><li>Possession of one or more approved information technology certificates and/or completion of other approved technology-related training may substitute for some or all of the required education.
</li></ul><p>Applicants who meet the Minimum Qualifications will be required to successfully complete the State Bar&rsquo;s selection process for this classification.
</p><p><b>About the State Bar
</b></p><p>The State Bar of California&rsquo;s mission is to protect the public and includes the primary functions of licensing, regulation, and discipline of attorneys; the advancement of the ethical and competent practice of law; and support of efforts for greater access to, and inclusion in, the legal system.
</p><p><b>Our Values
</b></p><p>Clarity | Investing in Our People | Excellence | Respect | Growth Mindset</p><p><br>
</p><p><b>DEI Statement
</b></p><p>We are a diverse, equitable, and inclusive workplace where all of our employees and prospective employees experience fairness, dignity, and respect.</p></div><p></p>

Realign

<div>San Francisco, California 94016 Posted March 12th, 2026
 <div></div><p>Looking for more job opportunities? Click here!</p></div>
<br><div><p>Job Type: Full Time</p>
<p>Job Category: IT</p>
<p>Job Description</p>
<p></p><p><b>Job Title:</b> ServiceNow Data Migration Engineer</p><p><b>
Location:</b> San Francisco, CA</p><p></p><p><b><br>
Job Description:</b><br>
We are seeking an experienced <b>ServiceNow Data Migration Engineer</b> to join our team. The ideal candidate will have a strong background in ServiceNow implementations, data migrations, and software development. This role involves configuring ITSM applications, developing solutions, migrating data, and participating in testing and Agile processes.</p><p><b>
Key Responsibilities:</b></p><ul><li>Perform ServiceNow data migrations and ensure accurate data transformation and integration.</li><li>Configure and implement ServiceNow ITSM applications in alignment with approved design plans.</li><li>Implement modules including Incident Management, Problem Management, Change Management, Knowledge Management, Service Catalog, Mobile App, and Virtual Agent.</li><li>Develop ServiceNow solutions using JavaScript, Jelly, Web Services, XML, HTML, and CSS.</li><li>Create SQL and LDAP queries to extract and migrate data from Oracle, MySQL, and Active Directory.</li><li>Establish repeatable processes for development, test, staging, and production environments with high reliability.</li><li>Participate in unit testing, system integration testing, performance testing, user acceptance testing, and client-specific testing.</li><li>Collaborate with project team members in Agile/Scrum ceremonies, including planning, pre-iteration, and retrospectives.</li><li>Communicate effectively with both technical and non-technical stakeholders.</li></ul><p><b>
Required Qualifications &amp; Skills:</b></p><ul><li>ServiceNow Certified Systems Administrator</li><li>Strong experience with ServiceNow data migrations</li><li>Experience with ServiceNow ITSM modules</li><li>Knowledge of software development lifecycle (SDLC)</li><li>Familiarity with Agile/Scrum methodology</li><li>Basic understanding of ITIL/industry standards</li><li>Strong interpersonal and communication skills</li></ul><p><b>
Education:</b></p><ul><li>Bachelor&rsquo;s degree in Computer Science or a related field</li></ul><p></p>
<p>Required Skills</p>
<p>CLOUD SECURITY ENGINEER</p> <p>DEVOPS ENGINEER</p> <p>SENIOR EMAIL SECURITY ENGINEER</p></div>

ServiceNow Data Migration Engineer-7

ACR Technology Inc

<p>Job Description: Data Engineer Eligibility:<br/>Only U.S. Citizen or Green Card<br/>Responsibilities<br/>Design, build, and maintain scalable ETL pipelines, data workflows, and data warehousing solutions for analytics and reporting. Develop and optimize data modeling solutions, databases, and large-scale datasets using platforms such as Google BigQuery, Hive, and cloud-native technologies. Write and optimize complex SQL queries and implement Python, Spark, and Scala-based data transformations. Build and maintain batch and streaming data pipelines using Spark, PySpark, Scala, and messaging systems such as Kafka. Orchestrate workflows and automate data processes using Apache Airflow. Integrate data from multiple sources, including third-party systems via REST APIs, ensuring data quality, consistency, governance, and compliance. Collaborate with product, engineering, and business teams to translate requirements into scalable technical solutions. Test, deploy, monitor, and support data solutions across cloud environments (AWS, Azure, or GCP). Document processes, contribute to continuous improvement initiatives, and provide technical guidance to users and cross-functional teams.</p><p>Qualifications<br/>5+ years of experience in data engineering, analytics, or related fields. Advanced proficiency in SQL and strong programming skills in Python and/or Scala. Hands-on experience with ETL processes, data modeling, and data warehousing concepts. Experience working with cloud data platforms such as Google BigQuery, AWS, or Azure. Strong experience with Spark (PySpark/Scala) and big data technologies such as Hive and Kafka. Experience building and managing workflows using Apache Airflow. Experience integrating systems using REST APIs. Knowledge of data governance, data quality, and compliance best practices. Bachelor&rsquo;s degree in Computer Science, Engineering, or equivalent experience.</p><p>Pay: $60.00 - $70.00 per hour</p><p>Work Location: In person</p>

Data Engineer (Only local to California, W2, GC and USC )

Explore 487+ Cloud data engineer in San Francisco this March. Find roles across top companies and apply now to boost your career.

487 cloud data engineer jobs In San Francisco

Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer (SS&C Technologies, Inc.; San Francisco, CA): Ref 00087619

Lead Data Engineer

ServiceNow Data Migration Engineer-7

Data Engineer (Only local to California, W2, GC and USC )