software engineer

data engineer

data scientist

machine learning engineer Jobs in San Francisco

machine learning engineer

ai engineer (assistant) Jobs in San Francisco

ai engineer (assistant)

data pipeline engineer

ROLLER

<div><h2 class="jobSectionHeader"><b>About ROLLER</b></h2>
<p>
ROLLER is not your average software-as-a-service company. With a global presence in over 30 countries, we're here to bring some excitement to the leisure and attractions industry and make a difference! Our mission is to help businesses operate smoothly and create fun and memorable guest experiences by providing seamless ticketing, point-of-sale, self-serve kiosks, memberships and digital waiver processes.</p>
<p>
But here's the best part: our team. We're a group of 300+ highly passionate, enthusiastic, and down-to-earth professionals located all around the world who are all working together to build something truly remarkable. We're aiming high and believe that the possibilities are endless. As we continue to grow globally, we're excited to write our success story and have fun along the way.</p>
<p>
We genuinely love what we do, and we're looking for like-minded people to join us on this amazing journey. If you're ready to be part of a dynamic team and make a real impact, come aboard, and let's create some unforgettable experiences together at ROLLER!</p><br>
<p></p>
<h2 class="jobSectionHeader"><b>
About the Role</b></h2>
<p>
We are seeking a highly technical, hands-on <b>Senior</b> <b>Data Engineer</b> to architect and scale our data infrastructure from the ground up. As a core member of the data function within our Business Technology team, you will be responsible for building the pipelines and models that power smarter decision-making and operational efficiency across the entire organization.</p>
<p>
In this foundational role, you will build &amp; architect the <b>modern data stack</b>, ensuring our infrastructure is robust, automated, and governed. You collaborate as a technical partner with <b>GTM</b> <b>,Product, Finance, P&amp;C </b>to build high-performance data models and pipelines that transform raw data into actionable cross-functional insights.</p>
<p>
Joining ROLLER at this pivotal growth stage, you will have the opportunity to make an outsized impact on our technical landscape, directly influencing how we process data to deliver world-class experiences for our customers globally.</p><br>
<p></p>
<p><b>
What You'll Do</b></p>
<ul>
<li><b>Scalable Architecture:</b> Design and implement robust <b>Data Modeling and Architecture</b> strategies that support high-volume data processing and maintain long-term scalability.</li>
<li><b>Cloud Ecosystem:</b> Develop and manage end-to-end data pipelines using <b>Google Cloud Platform</b> services, specifically leveraging <b>Cloud Run, Cloud Function</b> for compute, <b>BigQuery</b> for storage, and <b>Cloud Composer (Airflow)</b> for orchestration.</li>
<li><b>Transformation Excellence:</b> Build, maintain, and document complex data transformation layers using <b>DBT (Data Build Tool)</b> to ensure high data quality and reliability.</li>
<li><b>Infrastructure as Code:</b> Automate the provisioning of cloud resources using <b>Terraform</b> and streamline deployment workflows via <b>GitHub Actions</b> CI/CD pipelines.</li>
<li><b>Cloud Data Warehousing:</b> Demonstrate expert-level proficiency in managing and optimizing <b>Cloud Data Warehouses</b>, such as <b>Snowflake</b> &amp; <b>BigQuery</b>.</li>
<li><b>Team Collaboration:</b> Partner with cross-functional stakeholders to build and scale high-performing data infrastructure that supports engineering, analytics, and Data Program needs.</li>
<li><b>Stack Management:</b> Architect and maintain a modern data stack by implementing best-in-class tools including <b>Snowflake</b>, <b>Bigquery</b>, <b>dbt</b>, <b>Fivetran</b>, <b>Looker</b>, <b>Tableau</b> and <b>Airflow</b>.</li>
<li><b>Pipeline Engineering:</b> Develop scalable ETL/ELT workflows and robust data models to deliver real-time analytics and unified business reporting.</li>
<li><b>Data Visualization: Create and maintain intuitive, high-performance Looker dashboards will be an added advantage.</b></li></ul><br>
<p></p>
<h2 class="jobSectionHeader"><b>
About You</b></h2>
<p>
You are a technical builder who views data as a competitive advantage. You thrive in fast-paced environments and have a proven track record of engineering scalable data foundations from the ground up. Equal parts <b>architect and analytical problem-solver</b>, you excel at balancing long-term technical vision with the daily hands-on execution of complex pipelines.</p>
<p>
You are energized by the full lifecycle of data&mdash;moving beyond just writing code to actively leading <b>project discovery and analysis</b> alongside cross-functional partners. You take pride in enabling GTM, Product, Finance &amp; P&amp;C teams through clear insights and high-performance systems. Most importantly, you are excited to act as a founding technical force for a high-growth SaaS company that is transforming the guest experience for attractions businesses globally.</p><br>
<p></p>
<ul>
<li><b>5+ years of experience</b> in Data &amp; Analytics or Data Engineering with a focus on Scalable cloud driven data pipeline build</li>
</ul><ul><li>Proven experience in <b>dimensional modeling </b>(Star/Snowflake schema) and designing architectures that support both historical reporting and real-time needs.</li>
<li>Expert-level proficiency in <b>Snowflake</b> or <b>BigQuery</b>, including performance tuning, cost optimization, and access control (RBAC).</li>
<li>Hands-on experience with Google Cloud Platform services, specifically <b>Cloud Function</b>, <b>Cloud Run</b> for containerized workloads and <b>Cloud Composer</b> for orchestration.</li>
</ul><ul><li>Through hands-on experience of <b>dbt (Data Build Tool)</b> to manage transformations, including writing custom macros, implementing tests, and generating documentation.</li>
<li>Solid experience using <b>Terraform</b> to provision cloud resources, ensuring that infrastructure is version-controlled and reproducible.</li>
<li>Proficiency in <b>GitHub Actions</b> to automate testing and deployment pipelines for data models and infrastructure.</li>
<li>Ability to design high-performance dashboards that prioritize user experience and fast load times.</li>
</ul><ul><li>Experience collaborating with <b>Finance, GTM, and Product</b> to define key metrics (like CAC, LTV, or Churn) and codifying them into the data layer.</li>
<li>Familiarity with data ingestion tools like <b>Fivetran</b> , <b>Airbyte, Workato, Mulesoft</b> to sync data from various SaaS platforms into the warehouse.</li>
</ul><ul><li>Operates as a <b>full-stack Data Engineer</b> with the technical authority to architect and build entire data lifecycles, from raw source ingestion to high-impact data visualization.</li>
<li><b>Familiarity with business-critical systems</b> like Salesforce, Chargbee, Gainsight, and product analytics tools.</li>
<li><b>Strong communicator</b> with a track record of working across technical and non-technical teams to drive alignment.</li></ul><br>
<p></p>
<p><b>
Preferred Qualifications</b></p>
<ul>
<li>Experience partnering with <b>IT or Business Technology teams</b> to drive cross-functional outcomes.</li>
<li>Exposure to <b>customer success and revenue workflows</b>, such as onboarding journeys, renewal metrics, or support analytics.</li>
<li>Familiarity with <b>AI/ML pipelines</b> and experimentation frameworks that support data-driven innovation.</li></ul><br>
<p></p>
<h2 class="jobSectionHeader"><b>
Perks!</b></h2>
<ul><li>You'll get to work on a category-leading product that customers love in a fun, high-growth industry! Check our Capterra and G2 reviews.</li>
<li>4 ROLLER Recharge days per year (When we hit our goals each quarter, we take a well-earned day off together to relax, recharge, and celebrate our wins).</li>
<li>Engage in our 'Vibe Tribe' - led by our team members; you can contribute to company-wide initiatives directly. Regular events and social activities, fundraising &amp; cause-related campaigns...you name it. We're willing to make it happen!</li>
<li>Team Member Assistance Program to proactively support our team's health and wellbeing - access to coaching, education modules, weekly webinars, and more.</li>
<li>16 weeks paid Parental Leave for primary carers and 4 weeks paid Parental Leave for secondary carers.</li>
<li>Work with a driven, fun, and switched-on team that likes to raise the bar in all we do!</li>
<li>Individual learning &amp; development budget plus genuine career growth opportunities as we continue to expand!</li></ul><br>
<p></p>
<h2 class="jobSectionHeader"><b>
What You Can Expect</b></h2>
<div><ul><li><b>Initial call with our Talent Acquisition Manager</b><br>
You'll have an initial call with our Talent Acquisition Manager to chat through some of your experience to date, salary expectations and you can check off any initial questions you might have.</li></ul>
<ul><li><b>Interview with the Hiring Manager</b><br>
You'll get to meet with the hiring manager to learn more about the role &amp; ROLLER whilst also talking through your experience in more detail.</li></ul>
<ul><li><b>Loop Interviews</b><br>
This is where you will get to meet our wider ROLLER team to do a 'vibe check' on us to make sure our culture &amp; vibe meet what you are looking for!</li></ul>
<ul><li><b>Offer</b><br>
If all lights are green and the fit feel right, we'll conduct reference checks and you'll receive an offer to join!</li></ul></div></div>

Data Engineer

MERCOR

<div><p>A prestigious tech company is seeking a Software Engineer II to join their Safe Ads Experiences (SAE) team. This team is building the next-generation data collection platform SPECTRA, which will shape the future of how human-labeled data is collected and used in the company's systems. The role offers the opportunity to impact responsible advertising, user data privacy, and public trust through data-driven insights.</p><p><b>
Responsibilities</b></p><ul><li>
Drive technical implementation and testing of complex data pipeline features within the SPECTRA platform, ensuring robust end-to-end functionality and meeting project release timelines
</li><li>Design and develop data processing pipelines using SQL and Python to handle large-scale data collection, transformation, and quality monitoring workflows
</li><li>Build and maintain dashboards and visualization tools to provide visibility into data quality, rater performance, and platform metrics for stakeholders across multiple teams
</li><li>Create comprehensive end-to-end tests and monitoring alerts to ensure platform reliability, data integrity, and proactive identification of issues in the data collection workflow
</li><li>Debug and troubleshoot complex data flow issues across the SPECTRA platform, identifying root causes and implementing solutions to maintain high system availability
</li><li>Collaborate closely with Technical Leads and engineering teams to implement backend data processing logic and ensure adherence to development standards and best practices
</li><li>Partner with Product Data Operations (PDO) teams to coordinate human labeling workflows, budget planning, vendor management, and rater performance optimization
</li><li>Work with Taxonomists and Data Labeling Analysts to ensure proper data classification, labeling guidelines implementation, and quality assurance processes
</li><li>Coordinate with vendor partners to support external data collection operations, ensuring seamless integration with SPECTRA's multi-review and quality monitoring systems
</li><li>Support smart sampling initiatives and targeted data collection strategies that have delivered significant cost savings and improved data quality across advertising systems
</li></ul><p><b>Qualifications</b></p><ul><li>
Experience in SQL development writing complex queries, data transformations, and working with large datasets in production environments
</li><li>Proficient in Python with experience in data processing, automation, and pipeline development using object-oriented programming principles
</li><li>Experience with data engineering pipelines including ETL processes, data modeling, and building scalable data processing workflows
</li><li>Hands-on experience with data visualization and dashboard tools such as Tableau or similar platforms for creating actionable insights from large datasets
</li><li>Strong analytical and problem-solving skills with demonstrated ability to debug complex data issues and implement effective solutions
</li><li>Experience with data quality monitoring and automated testing frameworks to ensure data accuracy, completeness, and reliability
</li></ul><div>Preferred Qualifications:<br>
<ul><li>Degree in Computer Science or related field</li><li>Machine Learning experience with understanding of ML model training data requirements, feature engineering, and model evaluation metrics</li><li>Experience building and scaling large products or systems</li><li>Experience with building privacy and ads-related products is a big plus</li><li>Experience working with human labeling and annotation systems including workflow design, quality assurance, and vendor management in data collection operations</li><li>Prior experience working with the company or its internal tools is a plus
</li></ul></div><p>Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation.</p><p><b>
About Cincinnatus</b></p><p>
Cincinnatus is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for full-time and long-term contingent roles. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.</p><p>
Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve full-time or fixed-term commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows.</p><p>
Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus.</p><p><b>
Equal Employment Opportunity</b></p><p>
Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.</p><p>
Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.</p></div>

Software Engineer II

Qcells

<div><p><b>Description</b>
</p><h3 class="jobSectionHeader"><b>POSITION DESCRIPTION:</b></h3><br>
We are seeking a <b>Senior Data Engineer</b> to build and maintain scalable, cloud-based data pipelines that support enterprise analytics and operational reporting. This role will design and optimize ETL/ELT workflows using Azure data services (Fabric, Data Lake, Data Factory), integrate data from ERP, CRM, and other operational systems, and develop high-quality data models within a modern lakehouse architecture. The ideal candidate brings strong SQL and Python expertise, hands-on experience with distributed data platforms, and a solid understanding of data modeling, governance, and performance optimization, partnering closely with architects, analysts, and application teams to deliver reliable, well-structured datasets across the organization.<h3 class="jobSectionHeader"><b>
RESPONSIBILITIES</b></h3><ul><li>
Build and maintain s1calable data pipelines supporting ingestion, transformation, and consumption across the enterprise.</li><li>
Develop ETL/ELT workflows using Fabric or similar platforms.</li><li>
Implement and optimize data flows from ERP (NetSuite/SAP), CRM (Salesforce), internal systems, and third‑party feeds.</li><li>
Design and maintain high‑quality data models to support analytics, reporting, and operational use cases.</li><li>
Work closely with the Data Architect to implement lakehouse patterns, Delta Lake modeling, and domain‑driven designs.</li><li>
Ensure data quality, validation, and lineage tracking through automated frameworks.</li><li>
Optimize pipeline performance, scalability, and cost efficiency across cloud environments.</li><li>
Collaborate with analysts and application teams to deliver reliable, well‑structured datasets.</li><li>
Contribute to MDM, metadata management, and governance initiatives.</li><li>
Support CI/CD automation, testing, and monitoring for data workflows.</li></ul><h3 class="jobSectionHeader"><b>
MINIMUM QUALIFICATIONS</b></h3><ul><li>
3+ years of experience in data engineering or similar roles.</li><li>
Hands‑on experience with Azure data services (Data Lake, Data Factory, or Fabric).</li><li>
Strong proficiency in SQL and at least one scripting language (Python preferred).</li><li>
Experience building ETL/ELT pipelines using modern tools and frameworks.</li><li>
Understanding of data modeling concepts (star schema, dimensional, lakehouse modeling).</li><li>
Familiarity with structured/unstructured data, Delta Lake, and distributed compute (Spark is a plus).</li><li>
Experience integrating data from ERP, CRM, or operational systems.</li><li>
Knowledge of data quality, metadata, and basic governance principles.</li><li>
Strong debugging, problem‑solving, and performance‑optimization skills.</li><li>
Travel may be required up to 5%, depending on business needs.</li></ul><h3 class="jobSectionHeader"><b>
PREFERRED QUALIFICATIONS</b></h3><ul><li>
Experience with Delta Tables, Snowflake, or similar platforms.</li><li>
Exposure to event‑driven or streaming frameworks (Kafka/EventHub).</li><li>
Familiarity with finance, operations, energy, or ERP‑related data domains.</li><li>
Working knowledge of APIs and integration patterns.</li><li>
Azure certifications (Data Engineer Associate or equivalent).</li><li>
Experience supporting analytics teams or ML workflows.</li></ul><br>
Hanwha Q CELLS Technologies, Inc. a subsidiary of Hanwha Q CELLS, one of the world&acute;s largest and most recognized photovoltaic manufacturers for its high-performance, high-quality solar cells and modules. It is headquartered in Seoul, South Korea (Global Executive HQ) Talheim, Germany (Technology &amp; Innovation HQ) and Santa Clara, CA, USA (HW and SW Product Development HQ). Through its growing global business network spanning Europe, North America, Asia, South America, Africa, and the Middle East, the company provides excellent services and long-term partnerships to its customers in the utility, commercial, government, and residential markets. Hanwha Q CELLS is a flagship company of Hanwha Group, a FORTUNE Global 500 firm and a Top 7 business enterprise in South Korea.<br>
<br>
<div><div><div><br>
<b>PHYSICAL, MENTAL &amp; ENVIRONMENTAL DEMANDS:</b><br>
To comply with the Rehabilitation Act of 1973 the essential physical, mental and environmental requirements for this job are listed below. These are requirements <i>normally expected</i> to perform <i>regular</i> job duties. Incumbent must be able to successfully perform all of the functions of the job with or without reasonable accommodation.</div></div><div><div><div><div><b><br>
Mobility</b></div></div><br>
<div><div><br>
Standing</div><div><br>
20% of time</div></div><br>
<div><div><br>
Sitting</div><div><br>
70% of time</div></div><br>
<div><div><br>
Walking</div><div><br>
10% of time</div></div><br>
<div><div><br>
<b>
Strength</b></div></div><br>
<div><div><br>
Pulling</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Pushing</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Carrying</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Lifting</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
<b>
Dexterity</b> <b>(F = Frequently, O = Occasionally, N = Never)</b></div></div><br>
<div><div><br>
Typing</div><div><br>
F</div></div><br>
<div><div><br>
Handling</div><div><br>
F</div></div><br>
<div><div><br>
Reaching</div><div><br>
F</div></div></div><div><div><div><b><br>
Agility</b> <b>(F = Frequently, O = Occasionally, N = Never)</b></div></div><br>
<div><div><br>
Turning</div><div><br>
F</div></div><br>
<div><div><br>
Twisting</div><div><br>
F</div></div><br>
<div><div><br>
Bending</div><div><br>
O</div></div><br>
<div><div><br>
Crouching</div><div><br>
O</div></div><br>
<div><div><br>
Balancing</div><div><br>
N</div></div><br>
<div><div><br>
Climbing</div><div><br>
N</div></div><br>
<div><div><br>
Crawling</div><div><br>
N</div></div><br>
<div><div><br>
Kneeling</div><div><br>
N</div></div></div></div></div><div></div><p><br>
The salary range is required by the California Pay Transparency Act and may differ depending on the location of those candidates hired nationwide. Actual compensation is influenced by a wide array of factors including but not limited to, skill set, education, licenses and certifications, essential job duties and requirements, and the necessary experience relative to the job&rsquo;s minimum qualifications.</p>
<ul><li>This target salary range is for CA positions only and should not be interpreted as an offer of compensation.</li></ul>
You may view your privacy rights by reviewing Qcells' Privacy Policy or by contacting our HR team for a copy.</div>

Senior Data Engineer

ACR Technology Inc

<p>Job Description: Data Engineer Eligibility:<br/>Only U.S. Citizen or Green Card<br/>Responsibilities<br/>Design, build, and maintain scalable ETL pipelines, data workflows, and data warehousing solutions for analytics and reporting. Develop and optimize data modeling solutions, databases, and large-scale datasets using platforms such as Google BigQuery, Hive, and cloud-native technologies. Write and optimize complex SQL queries and implement Python, Spark, and Scala-based data transformations. Build and maintain batch and streaming data pipelines using Spark, PySpark, Scala, and messaging systems such as Kafka. Orchestrate workflows and automate data processes using Apache Airflow. Integrate data from multiple sources, including third-party systems via REST APIs, ensuring data quality, consistency, governance, and compliance. Collaborate with product, engineering, and business teams to translate requirements into scalable technical solutions. Test, deploy, monitor, and support data solutions across cloud environments (AWS, Azure, or GCP). Document processes, contribute to continuous improvement initiatives, and provide technical guidance to users and cross-functional teams.</p><p>Qualifications<br/>5+ years of experience in data engineering, analytics, or related fields. Advanced proficiency in SQL and strong programming skills in Python and/or Scala. Hands-on experience with ETL processes, data modeling, and data warehousing concepts. Experience working with cloud data platforms such as Google BigQuery, AWS, or Azure. Strong experience with Spark (PySpark/Scala) and big data technologies such as Hive and Kafka. Experience building and managing workflows using Apache Airflow. Experience integrating systems using REST APIs. Knowledge of data governance, data quality, and compliance best practices. Bachelor&rsquo;s degree in Computer Science, Engineering, or equivalent experience.</p><p>Pay: $60.00 - $70.00 per hour</p><p>Work Location: In person</p>

Data Engineer (Only local to California, W2, GC and USC )

Adobe

<div>
 <strong>
  Our Company
  <br/>
  <br/>
 </strong>
 Changing the world through digital experiences is what Adobe&rsquo;s all about. We give everyone&mdash;from emerging artists to global brands&mdash;everything they need to design and deliver exceptional digital experiences! We&rsquo;re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.
 <br/>
 <br/>
 We&rsquo;re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!
 <br/>
 <br/>
 Adobe Customer Solutions is looking for a full time Data Engineer with experience in building data integrations using AWS technology stack as part of the team's Data as a Service portfolio for Adobe&rsquo;s Digital Experience enterprise customers.
 <br/>
 <br/>
 Customer facing Engineers who enjoy tackling complex technical challenges, have a passion for delighting customers and who are self-motivated to push themselves in a team oriented culture will thrive in our environment
 <br/>
 <br/>
 What you&rsquo;ll do
 <br/>
 <br/>
 <ul>
  <li>
   Collaborate with Data architects, Enterprise architects, Solution consultants and Product engineering teams to capture customer data integration requirements, conceptualize solutions &amp; build required technology stack
  </li>
  <li>
   Collaborate with enterprise customer's engineering team to identify data sources, profile and quantify quality of data sources, develop tools to prepare data and build data pipelines for integrating customer data sources and third party data sources with Adobe solutions
  </li>
  <li>
   Develop new features and improve existing data integrations with customer data ecosystem
  </li>
  <li>
   Encourage team to think out-of-the-box and overcome engineering obstacles while incorporating new innovative design principles.
  </li>
  <li>
   Collaborate with a Project Manager to bill and forecast time for customer solutions
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Requirements
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Experience as an enterprise Data Engineer from a consulting background
  </li>
  <li>
   AWS Certified Data Engineer &ndash; Associate or AWS Certified Cloud Practitioner
  </li>
  <li>
   5+ years experience in building/operating/maintaining fault tolerant and scalable data processing integrations using AWS
  </li>
  <li>
   7+ years experience in Python programming language preferably using PySpark
  </li>
  <li>
   Software development experience working with Apache Airflow, MongoDB, MySQL
  </li>
  <li>
   Strong capacity to manage numerous projects are a must
  </li>
  <li>
   Experience using Docker or Kubernetes is a plus
  </li>
  <li>
   BS/MS degree in Computer Science or equivalent industry experience
  </li>
  <li>
   Ability to identify and resolve problems associated with production grade large scale data processing workflows
  </li>
  <li>
   Excellent communication skills (we&rsquo;re a geographically distributed team)
  </li>
  <li>
   Experience creating and maintaining unit tests and continuous integration.
  </li>
  <li>
   Passion for creating Intelligent data pipelines that customers love to use.
   <br/>
   <br/>
  </li>
 </ul>
 Special Consideration given for
 <br/>
 <br/>
 <ul>
  <li>
   Experience &amp; knowledge with Web Analytics or Digital Marketing
  </li>
  <li>
   Experience &amp; knowledge with Customer Data Platform (CDP) or Data Management Platform (DMP)
  </li>
  <li>
   Experience &amp; knowledge with Adobe Experience Cloud solutions
   <br/>
   <br/>
  </li>
 </ul>
 Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $114,100 -- $214,950 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.
 <br/>
 <br/>
 In California, the pay range for this position is $148,500 - $214,950 In New York, the pay range for this position is $148,500 - $214,950 In Washington, the pay range for this position is $135,100 - $195,550
 <br/>
 <br/>
 At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).
 <br/>
 <br/>
 In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.
 <br/>
 <br/>
 <strong>
  State-Specific Notices:
  <br/>
  <br/>
 </strong>
 <strong>
  California:
  <br/>
  <br/>
 </strong>
 <strong>
  Fair Chance Ordinances
  <br/>
  <br/>
 </strong>
 Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and &ldquo;fair chance&rdquo; ordinances.
 <br/>
 <br/>
 <strong>
  Colorado:
  <br/>
  <br/>
 </strong>
 <strong>
  Application Window Notice
  <br/>
  <br/>
 </strong>
 If this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.
 <br/>
 <br/>
 <strong>
  Massachusetts:
  <br/>
  <br/>
 </strong>
 <strong>
  Massachusetts Legal Notice
  <br/>
  <br/>
 </strong>
 It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
 <br/>
 <br/>
 Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more.
 <br/>
 <br/>
 Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.
</div>


Mento

<div><h3 class="jobSectionHeader"><b>About Mento</b></h3>
<p>
Mento is a career technology company that helps people be exceptional and thrive at work through human, AI, and software-based coaching. We're on a mission to provide people access to the best support, advice, and mentorship at work and empower them to take action on it. In a world where jobs and careers are rapidly changing, we believe that transformational growth and continuous improvement is mandatory for people and companies to thrive. We are on a mission to bring our unique model of coaching to every member of the global workforce.</p>
<p>
We strive to create a fun, conscientious, collaborative, and supportive work environment. We are a US-based, remote-first company, backed by leading VCs and angel investors.</p>
<h3 class="jobSectionHeader"><b>
About The Role</b></h3>
<p>
We're looking for our first Data Engineer to build the data infrastructure that powers insights and features across our coaching platform. You'll own data pipelines for coaching sessions, user analytics, and business operations, while establishing the foundation for our data architecture.</p>
<p>
This is not purely about business analytics - In this role, you'll join our engineering team and work closely with product, engineering, coaching, and leadership teams. You'll be embedded in product development&mdash;understanding feature requirements, instrumenting data collection, and building systems that power product capabilities.</p>
<h3 class="jobSectionHeader"><b>
Key Responsibilities:</b></h3>
<p>
Build data pipelines for coaching and user analytics. You'll create pipelines that process coaching session data, user interactions, and AI-generated outputs. These pipelines will power everything from product analytics to coaching effectiveness metrics to business intelligence dashboards.</p>
<p>
Build data systems that power product features. You'll create data pipelines that feed back into the product&mdash;user progress tracking, coaching insights, customer dashboards, and more. You'll work with product and engineering to understand what data products need and build reliable systems to deliver it.</p>
<p>
Establish our data infrastructure and architecture. As our first data engineer, you'll make key decisions about our data stack&mdash;choosing and implementing tools for orchestration, transformation, warehousing, and analytics. You'll build foundations that can scale with the company.</p>
<p>
Process and analyze AI/LLM outputs. You'll work with data from our AI coaching systems, building pipelines to analyze LLM responses, track coaching quality, and generate insights about how users interact with AI coaches.</p>
<p>
Support business operations and analytics. You'll build data systems that track customer success metrics, billing data, user engagement, and operational KPIs. Your work will directly inform business decisions and product strategy.</p>
<p>
Create accessible analytics infrastructure. You'll build systems that make data available to non-technical stakeholders through dashboards, reports, and self-service analytics tools. You'll think about data quality, documentation, and usability.</p>
<p>
Work closely with product on instrumentation and data collection. You'll collaborate with product and engineering teams to instrument new features, define events and metrics, and ensure we're collecting the right data. You'll be involved in product discussions and understand feature requirements from a data perspective.</p>
<h3 class="jobSectionHeader"><b>
Who We're Looking For</b></h3>
<p>
We're looking for a data engineer with mid to senior-level experience who can work independently, make architectural decisions, and build data systems from the ground up.</p><br>
<p>
You have strong data engineering fundamentals. You're experienced with SQL, Python, and building data pipelines. You understand data modeling, ETL/ELT patterns, and how to design scalable data architectures. You've worked with databases like PostgreSQL and have opinions on data infrastructure tools.</p>
<p>
Bonus: You're comfortable with Go. Our backend stack is Ruby and Go, with new development preferentially in Go. While we are happy to use Python as the primary language for data work, comfort with Go is a plus for building production data services and working closely with the backend team.</p>
<p>
You can drive technical decisions about data infrastructure. You've evaluated and implemented data tools before&mdash;whether orchestration frameworks, warehouses, transformation tools, or BI platforms. You can assess our needs and recommend the right stack for an early-stage company.</p>
<p>
You're comfortable working with diverse data sources. You'll work with operational databases, event streams (Redis), document stores (Elasticsearch), API data, and LLM outputs. You can navigate different data formats and build reliable integrations.</p>
<p>
You're comfortable working closely with product teams. You've worked embedded with product and engineering, participated in product discussions, and built data systems that directly power product features. You understand the difference between building for analysis versus building for production product use.</p>
<p>
You can build both analytical and operational data pipelines. You've built pipelines for analytics and business intelligence, but you've also built systems that feed data back into products in real-time or near-real-time. You understand the different requirements and tradeoffs.</p>
<p>
You have some experience with AI/ML data. You've worked with LLM outputs, unstructured data, or analytics for AI-powered products. You understand the unique challenges of working with AI-generated content and can design appropriate data models.</p>
<p>
You work well independently in an early-stage environment. You're comfortable with ambiguity and can prioritize work without extensive direction. You can balance building for immediate needs while creating foundations for future scale.</p>
<h3 class="jobSectionHeader"><b>
Why Work with Us?</b></h3>
<p>
We are a company dedicated to empowering professionals to live meaningful careers. That starts with our culture at Mento.</p>
<p>
You're excited about building data infrastructure that serves multiple purposes&mdash;analytics, business intelligence, and powering product features. You want to work closely with product teams and see your data systems directly impact user experience.</p>
<p>
We work hard to foster a workplace built around trust, respect, and collaboration. As a remote-first company, we believe in flexibility and autonomy&mdash;as long as you're delivering great work and staying connected with your teammates, you can work from anywhere.</p>
<p>
This is an opportunity to join an early-stage, mission-driven team as the founding data engineer. You'll have significant ownership over our data architecture and direct impact on both product and business strategy.</p>
<p>
We strongly believe that diversity of experience, perspectives, and background will lead to a better environment for our employees and a better product for our users. If you're passionate about building data systems that help people thrive at work, we want to hear from you.</p><br>
<p></p>
<p><b>
Other benefits and perks include:</b></p>
<p><i>
✈️ Fully Remote - ability to work from anywhere with bi-annual team offsites</i></p>
<p><i>
 Competitive salary and equity</i></p>
<p><i>
 Medical, dental, vision, and a 401k plan</i></p>
<p><i>
 Unlimited vacation (We actually mean this! it's important to keep yourself fresh)</i></p>
<p><i>
 $500 home office stipend</i></p>
<p><i>
 Access to your own Mento Coach</i></p></div>

OpenAI

<div>
 <strong>
  About The Team
  <br/>
  <br/>
 </strong>
 The Applied team works across research, engineering, product, and design to bring OpenAI&rsquo;s technology to consumers and businesses.
 <br/>
 <br/>
 We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.
 <br/>
 <br/>
 <strong>
  About The Role
  <br/>
  <br/>
 </strong>
 We're seeking a Data Engineer to take the lead in building our data pipelines and core tables for OpenAI. These pipelines are crucial for powering analyses, safety systems that guide business decisions, product growth, and prevent bad actors. If you're passionate about working with data and are eager to create solutions with significant impact, we'd love to hear from you. This role also provides the opportunity to collaborate closely with the researchers behind ChatGPT and help them train new models to deliver to users. As we continue our rapid growth, we value data-driven insights, and your contributions will play a pivotal role in our trajectory. Join us in shaping the future of OpenAI!
 <br/>
 <br/>
 <strong>
  In This Role, You Will
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Design, build and manage our data pipelines, ensuring all user event data is seamlessly integrated into our data warehouse.
  </li>
  <li>
   Develop canonical datasets to track key product metrics including user growth, engagement, and revenue.
  </li>
  <li>
   Work collaboratively with various teams, including, Infrastructure, Data Science, Product, Marketing, Finance, and Research to understand their data needs and provide solutions.
  </li>
  <li>
   Implement robust and fault-tolerant systems for data ingestion and processing.
  </li>
  <li>
   Participate in data architecture and engineering decisions, bringing your strong experience and knowledge to bear.
  </li>
  <li>
   Ensure the security, integrity, and compliance of data according to industry and company standards.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  You Might Thrive In This Role If You
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Have 3+ years of experience as a data engineer and 8+ years of any software engineering experience(including data engineering).
  </li>
  <li>
   Proficiency in at least one programming language commonly used within Data Engineering, such as Python, Scala, or Java.
  </li>
  <li>
   Experience with distributed processing technologies and frameworks, such as Hadoop, Flink and distributed storage systems (e.g., HDFS, S3).
  </li>
  <li>
   Expertise with any of ETL schedulers such as Airflow, Dagster, Prefect or similar frameworks.
  </li>
  <li>
   Solid understanding of Spark and ability to write, debug and optimize Spark code.
   <br/>
   <br/>
  </li>
 </ul>
 This role is exclusively based in our San Francisco HQ. We offer relocation assistance to new employees.
 <br/>
 <br/>
 <strong>
  About OpenAI
  <br/>
  <br/>
 </strong>
 OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
 <br/>
 <br/>
 We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
 <br/>
 <br/>
 For additional information, please see OpenAI&rsquo;s Affirmative Action and Equal Employment Opportunity Policy Statement.
 <br/>
 <br/>
 Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
 <br/>
 <br/>
 To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
 <br/>
 <br/>
 We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
 <br/>
 <br/>
 OpenAI Global Applicant Privacy Policy
 <br/>
 <br/>
 At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
 <br/>
 <br/>
 Compensation Range: $230K - $385K
</div>


Data Engineer, Analytics

Explore 303+ Data pipeline engineer in San Francisco this March. Find roles across top companies and apply now to boost your career.

303 data pipeline engineer jobs In San Francisco

Data Engineer

Software Engineer II

Senior Data Engineer

Data Engineer (Only local to California, W2, GC and USC )

Data Engineer

Data Engineer

Data Engineer, Analytics