software engineer

data engineer

data scientist

machine learning engineer Jobs in San Francisco

machine learning engineer

ai/ml engineer

senior data engineer

Qcells

<div><p><b>Description</b>
</p><h3 class="jobSectionHeader"><b>POSITION DESCRIPTION:</b></h3><br>
We are seeking a <b>Senior Data Engineer</b> to build and maintain scalable, cloud-based data pipelines that support enterprise analytics and operational reporting. This role will design and optimize ETL/ELT workflows using Azure data services (Fabric, Data Lake, Data Factory), integrate data from ERP, CRM, and other operational systems, and develop high-quality data models within a modern lakehouse architecture. The ideal candidate brings strong SQL and Python expertise, hands-on experience with distributed data platforms, and a solid understanding of data modeling, governance, and performance optimization, partnering closely with architects, analysts, and application teams to deliver reliable, well-structured datasets across the organization.<h3 class="jobSectionHeader"><b>
RESPONSIBILITIES</b></h3><ul><li>
Build and maintain s1calable data pipelines supporting ingestion, transformation, and consumption across the enterprise.</li><li>
Develop ETL/ELT workflows using Fabric or similar platforms.</li><li>
Implement and optimize data flows from ERP (NetSuite/SAP), CRM (Salesforce), internal systems, and third‑party feeds.</li><li>
Design and maintain high‑quality data models to support analytics, reporting, and operational use cases.</li><li>
Work closely with the Data Architect to implement lakehouse patterns, Delta Lake modeling, and domain‑driven designs.</li><li>
Ensure data quality, validation, and lineage tracking through automated frameworks.</li><li>
Optimize pipeline performance, scalability, and cost efficiency across cloud environments.</li><li>
Collaborate with analysts and application teams to deliver reliable, well‑structured datasets.</li><li>
Contribute to MDM, metadata management, and governance initiatives.</li><li>
Support CI/CD automation, testing, and monitoring for data workflows.</li></ul><h3 class="jobSectionHeader"><b>
MINIMUM QUALIFICATIONS</b></h3><ul><li>
3+ years of experience in data engineering or similar roles.</li><li>
Hands‑on experience with Azure data services (Data Lake, Data Factory, or Fabric).</li><li>
Strong proficiency in SQL and at least one scripting language (Python preferred).</li><li>
Experience building ETL/ELT pipelines using modern tools and frameworks.</li><li>
Understanding of data modeling concepts (star schema, dimensional, lakehouse modeling).</li><li>
Familiarity with structured/unstructured data, Delta Lake, and distributed compute (Spark is a plus).</li><li>
Experience integrating data from ERP, CRM, or operational systems.</li><li>
Knowledge of data quality, metadata, and basic governance principles.</li><li>
Strong debugging, problem‑solving, and performance‑optimization skills.</li><li>
Travel may be required up to 5%, depending on business needs.</li></ul><h3 class="jobSectionHeader"><b>
PREFERRED QUALIFICATIONS</b></h3><ul><li>
Experience with Delta Tables, Snowflake, or similar platforms.</li><li>
Exposure to event‑driven or streaming frameworks (Kafka/EventHub).</li><li>
Familiarity with finance, operations, energy, or ERP‑related data domains.</li><li>
Working knowledge of APIs and integration patterns.</li><li>
Azure certifications (Data Engineer Associate or equivalent).</li><li>
Experience supporting analytics teams or ML workflows.</li></ul><br>
Hanwha Q CELLS Technologies, Inc. a subsidiary of Hanwha Q CELLS, one of the world&acute;s largest and most recognized photovoltaic manufacturers for its high-performance, high-quality solar cells and modules. It is headquartered in Seoul, South Korea (Global Executive HQ) Talheim, Germany (Technology &amp; Innovation HQ) and Santa Clara, CA, USA (HW and SW Product Development HQ). Through its growing global business network spanning Europe, North America, Asia, South America, Africa, and the Middle East, the company provides excellent services and long-term partnerships to its customers in the utility, commercial, government, and residential markets. Hanwha Q CELLS is a flagship company of Hanwha Group, a FORTUNE Global 500 firm and a Top 7 business enterprise in South Korea.<br>
<br>
<div><div><div><br>
<b>PHYSICAL, MENTAL &amp; ENVIRONMENTAL DEMANDS:</b><br>
To comply with the Rehabilitation Act of 1973 the essential physical, mental and environmental requirements for this job are listed below. These are requirements <i>normally expected</i> to perform <i>regular</i> job duties. Incumbent must be able to successfully perform all of the functions of the job with or without reasonable accommodation.</div></div><div><div><div><div><b><br>
Mobility</b></div></div><br>
<div><div><br>
Standing</div><div><br>
20% of time</div></div><br>
<div><div><br>
Sitting</div><div><br>
70% of time</div></div><br>
<div><div><br>
Walking</div><div><br>
10% of time</div></div><br>
<div><div><br>
<b>
Strength</b></div></div><br>
<div><div><br>
Pulling</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Pushing</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Carrying</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Lifting</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
<b>
Dexterity</b> <b>(F = Frequently, O = Occasionally, N = Never)</b></div></div><br>
<div><div><br>
Typing</div><div><br>
F</div></div><br>
<div><div><br>
Handling</div><div><br>
F</div></div><br>
<div><div><br>
Reaching</div><div><br>
F</div></div></div><div><div><div><b><br>
Agility</b> <b>(F = Frequently, O = Occasionally, N = Never)</b></div></div><br>
<div><div><br>
Turning</div><div><br>
F</div></div><br>
<div><div><br>
Twisting</div><div><br>
F</div></div><br>
<div><div><br>
Bending</div><div><br>
O</div></div><br>
<div><div><br>
Crouching</div><div><br>
O</div></div><br>
<div><div><br>
Balancing</div><div><br>
N</div></div><br>
<div><div><br>
Climbing</div><div><br>
N</div></div><br>
<div><div><br>
Crawling</div><div><br>
N</div></div><br>
<div><div><br>
Kneeling</div><div><br>
N</div></div></div></div></div><div></div><p><br>
The salary range is required by the California Pay Transparency Act and may differ depending on the location of those candidates hired nationwide. Actual compensation is influenced by a wide array of factors including but not limited to, skill set, education, licenses and certifications, essential job duties and requirements, and the necessary experience relative to the job&rsquo;s minimum qualifications.</p>
<ul><li>This target salary range is for CA positions only and should not be interpreted as an offer of compensation.</li></ul>
You may view your privacy rights by reviewing Qcells' Privacy Policy or by contacting our HR team for a copy.</div>

Senior Data Engineer

ACR Technology Inc

<p><b>We&rsquo;re Hiring: Senior Data Engineer</b><br/>Location: California, USA (Bay Area &ndash; Local Candidates Only)<br/>Employment Type: W2 Only (All Visas Accepted Except H1)<br/>Experience: 6+ Years of Genuine Hands-on Experience Required</p><p>We are seeking an experienced, hands-on Senior Data Engineer to design, build, and scale modern data platforms supporting enterprise analytics, business intelligence, and healthcare data integrations.</p><p>This role involves working with SQL Server, Azure, Databricks, Snowflake, and Python in real-world production environments, with a strong focus on cloud modernization and scalable data architecture.</p><p>Key Responsibilities</p><ul><li>Design and maintain scalable ETL/ELT pipelines across cloud platforms</li><li>Lead migration of on-prem SQL Server workloads to Azure (ADF, Synapse, ADLS, Fabric)</li><li>Architect and optimize data warehouses, data marts, and lakehouse architectures</li><li>Work with healthcare data systems (EHR, HL7, FHIR, HIPAA-compliant environments)</li><li>Develop integrations using REST APIs, CDC, and event-driven architectures</li><li>Implement dimensional modeling and performance tuning strategies</li><li>Build batch and streaming pipelines using Spark and Kafka</li><li>Collaborate with BI, ML, and business stakeholders</li><li>Establish monitoring, data quality checks, and CI/CD processes</li></ul><p>Core Skills</p><ul><li>Advanced SQL and performance tuning</li><li>Azure (ADF, Synapse, Azure SQL, ADLS, Fabric)</li><li>Databricks, Snowflake, BigQuery</li><li>Python (PySpark), Scala</li><li>Spark (batch &amp; streaming), Kafka</li><li>ETL tools (ADF, SSIS, Airflow, dbt)</li><li>BI tools (Power BI preferred)</li><li>DevOps and data governance best practices</li></ul><p>Nice to have: Healthcare domain experience, Databricks administration, real-time architecture experience, ML pipeline exposure.</p><p>Interested candidates (local to Bay Area only, with 6+ years of genuine experience) may share their resume at:<br/><b>devang@acrtechnology.com</b></p><p>Job Types: Full-time, Contract</p><p>Pay: $56.76 - $68.35 per hour</p><p>Work Location: In person</p>

Sr. Data Engineer (Only W2)

Mento

<div><h3 class="jobSectionHeader"><b>About Mento</b></h3>
<p>
Mento is a career technology company that helps people be exceptional and thrive at work through human, AI, and software-based coaching. We're on a mission to provide people access to the best support, advice, and mentorship at work and empower them to take action on it. In a world where jobs and careers are rapidly changing, we believe that transformational growth and continuous improvement is mandatory for people and companies to thrive. We are on a mission to bring our unique model of coaching to every member of the global workforce.</p>
<p>
We strive to create a fun, conscientious, collaborative, and supportive work environment. We are a US-based, remote-first company, backed by leading VCs and angel investors.</p>
<h3 class="jobSectionHeader"><b>
About The Role</b></h3>
<p>
We're looking for our first Data Engineer to build the data infrastructure that powers insights and features across our coaching platform. You'll own data pipelines for coaching sessions, user analytics, and business operations, while establishing the foundation for our data architecture.</p>
<p>
This is not purely about business analytics - In this role, you'll join our engineering team and work closely with product, engineering, coaching, and leadership teams. You'll be embedded in product development&mdash;understanding feature requirements, instrumenting data collection, and building systems that power product capabilities.</p>
<h3 class="jobSectionHeader"><b>
Key Responsibilities:</b></h3>
<p>
Build data pipelines for coaching and user analytics. You'll create pipelines that process coaching session data, user interactions, and AI-generated outputs. These pipelines will power everything from product analytics to coaching effectiveness metrics to business intelligence dashboards.</p>
<p>
Build data systems that power product features. You'll create data pipelines that feed back into the product&mdash;user progress tracking, coaching insights, customer dashboards, and more. You'll work with product and engineering to understand what data products need and build reliable systems to deliver it.</p>
<p>
Establish our data infrastructure and architecture. As our first data engineer, you'll make key decisions about our data stack&mdash;choosing and implementing tools for orchestration, transformation, warehousing, and analytics. You'll build foundations that can scale with the company.</p>
<p>
Process and analyze AI/LLM outputs. You'll work with data from our AI coaching systems, building pipelines to analyze LLM responses, track coaching quality, and generate insights about how users interact with AI coaches.</p>
<p>
Support business operations and analytics. You'll build data systems that track customer success metrics, billing data, user engagement, and operational KPIs. Your work will directly inform business decisions and product strategy.</p>
<p>
Create accessible analytics infrastructure. You'll build systems that make data available to non-technical stakeholders through dashboards, reports, and self-service analytics tools. You'll think about data quality, documentation, and usability.</p>
<p>
Work closely with product on instrumentation and data collection. You'll collaborate with product and engineering teams to instrument new features, define events and metrics, and ensure we're collecting the right data. You'll be involved in product discussions and understand feature requirements from a data perspective.</p>
<h3 class="jobSectionHeader"><b>
Who We're Looking For</b></h3>
<p>
We're looking for a data engineer with mid to senior-level experience who can work independently, make architectural decisions, and build data systems from the ground up.</p><br>
<p>
You have strong data engineering fundamentals. You're experienced with SQL, Python, and building data pipelines. You understand data modeling, ETL/ELT patterns, and how to design scalable data architectures. You've worked with databases like PostgreSQL and have opinions on data infrastructure tools.</p>
<p>
Bonus: You're comfortable with Go. Our backend stack is Ruby and Go, with new development preferentially in Go. While we are happy to use Python as the primary language for data work, comfort with Go is a plus for building production data services and working closely with the backend team.</p>
<p>
You can drive technical decisions about data infrastructure. You've evaluated and implemented data tools before&mdash;whether orchestration frameworks, warehouses, transformation tools, or BI platforms. You can assess our needs and recommend the right stack for an early-stage company.</p>
<p>
You're comfortable working with diverse data sources. You'll work with operational databases, event streams (Redis), document stores (Elasticsearch), API data, and LLM outputs. You can navigate different data formats and build reliable integrations.</p>
<p>
You're comfortable working closely with product teams. You've worked embedded with product and engineering, participated in product discussions, and built data systems that directly power product features. You understand the difference between building for analysis versus building for production product use.</p>
<p>
You can build both analytical and operational data pipelines. You've built pipelines for analytics and business intelligence, but you've also built systems that feed data back into products in real-time or near-real-time. You understand the different requirements and tradeoffs.</p>
<p>
You have some experience with AI/ML data. You've worked with LLM outputs, unstructured data, or analytics for AI-powered products. You understand the unique challenges of working with AI-generated content and can design appropriate data models.</p>
<p>
You work well independently in an early-stage environment. You're comfortable with ambiguity and can prioritize work without extensive direction. You can balance building for immediate needs while creating foundations for future scale.</p>
<h3 class="jobSectionHeader"><b>
Why Work with Us?</b></h3>
<p>
We are a company dedicated to empowering professionals to live meaningful careers. That starts with our culture at Mento.</p>
<p>
You're excited about building data infrastructure that serves multiple purposes&mdash;analytics, business intelligence, and powering product features. You want to work closely with product teams and see your data systems directly impact user experience.</p>
<p>
We work hard to foster a workplace built around trust, respect, and collaboration. As a remote-first company, we believe in flexibility and autonomy&mdash;as long as you're delivering great work and staying connected with your teammates, you can work from anywhere.</p>
<p>
This is an opportunity to join an early-stage, mission-driven team as the founding data engineer. You'll have significant ownership over our data architecture and direct impact on both product and business strategy.</p>
<p>
We strongly believe that diversity of experience, perspectives, and background will lead to a better environment for our employees and a better product for our users. If you're passionate about building data systems that help people thrive at work, we want to hear from you.</p><br>
<p></p>
<p><b>
Other benefits and perks include:</b></p>
<p><i>
✈️ Fully Remote - ability to work from anywhere with bi-annual team offsites</i></p>
<p><i>
 Competitive salary and equity</i></p>
<p><i>
 Medical, dental, vision, and a 401k plan</i></p>
<p><i>
 Unlimited vacation (We actually mean this! it's important to keep yourself fresh)</i></p>
<p><i>
 $500 home office stipend</i></p>
<p><i>
 Access to your own Mento Coach</i></p></div>

Data Engineer

Middesk

<div><p><b>About Middesk</b></p><p>
Middesk makes it easier for businesses to work together. Since 2018, we&rsquo;ve been transforming business identity verification, replacing slow, manual processes with seamless access to complete, up-to-date data. Our platform helps companies across industries confidently verify business identities, onboard customers faster, and reduce risk at every stage of the customer lifecycle.</p><p>
Middesk came out of Y Combinator, is backed by Sequoia Capital and Accel Partners, and was recently named to Forbes Fintech 50 List and cited as an industry leader in business verification by digital identity strategy firm, Liminal.</p><p></p><p><b>
About Middesk Engineering:
</b></p><p>Middesk is, at its core, a data company. We live by the quality of our data assets and the engine that powers them. We&rsquo;re on a mission to build a comprehensive and complete business dataset for every business in the world. As part of the Data Platform team at Middesk, you&rsquo;ll collaborate with Data Science, Infrastructure and Product Engineering teams to build and maintain our own proprietary Entity Resolution system used to power the Middesk business identity platform, scaling our system to resolve millions of business identities across hundreds of data sources and thousands of distinct data sets. You&rsquo;ll often work with and support product engineers looking to launch new products and features.</p><p></p><p><b>
The Role:
</b></p><p>We're looking for a senior engineer to own and drive the technical direction of our data platform. You'll design data infrastructure systems that operate reliably at scale, define the architecture for how we acquire, transform, and serve data to product teams, and partner closely with engineering leadership to align platform strategy with company priorities.</p><p>
You'll be expected to independently scope complex projects from ambiguous problem statements, break them into incremental deliverables, and drive them to completion while keeping stakeholders informed and adapting when priorities shift. You'll also play a key role in elevating the engineering practices of the team through mentorship, code review, and setting technical standards.</p><p></p><p><b>
What You'll Do:</b></p><ul><li><p><b>
Own platform architecture and technical direction</b> for how we ingest, transform, and serve data across highly variable input formats - business entity data sourced from thousands of government agencies, registries, and third-party providers, each with its own schema, cadence, and reliability profile</p></li><li><p><b>
Design and build systems for scale</b> - both the infrastructure we need today and the infrastructure we'll need at 2&ndash;5x our current volume</p></li><li><p><b>
Scope and drive complex projects end-to-end</b>, breaking ambiguous problems into well-defined milestones with clear deliverables and timelines</p></li><li><p><b>
Design AI-powered tooling</b> to improve how we acquire and maintain data using LLMs, AI agents, and agent orchestration</p></li><li><p><b>
Partner with product engineering, data science, and business teams</b> to understand data needs and translate them into platform capabilities</p></li><li><p><b>
Establish and maintain data governance and quality standards</b> across the platform, ensuring the integrity and reliability of the data our customers depend on for compliance and risk decisions</p></li></ul><p></p><p><b>
What We&rsquo;re Looking For:</b></p><ul><li><p><b>
7+ years of professional software engineering experience</b>, with meaningful time spent on data infrastructure, data engineering, or backend platform work (targeting Senior to Staff Level Engineers)</p></li><li><p><b>
Experience designing and operating systems at meaningful scale</b>, ideally within a larger or rapidly scaling engineering organization</p></li><li><p><b>
Track record of independently owning and delivering complex, multi-milestone projects</b> - from scoping through launch</p></li><li><p><b>
Strong data modeling instincts</b> and deep familiarity with SQL, pipeline orchestration (Airflow, Dagster, etc.), and data transformation patterns</p></li><li><p><b>
Experience with distributed data processing frameworks</b> (Spark, Flink, Beam, or similar) and an understanding of when and how to apply parallelization to scale pipelines beyond single-node limits</p></li><li><p><b>
Proficiency in one or more of</b>: Python, Ruby, JavaScript/TypeScript, Java</p></li></ul><p></p><p><b>
Nice to Haves:</b></p><ul><li><p>
Experience working with or building AI/LLM-powered tooling or data products (strongly preferred)</p></li><li><p>
Experience with scraper technologies, including agentic AI</p></li><li><p>
Experience building and designing collections stored on Elasticsearch</p></li><li><p>
Experience operating event-driven data pipelines using serverless compute (e.g., AWS Lambda, Google Cloud Functions, Azure Functions) and managed cloud services</p></li><li><p>
Experience with Terraform, Datadog, or Kubernetes</p></li></ul><p>
Compensation Range: $205K - $275K</p></div>

Software Engineer, Data Platform

ROLLER

<div><h2 class="jobSectionHeader"><b>About ROLLER</b></h2>
<p>
ROLLER is not your average software-as-a-service company. With a global presence in over 30 countries, we're here to bring some excitement to the leisure and attractions industry and make a difference! Our mission is to help businesses operate smoothly and create fun and memorable guest experiences by providing seamless ticketing, point-of-sale, self-serve kiosks, memberships and digital waiver processes.</p>
<p>
But here's the best part: our team. We're a group of 300+ highly passionate, enthusiastic, and down-to-earth professionals located all around the world who are all working together to build something truly remarkable. We're aiming high and believe that the possibilities are endless. As we continue to grow globally, we're excited to write our success story and have fun along the way.</p>
<p>
We genuinely love what we do, and we're looking for like-minded people to join us on this amazing journey. If you're ready to be part of a dynamic team and make a real impact, come aboard, and let's create some unforgettable experiences together at ROLLER!</p><br>
<p></p>
<h2 class="jobSectionHeader"><b>
About the Role</b></h2>
<p>
We are seeking a highly technical, hands-on <b>Senior</b> <b>Data Engineer</b> to architect and scale our data infrastructure from the ground up. As a core member of the data function within our Business Technology team, you will be responsible for building the pipelines and models that power smarter decision-making and operational efficiency across the entire organization.</p>
<p>
In this foundational role, you will build &amp; architect the <b>modern data stack</b>, ensuring our infrastructure is robust, automated, and governed. You collaborate as a technical partner with <b>GTM</b> <b>,Product, Finance, P&amp;C </b>to build high-performance data models and pipelines that transform raw data into actionable cross-functional insights.</p>
<p>
Joining ROLLER at this pivotal growth stage, you will have the opportunity to make an outsized impact on our technical landscape, directly influencing how we process data to deliver world-class experiences for our customers globally.</p><br>
<p></p>
<p><b>
What You'll Do</b></p>
<ul>
<li><b>Scalable Architecture:</b> Design and implement robust <b>Data Modeling and Architecture</b> strategies that support high-volume data processing and maintain long-term scalability.</li>
<li><b>Cloud Ecosystem:</b> Develop and manage end-to-end data pipelines using <b>Google Cloud Platform</b> services, specifically leveraging <b>Cloud Run, Cloud Function</b> for compute, <b>BigQuery</b> for storage, and <b>Cloud Composer (Airflow)</b> for orchestration.</li>
<li><b>Transformation Excellence:</b> Build, maintain, and document complex data transformation layers using <b>DBT (Data Build Tool)</b> to ensure high data quality and reliability.</li>
<li><b>Infrastructure as Code:</b> Automate the provisioning of cloud resources using <b>Terraform</b> and streamline deployment workflows via <b>GitHub Actions</b> CI/CD pipelines.</li>
<li><b>Cloud Data Warehousing:</b> Demonstrate expert-level proficiency in managing and optimizing <b>Cloud Data Warehouses</b>, such as <b>Snowflake</b> &amp; <b>BigQuery</b>.</li>
<li><b>Team Collaboration:</b> Partner with cross-functional stakeholders to build and scale high-performing data infrastructure that supports engineering, analytics, and Data Program needs.</li>
<li><b>Stack Management:</b> Architect and maintain a modern data stack by implementing best-in-class tools including <b>Snowflake</b>, <b>Bigquery</b>, <b>dbt</b>, <b>Fivetran</b>, <b>Looker</b>, <b>Tableau</b> and <b>Airflow</b>.</li>
<li><b>Pipeline Engineering:</b> Develop scalable ETL/ELT workflows and robust data models to deliver real-time analytics and unified business reporting.</li>
<li><b>Data Visualization: Create and maintain intuitive, high-performance Looker dashboards will be an added advantage.</b></li></ul><br>
<p></p>
<h2 class="jobSectionHeader"><b>
About You</b></h2>
<p>
You are a technical builder who views data as a competitive advantage. You thrive in fast-paced environments and have a proven track record of engineering scalable data foundations from the ground up. Equal parts <b>architect and analytical problem-solver</b>, you excel at balancing long-term technical vision with the daily hands-on execution of complex pipelines.</p>
<p>
You are energized by the full lifecycle of data&mdash;moving beyond just writing code to actively leading <b>project discovery and analysis</b> alongside cross-functional partners. You take pride in enabling GTM, Product, Finance &amp; P&amp;C teams through clear insights and high-performance systems. Most importantly, you are excited to act as a founding technical force for a high-growth SaaS company that is transforming the guest experience for attractions businesses globally.</p><br>
<p></p>
<ul>
<li><b>5+ years of experience</b> in Data &amp; Analytics or Data Engineering with a focus on Scalable cloud driven data pipeline build</li>
</ul><ul><li>Proven experience in <b>dimensional modeling </b>(Star/Snowflake schema) and designing architectures that support both historical reporting and real-time needs.</li>
<li>Expert-level proficiency in <b>Snowflake</b> or <b>BigQuery</b>, including performance tuning, cost optimization, and access control (RBAC).</li>
<li>Hands-on experience with Google Cloud Platform services, specifically <b>Cloud Function</b>, <b>Cloud Run</b> for containerized workloads and <b>Cloud Composer</b> for orchestration.</li>
</ul><ul><li>Through hands-on experience of <b>dbt (Data Build Tool)</b> to manage transformations, including writing custom macros, implementing tests, and generating documentation.</li>
<li>Solid experience using <b>Terraform</b> to provision cloud resources, ensuring that infrastructure is version-controlled and reproducible.</li>
<li>Proficiency in <b>GitHub Actions</b> to automate testing and deployment pipelines for data models and infrastructure.</li>
<li>Ability to design high-performance dashboards that prioritize user experience and fast load times.</li>
</ul><ul><li>Experience collaborating with <b>Finance, GTM, and Product</b> to define key metrics (like CAC, LTV, or Churn) and codifying them into the data layer.</li>
<li>Familiarity with data ingestion tools like <b>Fivetran</b> , <b>Airbyte, Workato, Mulesoft</b> to sync data from various SaaS platforms into the warehouse.</li>
</ul><ul><li>Operates as a <b>full-stack Data Engineer</b> with the technical authority to architect and build entire data lifecycles, from raw source ingestion to high-impact data visualization.</li>
<li><b>Familiarity with business-critical systems</b> like Salesforce, Chargbee, Gainsight, and product analytics tools.</li>
<li><b>Strong communicator</b> with a track record of working across technical and non-technical teams to drive alignment.</li></ul><br>
<p></p>
<p><b>
Preferred Qualifications</b></p>
<ul>
<li>Experience partnering with <b>IT or Business Technology teams</b> to drive cross-functional outcomes.</li>
<li>Exposure to <b>customer success and revenue workflows</b>, such as onboarding journeys, renewal metrics, or support analytics.</li>
<li>Familiarity with <b>AI/ML pipelines</b> and experimentation frameworks that support data-driven innovation.</li></ul><br>
<p></p>
<h2 class="jobSectionHeader"><b>
Perks!</b></h2>
<ul><li>You'll get to work on a category-leading product that customers love in a fun, high-growth industry! Check our Capterra and G2 reviews.</li>
<li>4 ROLLER Recharge days per year (When we hit our goals each quarter, we take a well-earned day off together to relax, recharge, and celebrate our wins).</li>
<li>Engage in our 'Vibe Tribe' - led by our team members; you can contribute to company-wide initiatives directly. Regular events and social activities, fundraising &amp; cause-related campaigns...you name it. We're willing to make it happen!</li>
<li>Team Member Assistance Program to proactively support our team's health and wellbeing - access to coaching, education modules, weekly webinars, and more.</li>
<li>16 weeks paid Parental Leave for primary carers and 4 weeks paid Parental Leave for secondary carers.</li>
<li>Work with a driven, fun, and switched-on team that likes to raise the bar in all we do!</li>
<li>Individual learning &amp; development budget plus genuine career growth opportunities as we continue to expand!</li></ul><br>
<p></p>
<h2 class="jobSectionHeader"><b>
What You Can Expect</b></h2>
<div><ul><li><b>Initial call with our Talent Acquisition Manager</b><br>
You'll have an initial call with our Talent Acquisition Manager to chat through some of your experience to date, salary expectations and you can check off any initial questions you might have.</li></ul>
<ul><li><b>Interview with the Hiring Manager</b><br>
You'll get to meet with the hiring manager to learn more about the role &amp; ROLLER whilst also talking through your experience in more detail.</li></ul>
<ul><li><b>Loop Interviews</b><br>
This is where you will get to meet our wider ROLLER team to do a 'vibe check' on us to make sure our culture &amp; vibe meet what you are looking for!</li></ul>
<ul><li><b>Offer</b><br>
If all lights are green and the fit feel right, we'll conduct reference checks and you'll receive an offer to join!</li></ul></div></div>

DoorDash

<p></p><div><h1 class="jobSectionHeader"><b>About the Team</b></h1>
<p>
Data is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization and financial reporting. By implementing pipelines, data structures, and data warehouse architectures; this team serves as the foundation for decision-making at DoorDash.</p>
<h1 class="jobSectionHeader"><b>
About the Role</b></h1>
<p>
DoorDash is looking for a Senior Data Engineer to be a technical powerhouse to help us scale our data infrastructure, automation and tools to meet growing business needs. This is a hybrid position in San Francisco, CA; Sunnyvale, CA; or Seattle, WA.</p><br>
<p></p>
<h1 class="jobSectionHeader"><b>
You're excited about this opportunity because you will&hellip;</b></h1>
<ul><li>Work with business partners and stakeholders to understand data requirements</li>
<li>Work with engineering, product teams and 3rd parties to collect required data</li>
<li>Design, develop and implement large scale, high volume, high performance data models and pipelines for Data Lake and Data Warehouse</li>
<li>Develop and implement data quality checks, conduct QA and implement monitoring routines</li>
<li>Improve the reliability and scalability of our ETL processes</li>
<li>Manage a portfolio of data products that deliver high-quality, trustworthy data</li>
<li>Help onboard and support other engineers as they join the team</li>
</ul><h1 class="jobSectionHeader"><b>We're excited about you because&hellip;</b></h1>
<ul><li>5+ years of professional experience</li>
<li>3+ years experience working in data engineering, business intelligence, or a similar role</li>
<li>Proficiency in programming languages such as Python/Java</li>
<li>3+ years of experience in ETL orchestration and workflow management tools like Airflow, Flink, Oozie and Azkaban using AWS/GCP</li>
<li>Expert in Database fundamentals, SQL and distributed computing</li>
<li>3+ years of experience with the Distributed data/similar ecosystem (Spark, Hive, Druid, Presto) and streaming technologies such as Kafka/Flink.</li>
<li>Experience working with Snowflake, Redshift, PostgreSQL and/or other DBMS platforms</li>
<li>Excellent communication skills and experience working with technical and non-technical teams</li>
<li>Knowledge of reporting tools such as Tableau, Superset and Looker</li>
<li>Comfortable working in fast paced environment, self starter and self organizing</li>
<li>Ability to think strategically, analyze and interpret market and consumer information</li>
<li>You must be located near one of our engineering hubs indicated above<b>
</b></li></ul><p>We use Covey as part of our hiring and / or promotional process for jobs in NYC and certain features may qualify it as an AEDT. As part of the evaluation process we provide Covey with job requirements and candidate submitted applications. We began using Covey Scout for Inbound on August 21, 2023.</p>
<p>
Please see the independent bias audit report covering our use of Covey here.</p><div><h2 class="jobSectionHeader"><b>
About DoorDash</b></h2>
<p>
At DoorDash, our mission to empower local economies shapes how our team members move quickly, learn, and reiterate in order to make impactful decisions that display empathy for our range of users&mdash;from Dashers to merchant partners to consumers. We are a technology and logistics company that started by enabling door-to-door delivery, and we are looking for team members who can help us go from a company that is known as the place you order food to a company that people turn to for any and all goods.<br>
<br>
DoorDash is growing rapidly and changing constantly, which gives our team members the opportunity to share their unique perspectives, solve new challenges, and own their careers. We're committed to supporting employees' happiness, healthiness, and overall well-being by providing comprehensive benefits and perks including premium healthcare, wellness expense reimbursement, paid parental leave and more.</p>
<h2 class="jobSectionHeader"><b>
Our Commitment to Diversity and Inclusion</b></h2>
<p>
We're committed to growing and empowering a more inclusive community within our company, industry, and cities. That's why we hire and cultivate diverse teams of people from all backgrounds, experiences, and perspectives. We believe that true innovation happens when everyone has room at the table and the tools, resources, and opportunity to excel.</p>
<p>
Statement of Non-Discrimination: In keeping with our beliefs and goals, no employee or applicant will face discrimination or harassment based on: race, color, ancestry, national origin, religion, age, gender, marital/domestic partner status, sexual orientation, gender identity or expression, disability status, or veteran status. Above and beyond discrimination and harassment based on &quot;protected categories,&quot; we also strive to prevent other subtler forms of inappropriate behavior (i.e., stereotyping) from ever gaining a foothold in our office. Whether blatant or hidden, barriers to success have no place at DoorDash. We value a diverse workforce &ndash; people who identify as women, non-binary or gender non-conforming, LGBTQIA+, American Indian or Native Alaskan, Black or African American, Hispanic or Latinx, Native Hawaiian or Other Pacific Islander, differently-abled, caretakers and parents, and veterans are strongly encouraged to apply. Thank you to the Level Playing Field Institute for this statement of non-discrimination.</p>
<p>
Pursuant to the San Francisco Fair Chance Ordinance, Los Angeles Fair Chance Initiative for Hiring Ordinance, and any other state or local hiring regulations, we will consider for employment any qualified applicant, including those with arrest and conviction records, in a manner consistent with the applicable regulation.</p>
<p><b>
If you need any accommodations, please inform your recruiting contact upon initial connection.</b></p></div></div>

Senior Software Engineer, Data Engineering

Aarki

<div>
 <strong>
  Who are we?
  <br/>
  <br/>
 </strong>
 Aarki is an AI-driven company specializing in mobile advertising solutions designed to fuel revenue growth. We leverage AI to discover audiences in a privacy-first environment through trillions of contextual bidding signals and proprietary behavioral models. Our audience engagement platform includes creative strategy and execution. We handle 5 million mobile ad requests per second from over 10 billion devices, driving performance for both publishers and brands. We are headquartered in San Francisco, CA, with a global presence across the United States, EMEA, and APAC.
 <br/>
 <br/>
 <strong>
  The role?
  <br/>
  <br/>
 </strong>
 We are seeking a motivated and detail-oriented Machine Learning Engineer to join our team. As an ML Engineer, you will be involved in designing and implementing machine learning models and data pipelines to enhance our programmatic demand-side platform (DSP). You will work closely with Senior MLE and other team members to drive impactful machine learning projects and contribute to innovative solutions.
 <br/>
 <br/>
 <strong>
  What will you do?
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Support the development of machine learning models to address challenges in programmatic advertising, such as predicting user responses, forecasting bid landscapes, and detecting fraud.
  </li>
  <li>
   Collaborate with senior data scientists and cross-functional teams (product, engineering, and analytics) to integrate models into production workflows.
  </li>
  <li>
   Analyze the impact of integrating new data sources and features into our models.
  </li>
  <li>
   Build and maintain data pipelines to process and prepare large datasets for model training and evaluation.
  </li>
  <li>
   Contribute ideas and assist in testing new tools, methodologies, and technologies to improve our machine learning capabilities.
  </li>
  <li>
   Document experiments, assumptions, and outcomes; maintain reproducibility
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  What are we looking for?
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Bachelor&rsquo;s degree in Mathematics, Physics, Computer Science, or a related technical field.
  </li>
  <li>
   At least 2 years of professional experience in machine learning, statistical analysis, and data analysis.
  </li>
  <li>
   Experience with machine learning techniques such as regression, classification, and clustering.
  </li>
  <li>
   Proficiency in Python and SQL and familiarity with big data tools (e.g., Spark) and ML libraries (e.g., TensorFlow, PyTorch, Scikit-Learn).
  </li>
  <li>
   Strong grasp of probability, statistics, and data analysis principles.
  </li>
  <li>
   Ability to work effectively in a team environment, with good communication skills to explain complex concepts to diverse stakeholders.
   <br/>
   <br/>
  </li>
 </ul>
 Nice-to-Have
 <br/>
 <br/>
 <ul>
  <li>
   Familiarity with system programming languages including C++ and Rust is a plus.
  </li>
  <li>
   Exposure to online inference systems, gRPC/REST model endpoints, or streaming features (Kafka/Flink)
  </li>
  <li>
   Ad-tech familiarity: auction dynamics, pacing, fraud signals, creative personalization.
  </li>
 </ul>
</div>


Machine Learning Engineer

Explore 353+ Senior data engineer in San Francisco this March. Find roles across top companies and apply now to boost your career.

353 senior data engineer jobs In San Francisco

Senior Data Engineer

Sr. Data Engineer (Only W2)

Data Engineer

Software Engineer, Data Platform

Data Engineer

Senior Software Engineer, Data Engineering

Machine Learning Engineer