data engineer

software engineer

data scientist

advisor - scientific data engineer Jobs in San Francisco

advisor - scientific data engineer

ai data engineer (agent platform) Jobs in San Francisco

ai data engineer (agent platform)

data developer

Twitch

<div>
 
 About Us
 
 
 
 Twitch is the world&rsquo;s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day.
 
 
 We&rsquo;re about community, inside and out. You&rsquo;ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We&rsquo;re on a quest to empower live communities, so if this sounds good to you, see what we&rsquo;re up to on LinkedIn and X, and discover the projects we&rsquo;re solving on our Blog. Be sure to explore our Interviewing Guide to learn how to ace our interview process.
 
 
 
 About The Role
 
 
 
 As a data engineer in the Data Platform organization, you will be transforming Twitch&rsquo;s largest data sets into offerings that are usable by the entire company. You&rsquo;ll be working with other senior team members, as well as other data engineers, scientists, and stakeholders from all across the business. You will help define how our core business metrics are managed, as well as how other parts of the company define their individual metrics.
 
 
 
 You Will:
 
 
 
 
 <ul>
 <li>
 Work closely with data scientists and engineers from across the company to define and create robust data architectures and pipelines
 </li>
 <li>
 Develop and manage scalable data pipelines to extract, transform, and load data from various sources
 </li>
 <li>
 Partner with a range of stakeholders to translate the company&rsquo;s needs into data offerings
 </li>
 <li>
 Automate data processing and reporting workflows to improve efficiency and data integrity
 </li>
 <li>
 Implement data quality checks and monitor processes to maintain high data accuracy
 </li>
 <li>
 Simplify and enhance the accessibility, clarity, and usability of large and complex datasets through the development of data cubes and data sharing solutions
 
 
 
 </li>
 </ul>
 
 You Have:
 
 
 
 
 <ul>
 <li>
 3+ year of experience working in a data engineering, data science, or software engineering capacity
 </li>
 <li>
 Expertise in writing and maintaining robust data pipelines in SQL and Python
 </li>
 <li>
 A track record of turning data requirements from stakeholders into actionable plans
 </li>
 <li>
 Experience with cloud-native solutions
 </li>
 <li>
 A history of implementing and upholding best practices in data pipelines, ensuring accuracy, consistency, and reliability
 
 
 
 </li>
 </ul>
 
 Bonus Points
 
 
 
 
 <ul>
 <li>
 Bachelor's degree, or Master's degree in computer science, statistics, information systems, or a related, technical field
 </li>
 <li>
 Experience with a scripting language (e.g., Python, Java, or R)
 </li>
 <li>
 Familiarity and interest in Twitch!
 
 
 
 </li>
 </ul>
 
 Perks
 
 
 
 
 <ul>
 <li>
 Medical, Dental, Vision &amp; Disability Insurance
 </li>
 <li>
 401(k)
 </li>
 <li>
 Maternity &amp; Parental Leave
 </li>
 <li>
 Flexible PTO
 </li>
 <li>
 Amazon Employee Discount
 
 
 
 </li>
 </ul>
 
 Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
 
 
 
 Job ID: TW9042
 
 
 The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
 
 
 US, CA, San Francisco
 
 
 $152,000&mdash;$205,600 USD
 
 
 
 Twitch is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
 
 
 
 
 Twitch values your privacy. Please consult our Candidate Privacy Notice, for information about how we collect, use, and disclose personal information of our candidates.
 
</div>

Data Engineer

You.com

<div><div>About Us

At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge layer that agents, applications, and enterprises rely on to retrieve real-time, accurate, and citation-backed information.

Our platform combines proprietary vertical indexes with LLM-optimized retrieval systems to power AI agents, applications, and enterprise workflows. We are solving hard problems across search, large language models, and large-scale infrastructure to make AI systems more reliable, transparent, and useful.

Our team includes engineers, researchers, product builders, and operators who care about solving meaningful problems and delivering real-world impact. Whether you are improving core infrastructure, shaping product experiences, or helping bring new AI capabilities to market, your work will help define how modern AI finds and uses knowledge.</div><div><h4 class="jobSectionHeader">
About the Role</h4>

We are looking for a hands-on Data Engineer to help build and scale our modern data platform. In this role, you will work closely with engineering, product, and analytics teams to develop reliable, high-performance data pipelines and systems.

You&rsquo;ll contribute to both batch and real-time data processing using technologies like Databricks, AWS, and Kafka, while helping ensure data quality, accessibility, and usability across the organization. You&rsquo;ll play a key role in enabling data activation, ensuring that high-quality data flows not only into the warehouse but also outward to business tools like Salesforce, HubSpot, and Braze. Additionally, you will help power next-generation AI-driven applications, including agent-based systems and retrieval-augmented generation (RAG), by building robust data foundations and pipelines. This is a great opportunity for someone who enjoys solving data challenges end-to-end from ingestion to insights.

Responsibilities
<ul>
<li>Build and maintain scalable data pipelines (batch and streaming) using tools like Databricks, Spark, Kafka, and AWS services</li>
<li>Design, develop, and optimize ETL/ELT workflows using DBT, PySpark, SQL, and tools like Fivetran</li>
<li>Partner closely with marketing and growth teams to enable data use cases such as segmentation, campaign targeting, and lifecycle analytics</li>
<li>Develop and maintain reverse ETL pipelines to sync data from the warehouse to tools like Salesforce, HubSpot, Braze, and other downstream systems</li>
<li>Create and manage curated datasets to support analytics, reporting, and go-to-market initiatives</li>
<li>Build and maintain dashboards and reporting layers to support marketing and business performance tracking</li>
<li>Support AI/ML and agent-based applications by preparing and serving high-quality datasets for RAG pipelines and MCP (Model Context Protocol) integrations</li>
<li>Monitor pipeline performance, troubleshoot issues, and ensure high data reliability and quality</li>
<li>Implement data quality checks, validations, and alerting mechanisms across both ingestion and activation layers</li>
<li>Collaborate with cross-functional teams to define data contracts and ensure consistency across systems</li>
</ul><h4 class="jobSectionHeader">Qualifications</h4>
<ul><li>6+ years of experience in data engineering or a related field</li>
<li>Strong hands-on experience with Databricks, AWS (S3, Glue, Athena, EMR, etc.), and Kafka</li>
<li>Proficiency in Python (PySpark) and SQL for large-scale data processing</li>
<li>Experience building and maintaining ETL/ELT pipelines (DBT/Airflow or similar experience preferred)</li>
<li>Experience with data ingestion tools such as Fivetran (or similar)</li>
<li>Familiarity with reverse ETL / data activation workflows and syncing data to tools like Salesforce, HubSpot, Braze</li>
<li>Exposure to or experience with AI/ML data pipelines, including RAG architectures, vector databases, or embeddings workflows</li>
<li>Familiarity with agent-based systems, MCP integrations, or LLM-powered applications is a strong plus</li>
<li>Experience working with marketing, Product or growth teams on data use cases (segmentation, attribution, campaign analytics, etc.)</li>
<li>Understanding of data modeling and working with large-scale datasets (batch and streaming)</li>
<li>Experience creating dashboards and supporting reporting workflows (BI tools) for both internal and external audiences</li>
<li>Strong problem-solving skills and ability to debug production data issues</li>
<li>Strong communication skills and ability to work collaboratively across teams</li> 
</ul></div><div><div><div><div>
Our salary bands are structured based on a combination of geographic tiers and internal leveling. Compensation is determined by multiple factors assessed during the interview process, with the final offer reflecting these considerations.</div></div>
Salary Band
$185,000 - $225,000 USD</div></div><div><h4 class="jobSectionHeader">
Company Perks:</h4>
<ul>
<li>Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions
</li>
<li>Flexible PTO with U.S. holidays observed and a week shutdown in December to rest and recharge*
</li>
<li>A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*
</li>
<li>12 weeks of paid parental leave in the US*
</li>
<li>401k program, 3% match - vested immediately!*
</li>
<li>$500 work-from-home stipend to be used up to a year of your start date*
</li>
<li>$600 technology stipend to support a portion of our hybrid/remote team's cell phone and internet expenses*</li>
<li>
$1,200 per year Health &amp; Wellness Allowance to support your personal goals*
</li>
<li>The chance to collaborate with a team at the forefront of AI research
</li>
</ul><ul><li>Certain perks and benefits are limited to full-time employees only</li></ul>

You.com participates in E-Verify. We will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee&rsquo;s Form I-9 to confirm work authorization. (English/Spanish: E-Verify Participation/Right to Work) We are also an inclusive, equitable, and accessible workplace. Please let us know if you require accommodation for any portion of the recruitment and hiring process.

Beware of recruiting scams: You.com will only contact you through official @You.com email addresses and will never ask for payment or sensitive personal information during the hiring process.</div></div>

<div>
 
 About Us
 
 
 
 At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge layer that agents, applications, and enterprises rely on to retrieve real-time, accurate, and citation-backed information.
 
 
 Our platform combines proprietary vertical indexes with LLM-optimized retrieval systems to power AI agents, applications, and enterprise workflows. We are solving hard problems across search, large language models, and large-scale infrastructure to make AI systems more reliable, transparent, and useful.
 
 
 Our team includes engineers, researchers, product builders, and operators who care about solving meaningful problems and delivering real-world impact. Whether you are improving core infrastructure, shaping product experiences, or helping bring new AI capabilities to market, your work will help define how modern AI finds and uses knowledge.
 
 
 
 About The Role
 
 
 
 We are looking for a hands-on Data Engineer to help build and scale our modern data platform. In this role, you will work closely with engineering, product, and analytics teams to develop reliable, high-performance data pipelines and systems.
 
 
 You'll contribute to both batch and real-time data processing using technologies like Databricks, AWS, and Kafka, while helping ensure data quality, accessibility, and usability across the organization. You'll play a key role in enabling data activation, ensuring that high-quality data flows not only into the warehouse but also outward to business tools like Salesforce, HubSpot, and Braze. Additionally, you will help power next-generation
 
 AI-driven applications
 
 , including agent-based systems and retrieval-augmented generation (RAG), by building robust data foundations and pipelines. This is a great opportunity for someone who enjoys solving data challenges end-to-end from ingestion to insights.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Build and maintain scalable data pipelines (batch and streaming) using tools like Databricks, Spark, Kafka, and AWS services
 </li>
 <li>
 Design, develop, and optimize ETL/ELT workflows using DBT, PySpark, SQL, and tools like Fivetran
 </li>
 <li>
 Partner closely with marketing and growth teams to enable data use cases such as segmentation, campaign targeting, and lifecycle analytics
 </li>
 <li>
 Develop and maintain reverse ETL pipelines to sync data from the warehouse to tools like Salesforce, HubSpot, Braze, and other downstream systems
 </li>
 <li>
 Create and manage curated datasets to support analytics, reporting, and go-to-market initiatives
 </li>
 <li>
 Build and maintain dashboards and reporting layers to support marketing and business performance tracking
 </li>
 <li>
 Support AI/ML and agent-based applications by preparing and serving high-quality datasets for RAG pipelines and MCP (Model Context Protocol) integrations
 </li>
 <li>
 Monitor pipeline performance, troubleshoot issues, and ensure high data reliability and quality
 </li>
 <li>
 Implement data quality checks, validations, and alerting mechanisms across both ingestion and activation layers
 </li>
 <li>
 Collaborate with cross-functional teams to define data contracts and ensure consistency across systems
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 
 6+ years
 
 of experience in data engineering or a related field
 </li>
 <li>
 Strong hands-on experience with Databricks, AWS (S3, Glue, Athena, EMR, etc.), and Kafka
 </li>
 <li>
 Proficiency in Python (PySpark) and SQL for large-scale data processing
 </li>
 <li>
 Experience building and maintaining ETL/ELT pipelines (DBT/Airflow or similar experience preferred)
 </li>
 <li>
 Experience with data ingestion tools such as Fivetran (or similar)
 </li>
 <li>
 Familiarity with reverse ETL / data activation workflows and syncing data to tools like Salesforce, HubSpot, Braze
 </li>
 <li>
 Exposure to or experience with AI/ML data pipelines, including RAG architectures, vector databases, or embeddings workflows
 </li>
 <li>
 Familiarity with agent-based systems, MCP integrations, or LLM-powered applications is a strong plus
 </li>
 <li>
 Experience working with marketing, Product or growth teams on data use cases (segmentation, attribution, campaign analytics, etc.)
 </li>
 <li>
 Understanding of data modeling and working with large-scale datasets (batch and streaming)
 </li>
 <li>
 Experience creating dashboards and supporting reporting workflows (BI tools) for both internal and external audiences
 </li>
 <li>
 Strong problem-solving skills and ability to debug production data issues
 </li>
 <li>
 Strong communication skills and ability to work collaboratively across teams
 
 
 </li>
 </ul>
 Our salary bands are structured based on a combination of geographic tiers and internal leveling. Compensation is determined by multiple factors assessed during the interview process, with the final offer reflecting these considerations.
 
 
 Salary Band
 
 
 $185,000&mdash;$225,000 USD
 
 
 
 Company Perks:
 
 
 
 <ul>
 <li>
 Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions
 </li>
 <li>
 Flexible PTO with U.S. holidays observed and a week shutdown in December to rest and recharge*
 </li>
 <li>
 A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*
 </li>
 <li>
 12 weeks of paid parental leave in the US*
 </li>
 <li>
 401k program, 3% match - vested immediately!*
 </li>
 <li>
 $500 work-from-home stipend to be used up to a year of your start date*
 </li>
 <li>
 $600 technology stipend to support a portion of our hybrid/remote team's cell phone and internet expenses*
 </li>
 <li>
 $1,200 per year Health &amp; Wellness Allowance to support your personal goals*
 </li>
 <li>
 The chance to collaborate with a team at the forefront of AI research
 </li>
 <li>
 Certain perks and benefits are limited to full-time employees only
 
 
 </li>
 </ul>
 
 You.com participates in E-Verify. We will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee's Form I-9 to confirm work authorization. (English/Spanish: E-Verify Participation/Right to Work)
 
 
 We are also an inclusive, equitable, and accessible workplace. Please let us know if you require accommodation for any portion of the recruitment and hiring process.
 
 
 
 
 
 Beware of recruiting scams: You.com will only contact you through official @You.com email addresses and will never ask for payment or sensitive personal information during the hiring process.
 
 
</div>

Whatnot

<div>
 
 
 🚀 Join the Future of Commerce with Whatnot!
 
 
 
 
 Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it's trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We're building live commerce at a scale that's never been done in the West, and there's no playbook to copy. The people here are shaping how an entirely new industry develops.
 
 
 As a remote co-located team, we're inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact.
 
 
 We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce.
 
 
 
 💻 Role
 
 
 
 At Whatnot data engineers build foundational data systems that power product development, experimentation, machine learning, and operational decision-making across the company. As an Data Engineer on the Notifications Platform, you will play a critical role in owning and evolving one of the highest-volume and highest-impact data domains at Whatnot.
 
 
 Notifications generate hundreds of millions of events per day, and the underlying data systems support everything from ML iteration and experimentation to adhoc engineering debugging. In this role, you will define the technical direction for the Notifications data mart, harden it to production-grade reliability, and set new patterns for domain-owned data engineering.
 
 
 Working in a highly cross-functional role, you will collaborate closely with Product Engineers, Data Scientists, ML Engineers, and the Analytics Platform team. You&rsquo;ll make key architectural decisions around data modeling, reliability, latency, and cost &mdash; and then make them real.
 
 
 
 On Any Given Day, You Will
 
 
 
 <ul>
 <li>
 Own data architecture end-to-end. Define how we capture, model, and serve critical business data&mdash;then implement it in production. You&rsquo;ll make architectural decisions around storage formats, compute patterns, and SLAs that balance cost, scalability, and consistency.
 </li>
 <li>
 Build mission-critical pipelines. Develop and operate batch data workflows that process high-volume events related to notifications with tight guarantees for latency, completeness, and accuracy.
 </li>
 <li>
 Design and implement canonical models. Create domain-oriented data models that serve as the source of truth for analytics, ML, and production applications. Establish and enforce modeling standards, ownership boundaries, and data contracts across teams.
 </li>
 <li>
 Enforce data quality at scale. Build tests, lineage, monitoring, and reconciliation systems that make every dataset observable and every anomaly actionable.
 </li>
 <li>
 Automate operational workflows. Partner with business systems and platform teams to eliminate manual data handoffs and reconcile data across services, warehouses, and external systems.
 </li>
 <li>
 Enable insights and experimentation. Support analytics, ML, and product engineering teams by exposing high-quality, self-healing, maintainable data assets.
 
 
 </li>
 </ul>
 
 We offer flexibility to work from home or from one of our global office hubs, and we value in-person time for planning, problem-solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs.
 
 
 
 
 👋 You
 
 
 
 Curious about who thrives at Whatnot? We&rsquo;ve found that embodying a low ego, growth mindset, and high-impact drive goes a long way here.
 
 
 As our next Data Engineer, you bring deep experience designing reliable, scalable data systems and are excited to take true ownership of a complex product domain.
 
 
 You should have 5+ years of experience in the data or software engineering domain, plus:
 
 
 <ul>
 <li>
 Strong experience building and maintaining production-grade data pipelines with clear SLAs, monitoring, and alerting
 </li>
 <li>
 Deep expertise in SQL, including complex model graphs, dependency management, and performance optimization
 </li>
 <li>
 Are comfortable writing production-grade code in Python or SQL languages, and integrating with CI/CD and infrastructure-as-code workflows.
 </li>
 <li>
 Have deep hands-on expertise with modern data tooling across ingestion (e.g., Kafka, Debezium), transformation (dbt, Spark, Flink), orchestration (Dagster, Airflow), and observability (Monte Carlo, Great Expectations).
 </li>
 <li>
 Have operated cloud data warehouses such as Snowflake, BigQuery, or Redshift, including schema design, cost optimization, and workload tuning.
 </li>
 <li>
 Proven track record working with large-scale datasets (hundreds of millions of rows per day)
 </li>
 <li>
 Experience designing data models that balance analytics, ML, and operational debugging use cases
 </li>
 <li>
 Strong systems thinking &mdash; you consider correctness, latency, cost, and maintainability together
 </li>
 <li>
 Self-starter ethic, thriving under a high level of autonomy
 </li>
 <li>
 Exceptional interpersonal and communication skills in cross-functional environments
 
 
 </li>
 </ul>
 
 💰Compensation For Full-Time (Salary)
 
 
 
 
 US based applicants:
 
 $195,000/year to $230,000/year + benefits + equity.
 
 
 The salary range may be inclusive of several levels that would be applicable to the position. Final salary will be based on a number of factors including, level, relevant prior experience, skills, and expertise. This range is only inclusive of base salary, not benefits (more details below) or equity.
 
 
 
 🎁 Benefits
 
 
 
 <ul>
 <li>
 Generous Holiday and Time off Policy
 </li>
 <li>
 Health Insurance options including Medical, Dental, Vision
 </li>
 <li>
 Work From Home Support
 </li>
 <ul>
 <li>
 Home office setup allowance
 </li>
 <li>
 Monthly allowance for cell phone and internet
 </li>
 </ul>
 <li>
 Care benefits
 </li>
 <ul>
 <li>
 Monthly allowance for wellness
 </li>
 <li>
 Annual allowance towards Childcare
 </li>
 <li>
 Lifetime benefit for family planning, such as adoption or fertility expenses
 </li>
 </ul>
 <li>
 Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
 </li>
 <li>
 Monthly allowance to dogfood the app
 </li>
 <ul>
 <li>
 All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
 </li>
 </ul>
 <li>
 Parental Leave
 </li>
 <ul>
 <li>
 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.
 </li>
 </ul>
 </ul>
 
 
 💛 EOE
 
 
 
 
 Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.
 
 
 Compensation Range: $180K - $260K
 
 
</div>

Data Engineer, Notifications

Cohere

<div>
 
 Who are we?
 
 
 
 Our mission is to scale intelligence to serve humanity. We&rsquo;re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.
 
 
 We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what&rsquo;s best for our customers.
 
 
 Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.
 
 
 Join us on our mission and shape the future!
 
 
 
 Why this role?
 
 
 
 We're building the foundational infrastructure that will define how the world thinks about and deploys AI, and we want the sharpest, most curious people to help us do it. As a member of our Analytics &amp; Data Insights team, you'll tackle the kind of problems that don't have textbook answers yet, launch products that didn't exist a year ago, and help enterprises understand what foundational AI actually means for their bottom line.
 
 
 
 As a Data Engineer, You Will
 
 
 
 <ul>
 <li>
 Work directly on storage infrastructure, product launches, and new customer experiences built on one of the most advanced AI systems in the world
 </li>
 <li>
 Collaborate daily with researchers and engineers who are some of the best in the world at what they do
 </li>
 <li>
 Run implementations end-to-end and see initiatives through to real outcomes &mdash; no waiting around to be told what to do
 </li>
 <li>
 Partner across research, marketing, sales, and finance to help define how Cohere grows, with your recommendations feeding directly into products and strategy
 
 
 </li>
 </ul>
 
 You May Be a Good Fit If You Have
 
 
 
 <ul>
 <li>
 5+ years of experience working on production-grade data processing systems
 </li>
 <li>
 Strong command of Python and SQL
 </li>
 <li>
 Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink
 </li>
 <li>
 The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX
 </li>
 <li>
 Experience with modern orchestration platforms, especially Kubernetes (nice to have)
 </li>
 <li>
 Familiarity with modern analytics stack tooling such as BigQuery, Airflow, or dbt (nice to have)
 </li>
 <li>
 Knowledge of Java or Golang (nice to have)
 </li>
 <li>
 Genuine excitement about AI - you follow the research, have opinions, and enjoy being in the weeds
 </li>
 <li>
 Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimise what already exists
 
 
 </li>
 </ul>
 If some of the above doesn&rsquo;t line up perfectly with your experience, we still encourage you to apply!
 
 
 We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
 
 
 
 Full-Time Employees At Cohere Enjoy These Perks
 
 
 
 🤝 An open and inclusive culture and work environment
 
 
 🧑&zwj;💻 Work closely with a team on the cutting edge of AI research
 
 
 🍽 Weekly lunch stipend, in-office lunches &amp; snacks
 
 
 🦷 Full health and dental benefits, including a separate budget to take care of your mental health
 
 
 🐣 100% Parental Leave top-up for up to 6 months
 
 
 🎨 Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
 
 
 🏙 Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
 
 
 ✈️ 6 weeks of vacation (30 working days!)
</div>

<div>
 
 
 🚀 Join the Future of Commerce with Whatnot!
 
 
 
 
 Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it's trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We're building live commerce at a scale that's never been done in the West, and there's no playbook to copy. The people here are shaping how an entirely new industry develops.
 
 
 As a remote co-located team, we're inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact.
 
 
 We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce.
 
 
 
 💻 Role
 
 
 
 Data is crucial to Whatnot&rsquo;s mission to bring people together through commerce.
 
 
 As our newest
 
 Data Engineer
 
 , you&rsquo;ll build and scale the systems that power data-driven decisions across the company. You&rsquo;ll work directly with stakeholders across the business &ndash; such as product, sales, marketing, finance, and trust teams &ndash; to design reliable data architectures, ship resilient pipelines, and create the foundational data products that power Whatnot&rsquo;s internal and external growth.
 
 
 
 On Any Given Day, You Will
 
 
 
 <ul>
 <li>
 Own data architecture end-to-end. Define how we capture, model, and serve critical business data&mdash;then implement it in production. You&rsquo;ll make architectural decisions around storage formats, compute patterns, and SLAs that balance cost, scalability, and consistency.
 </li>
 <li>
 Build mission-critical pipelines. Develop and operate streaming and batch data workflows that process high-volume events across multiple domains&mdash;user activity, transactions, experimentation, marketing performance, and operational telemetry&mdash;with tight guarantees for latency, completeness, and accuracy.
 </li>
 <li>
 Design and implement canonical models. Create domain-oriented data models that serve as the source of truth for analytics, ML, and real-time applications. Establish and enforce modeling standards, ownership boundaries, and data contracts across teams.
 </li>
 <li>
 Enforce data quality at scale. Build tests, lineage, monitoring, and reconciliation systems that make every dataset observable and every anomaly actionable.
 </li>
 <li>
 Automate operational workflows. Partner with business systems and platform teams to eliminate manual data handoffs and reconcile data across services, warehouses, and external systems.
 </li>
 <li>
 Enable insights and experimentation. Support analytics, ML, and product engineering teams by exposing high-quality, low-latency data through semantic layers, APIs, and real-time query systems.
 
 
 </li>
 </ul>
 Due to the cross-functional nature of this role, candidates will be matched to multiple teams based on need and experience, including product, analytics, or data platforms teams.
 
 
 
 👋 You
 
 
 
 People who do well at Whatnot tend to be comfortable figuring things out as they go, biased toward action, and genuinely curious about what they're building. They care more about outcomes than credit and stay close to the product and the people using it.
 
 
 <ul>
 <li>
 Have 3+ years of experience as a data or software engineer building data warehouses, distributed data systems, or event-driven architectures.
 </li>
 <li>
 Can design and implement data models using dimensional, Data Vault, or ledger-style techniques that support analytical and transactional workloads.
 </li>
 <li>
 Have deep hands-on expertise with modern data tooling across ingestion (e.g., Kafka, Debezium), transformation (dbt, Spark, Flink), orchestration (Dagster, Airflow), and observability (Monte Carlo, Great Expectations).
 </li>
 <li>
 Have operated cloud data warehouses such as Snowflake, BigQuery, or Redshift, including schema design, cost optimization, and workload tuning.
 </li>
 <li>
 Are comfortable writing production-grade code in Python or SQL languages, and integrating with CI/CD and infrastructure-as-code workflows.
 </li>
 <li>
 Enjoy partnering across disciplines&mdash;engineering, product, analytics&mdash;to translate messy business requirements into elegant data systems.
 </li>
 <li>
 Thrive as a self-starter in a fast-moving environment, owning both the technical design and the operational outcomes of your work.
 
 
 </li>
 </ul>
 If designing the data backbone that powers Whatnot&rsquo;s growth, insights, and product innovation excites you, we&rsquo;d love to meet you.
 
 
 
 We offer flexibility to work from home or from one of our global office hubs, and we value in-person time for planning, problem-solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs.
 
 
 
 
 💰Compensation
 
 
 
 
 For Full-Time (Salary)
 
 
 
 
 US based applicants:
 
 $180,000/year to $260,000/year + benefits + equity.
 
 
 The salary range may be inclusive of several levels that would be applicable to the position. Final salary will be based on a number of factors including, level, relevant prior experience, skills, and expertise. This range is only inclusive of base salary, not benefits (more details below) or equity.
 
 
 
 🎁 Benefits
 
 
 
 <ul>
 <li>
 Generous Holiday and Time off Policy
 </li>
 <li>
 Health Insurance options including Medical, Dental, Vision
 </li>
 <li>
 Work From Home Support
 </li>
 <ul>
 <li>
 Home office setup allowance
 </li>
 <li>
 Monthly allowance for cell phone and internet
 </li>
 </ul>
 <li>
 Care benefits
 </li>
 <ul>
 <li>
 Monthly allowance for wellness
 </li>
 <li>
 Annual allowance towards Childcare
 </li>
 <li>
 Lifetime benefit for family planning, such as adoption or fertility expenses
 </li>
 </ul>
 <li>
 Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
 </li>
 <li>
 Monthly allowance to dogfood the app
 </li>
 <ul>
 <li>
 All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
 </li>
 </ul>
 <li>
 Parental Leave
 </li>
 <ul>
 <li>
 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.
 </li>
 </ul>
 </ul>
 
 
 💛 EOE
 
 
 
 
 Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.
 
 
 Compensation Range: $180K - $260K
 
 
</div>

Figma

<div>
 Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma&rsquo;s platform helps teams bring ideas to life&mdash;whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us!
 
 
 We are looking for an experienced Data Engineer to partner with our Data Science and Data Infrastructure teams to own and scale our data pipelines. You&rsquo;ll also work closely with stakeholders across business teams including sales, marketing, and finance to ensure that the data they need arrives promptly and reliably. You&rsquo;ll play an integral role in building the metrics and self-serve reporting capabilities to unlock Figma&rsquo;s next phase of growth.
 
 
 This is a great role for an individual who is passionate about working with data and data systems, and who loves solving problems. You&rsquo;ll have a good sense for when it makes sense to build fast, scrappy solutions to unblock a key stakeholder vs. when to push back or bring in an outside service. The ideal candidate will be a great communicator who can help coordinate across multiple internal and external teams and takes pride in building end-to-end projects.
 
 
 This is a full time role that can be held from one of our US hubs or remotely in the United States.
 
 
 
 What you'll do at Figma
 
 
 :
 
 
 
 <ul>
 <li>
 Own, build, and maintain scalable data pipelines that connect various cloud data sources.
 </li>
 <li>
 Develop a deep understanding of Figma&rsquo;s core data models and optimize data pipelines for scale.
 </li>
 <li>
 Partner with the Data Science and Data Infrastructure teams to build new foundational data sets that are trusted, well understood, and enable self-service.
 </li>
 <li>
 Work with a wide range of cross-functional stakeholders to derive requirements and architect shared datasets; ability to document, simplify and explain complex problems to different types of audiences.
 </li>
 <li>
 Establish best practices for the development of specialized data sets for analytics and modeling.
 
 
 </li>
 </ul>
 We'd love to hear from you if you have:
 
 
 <ul>
 <li>
 4+ years in a relevant field.
 </li>
 <li>
 Fluency with both SQL and Python.
 </li>
 <li>
 Familiarity with Snowflake, dbt, Dagster, and ETL/reverse ETL tools.
 </li>
 <li>
 Excellent judgment and creative problem solving skills.
 </li>
 <li>
 A self-starting mindset along with strong communication and collaboration skills.
 
 
 </li>
 </ul>
 While not required, it&rsquo;s an added plus if you also have:
 
 
 <ul>
 <li>
 Knowledge in data modeling methodologies to design and build robust data architectures for insightful analytics.
 </li>
 <li>
 Experience with business systems such as Salesforce, Customer IO, Stripe, NetSuite is a big plus.
 
 
 </li>
 </ul>
 At Figma, one of our values is Grow as you go. We believe in hiring smart, curious people who are excited to learn and develop their skills. If you&rsquo;re excited about this role but your past experience doesn&rsquo;t align perfectly with the points outlined in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.
 
 
 
 Pay Transparency Disclosure
 
 
 
 If based in Figma&rsquo;s San Francisco or New York hub offices, this role has the annual base salary range stated below.
 
 
 Job level and actual compensation will be decided based on factors including, but not limited to, individual qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), market demands, and specific work location. The listed range is a guideline, and the range for this role may be modified. For roles that are available to be filled remotely, the pay range is localized according to employee work location by a factor of between 80% and 100% of range. Please discuss your specific work location with your recruiter for more information.
 
 
 Figma offers equity to employees, as well a competitive package of additional benefits, including health, dental &amp; vision, retirement with company contribution, parental leave &amp; reproductive or family planning support, mental health &amp; wellness benefits, generous PTO, company recharge days, a learning &amp; development stipend, a work from home stipend, and cell phone reimbursement. Figma also offers sales incentive pay for most sales roles and an annual bonus plan for eligible non-sales roles. Figma&rsquo;s compensation and benefits are subject to change and may be modified in the future.
 
 
 Annual Base Salary Range:
 
 
 $140,000&mdash;$348,000 USD
 
 
 At Figma we celebrate and support our differences. We know employing a team rich in diverse thoughts, experiences, and opinions allows our employees, our product and our community to flourish. Figma is an equal opportunity workplace - we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity/expression, veteran status
 
 ,
 
 or any other characteristic protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.
 
 
 We will work to ensure individuals with disabilities are provided reasonable accommodation to apply for a role, participate in the interview process, perform essential job functions, and receive other benefits and privileges of employment. If you require accommodation, please reach out to accommodations-ext@figma.com. These modifications enable an individual with a disability to have an equal opportunity not only to get a job, but successfully perform their job tasks to the same extent as people without disabilities.
 
 
 Examples of accommodations include but are not limited to:
 
 
 <ul>
 <li>
 Holding interviews in an accessible location
 </li>
 <li>
 Enabling closed captioning on video conferencing
 </li>
 <li>
 Ensuring all written communication be compatible with screen readers
 </li>
 <li>
 Changing the mode or format of interviews
 
 
 </li>
 </ul>
 To ensure the integrity of our hiring process and facilitate a more personal connection, we require all candidates keep their cameras on during video interviews. Additionally, if hired you will be required to attend in person onboarding.
 
 
 By applying for this job, the candidate acknowledges and agrees that any personal data contained in their application or supporting materials will be processed in accordance with Figma's Candidate Privacy Notice.
</div>

Explore 203+ Data developer in San Francisco this May. Find roles across top companies and apply now to boost your career.

203 data developer jobs In San Francisco

Data Engineer

Data Engineer

Data Engineer

Data Engineer, Notifications

Data Engineer

Data Engineer

Data Engineer