data pipeline engineer

ROLLER

<div>
 
 About ROLLER
 
 
 
 ROLLER is not your average software-as-a-service company. With a global presence in over 30 countries, we're here to bring some excitement to the leisure and attractions industry and make a difference! Our mission is to help businesses operate smoothly and create fun and memorable guest experiences by providing seamless ticketing, point-of-sale, self-serve kiosks, memberships and digital waiver processes.
 
 
 But here's the best part: our team. We're a group of 300+ highly passionate, enthusiastic, and down-to-earth professionals located all around the world who are all working together to build something truly remarkable. We're aiming high and believe that the possibilities are endless. As we continue to grow globally, we're excited to write our success story and have fun along the way.
 
 
 We genuinely love what we do, and we're looking for like-minded people to join us on this amazing journey. If you're ready to be part of a dynamic team and make a real impact, come aboard, and let's create some unforgettable experiences together at ROLLER!
 
 
 
 About the Role
 
 
 
 We are seeking a highly technical, hands-on
 
 Senior
 
 
 Data Engineer
 
 to architect and scale our data infrastructure from the ground up. As a core member of the data function within our Business Technology team, you will be responsible for building the pipelines and models that power smarter decision-making and operational efficiency across the entire organization.
 
 
 In this foundational role, you will build &amp; architect the
 
 modern data stack
 
 , ensuring our infrastructure is robust, automated, and governed. You collaborate as a technical partner with
 
 GTM
 
 
 ,Product, Finance, P&amp;C
 
 to build high-performance data models and pipelines that transform raw data into actionable cross-functional insights.
 
 
 Joining ROLLER at this pivotal growth stage, you will have the opportunity to make an outsized impact on our technical landscape, directly influencing how we process data to deliver world-class experiences for our customers globally.
 
 
 
 What You'll Do
 
 
 
 <ul>
 <li>
 
 Scalable Architecture:
 
 Design and implement robust Data Modeling and Architecture strategies that support high-volume data processing and maintain long-term scalability.
 </li>
 <li>
 
 Cloud Ecosystem:
 
 Develop and manage end-to-end data pipelines using Google Cloud Platform services, specifically leveraging Cloud Run, Cloud Function for compute, BigQuery for storage, and Cloud Composer (Airflow) for orchestration.
 </li>
 <li>
 
 Transformation Excellence:
 
 Build, maintain, and document complex data transformation layers using DBT (Data Build Tool) to ensure high data quality and reliability.
 </li>
 <li>
 
 Infrastructure as Code:
 
 Automate the provisioning of cloud resources using Terraform and streamline deployment workflows via GitHub Actions CI/CD pipelines.
 </li>
 <li>
 
 Cloud Data Warehousing:
 
 Demonstrate expert-level proficiency in managing and optimizing Cloud Data Warehouses, such as Snowflake &amp; BigQuery.
 </li>
 <li>
 
 Team Collaboration:
 
 Partner with cross-functional stakeholders to build and scale high-performing data infrastructure that supports engineering, analytics, and Data Program needs.
 </li>
 <li>
 
 Stack Management:
 
 Architect and maintain a modern data stack by implementing best-in-class tools including Snowflake, Bigquery, dbt, Fivetran, Looker, Tableau and Airflow.
 </li>
 <li>
 
 Pipeline Engineering:
 
 Develop scalable ETL/ELT workflows and robust data models to deliver real-time analytics and unified business reporting.
 </li>
 <li>
 
 Data Visualization: Create and maintain intuitive, high-performance Looker dashboards will be an added advantage.
 
 
 
 </li>
 </ul>
 
 About You
 
 
 
 You are a technical builder who views data as a competitive advantage. You thrive in fast-paced environments and have a proven track record of engineering scalable data foundations from the ground up. Equal parts
 
 architect and analytical problem-solver
 
 , you excel at balancing long-term technical vision with the daily hands-on execution of complex pipelines.
 
 
 You are energized by the full lifecycle of data&mdash;moving beyond just writing code to actively leading
 
 project discovery and analysis
 
 alongside cross-functional partners. You take pride in enabling GTM, Product, Finance &amp; P&amp;C teams through clear insights and high-performance systems. Most importantly, you are excited to act as a founding technical force for a high-growth SaaS company that is transforming the guest experience for attractions businesses globally.
 
 
 <ul>
 <li>
 
 5+ years of experience
 
 in Data &amp; Analytics or Data Engineering with a focus on Scalable cloud driven data pipeline build
 </li>
 <li>
 Proven experience in dimensional modeling (Star/Snowflake schema) and designing architectures that support both historical reporting and real-time needs.
 </li>
 <li>
 Expert-level proficiency in Snowflake or BigQuery, including performance tuning, cost optimization, and access control (RBAC).
 </li>
 <li>
 Hands-on experience with Google Cloud Platform services, specifically Cloud Function, Cloud Run for containerized workloads and Cloud Composer for orchestration.
 </li>
 <li>
 Through hands-on experience of dbt (Data Build Tool) to manage transformations, including writing custom macros, implementing tests, and generating documentation.
 </li>
 <li>
 Solid experience using Terraform to provision cloud resources, ensuring that infrastructure is version-controlled and reproducible.
 </li>
 <li>
 Proficiency in GitHub Actions to automate testing and deployment pipelines for data models and infrastructure.
 </li>
 <li>
 Ability to design high-performance dashboards that prioritize user experience and fast load times.
 </li>
 <li>
 Experience collaborating with Finance, GTM, and Product to define key metrics (like CAC, LTV, or Churn) and codifying them into the data layer.
 </li>
 <li>
 Familiarity with data ingestion tools like Fivetran , Airbyte, Workato, Mulesoft to sync data from various SaaS platforms into the warehouse.
 </li>
 <li>
 Operates as a full-stack Data Engineer with the technical authority to architect and build entire data lifecycles, from raw source ingestion to high-impact data visualization.
 </li>
 <li>
 
 Familiarity with business-critical systems
 
 like Salesforce, Chargbee, Gainsight, and product analytics tools.
 </li>
 <li>
 
 Strong communicator
 
 with a track record of working across technical and non-technical teams to drive alignment.
 </li>
 <li>
 You have a high appetite for Technology and AI and a natural curiosity for how it can transform your work. You're comfortable using AI tools to automate repetitive 'busy work,' freeing you up to focus on high-impact work.
 
 
 </li>
 </ul>
 We believe AI is a career-defining inflection point. ROLLER is a fast adopter of new technology like AI, and every team member is empowered to own their learning and use the latest tools to supercharge their impact. We're looking for candidates with the proficiency and curiosity to embrace AI and technology &mdash; not just as a technical skill, but as a core competency to help us achieve big goals
 
 
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Experience partnering with IT or Business Technology teams to drive cross-functional outcomes.
 </li>
 <li>
 Exposure to customer success and revenue workflows, such as onboarding journeys, renewal metrics, or support analytics.
 </li>
 <li>
 Familiarity with AI/ML pipelines and experimentation frameworks that support data-driven innovation.
 
 
 </li>
 </ul>
 Perks!
 
 
 <ul>
 <li>
 You'll get to work on a category-leading product that customers love in a fun, high-growth industry! Check our Capterra and G2 reviews.
 </li>
 <li>
 ROLLER Recharge days to celebrate and recharge once we've hit our goals
 </li>
 <li>
 Engage in our 'Vibe Tribe' - led by our team members; you can contribute to company-wide initiatives directly. Regular events and social activities, fundraising &amp; cause-related campaigns...you name it. We're willing to make it happen!
 </li>
 <li>
 Team Member Assistance Program to proactively support our team's health and wellbeing - access to coaching, education modules, weekly webinars, and more.
 </li>
 <li>
 16 weeks paid Parental Leave for primary carers and 4 weeks paid Parental Leave for secondary carers.
 </li>
 <li>
 Work with a driven, fun, and switched-on team that likes to raise the bar in all we do!
 </li>
 <li>
 Individual learning &amp; development budget plus genuine career growth opportunities as we continue to expand!
 
 
 </li>
 </ul>
 What You Can Expect
 
 
 <ul>
 <li>
 
 Initial call with our Talent Acquisition Manager
 
 You'll have an initial call with our Talent Acquisition Manager to chat through some of your experience to date, salary expectations and you can check off any initial questions you might have.
 </li>
 <li>
 
 Interview with the Hiring Manager
 
 You'll get to meet with the hiring manager to learn more about the role &amp; ROLLER whilst also talking through your experience in more detail.
 </li>
 <li>
 
 Loop Interviews
 
 This is where you will get to meet our wider ROLLER team to do a 'vibe check' on us to make sure our culture &amp; vibe meet what you are looking for!
 </li>
 <li>
 
 Offer
 
 If all lights are green and the fit feel right, we'll conduct reference checks and you'll receive an offer to join!
 </li>
 </ul>
</div>

Data Engineer

You.com

<div>
 
 About Us
 
 
 
 At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge layer that agents, applications, and enterprises rely on to retrieve real-time, accurate, and citation-backed information.
 
 
 Our platform combines proprietary vertical indexes with LLM-optimized retrieval systems to power AI agents, applications, and enterprise workflows. We are solving hard problems across search, large language models, and large-scale infrastructure to make AI systems more reliable, transparent, and useful.
 
 
 Our team includes engineers, researchers, product builders, and operators who care about solving meaningful problems and delivering real-world impact. Whether you are improving core infrastructure, shaping product experiences, or helping bring new AI capabilities to market, your work will help define how modern AI finds and uses knowledge.
 
 
 
 About The Role
 
 
 
 We are looking for a hands-on Data Engineer to help build and scale our modern data platform. In this role, you will work closely with engineering, product, and analytics teams to develop reliable, high-performance data pipelines and systems.
 
 
 You'll contribute to both batch and real-time data processing using technologies like Databricks, AWS, and Kafka, while helping ensure data quality, accessibility, and usability across the organization. You'll play a key role in enabling data activation, ensuring that high-quality data flows not only into the warehouse but also outward to business tools like Salesforce, HubSpot, and Braze. Additionally, you will help power next-generation
 
 AI-driven applications
 
 , including agent-based systems and retrieval-augmented generation (RAG), by building robust data foundations and pipelines. This is a great opportunity for someone who enjoys solving data challenges end-to-end from ingestion to insights.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Build and maintain scalable data pipelines (batch and streaming) using tools like Databricks, Spark, Kafka, and AWS services
 </li>
 <li>
 Design, develop, and optimize ETL/ELT workflows using DBT, PySpark, SQL, and tools like Fivetran
 </li>
 <li>
 Partner closely with marketing and growth teams to enable data use cases such as segmentation, campaign targeting, and lifecycle analytics
 </li>
 <li>
 Develop and maintain reverse ETL pipelines to sync data from the warehouse to tools like Salesforce, HubSpot, Braze, and other downstream systems
 </li>
 <li>
 Create and manage curated datasets to support analytics, reporting, and go-to-market initiatives
 </li>
 <li>
 Build and maintain dashboards and reporting layers to support marketing and business performance tracking
 </li>
 <li>
 Support AI/ML and agent-based applications by preparing and serving high-quality datasets for RAG pipelines and MCP (Model Context Protocol) integrations
 </li>
 <li>
 Monitor pipeline performance, troubleshoot issues, and ensure high data reliability and quality
 </li>
 <li>
 Implement data quality checks, validations, and alerting mechanisms across both ingestion and activation layers
 </li>
 <li>
 Collaborate with cross-functional teams to define data contracts and ensure consistency across systems
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 
 6+ years
 
 of experience in data engineering or a related field
 </li>
 <li>
 Strong hands-on experience with Databricks, AWS (S3, Glue, Athena, EMR, etc.), and Kafka
 </li>
 <li>
 Proficiency in Python (PySpark) and SQL for large-scale data processing
 </li>
 <li>
 Experience building and maintaining ETL/ELT pipelines (DBT/Airflow or similar experience preferred)
 </li>
 <li>
 Experience with data ingestion tools such as Fivetran (or similar)
 </li>
 <li>
 Familiarity with reverse ETL / data activation workflows and syncing data to tools like Salesforce, HubSpot, Braze
 </li>
 <li>
 Exposure to or experience with AI/ML data pipelines, including RAG architectures, vector databases, or embeddings workflows
 </li>
 <li>
 Familiarity with agent-based systems, MCP integrations, or LLM-powered applications is a strong plus
 </li>
 <li>
 Experience working with marketing, Product or growth teams on data use cases (segmentation, attribution, campaign analytics, etc.)
 </li>
 <li>
 Understanding of data modeling and working with large-scale datasets (batch and streaming)
 </li>
 <li>
 Experience creating dashboards and supporting reporting workflows (BI tools) for both internal and external audiences
 </li>
 <li>
 Strong problem-solving skills and ability to debug production data issues
 </li>
 <li>
 Strong communication skills and ability to work collaboratively across teams
 
 
 </li>
 </ul>
 Our salary bands are structured based on a combination of geographic tiers and internal leveling. Compensation is determined by multiple factors assessed during the interview process, with the final offer reflecting these considerations.
 
 
 Salary Band
 
 
 $185,000&mdash;$225,000 USD
 
 
 
 Company Perks:
 
 
 
 <ul>
 <li>
 Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions
 </li>
 <li>
 Flexible PTO with U.S. holidays observed and a week shutdown in December to rest and recharge*
 </li>
 <li>
 A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*
 </li>
 <li>
 12 weeks of paid parental leave in the US*
 </li>
 <li>
 401k program, 3% match - vested immediately!*
 </li>
 <li>
 $500 work-from-home stipend to be used up to a year of your start date*
 </li>
 <li>
 $600 technology stipend to support a portion of our hybrid/remote team's cell phone and internet expenses*
 </li>
 <li>
 $1,200 per year Health &amp; Wellness Allowance to support your personal goals*
 </li>
 <li>
 The chance to collaborate with a team at the forefront of AI research
 </li>
 <li>
 Certain perks and benefits are limited to full-time employees only
 
 
 </li>
 </ul>
 
 You.com participates in E-Verify. We will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee's Form I-9 to confirm work authorization. (English/Spanish: E-Verify Participation/Right to Work)
 
 
 We are also an inclusive, equitable, and accessible workplace. Please let us know if you require accommodation for any portion of the recruitment and hiring process.
 
 
 
 
 
 Beware of recruiting scams: You.com will only contact you through official @You.com email addresses and will never ask for payment or sensitive personal information during the hiring process.
 
 
</div>

FRONT

<div>Front is the customer operations platform built for B2B complexity, keeping every team, tool, and customer conversation in sync so companies can scale without losing connection. Others handle simple interactions. Front handles the coordination and context behind complex B2B customer relationships. Over 9,000 companies, including Uber Freight, Navan, and Stripe, rely on Front because it's the only one that can run the operational layer that makes customer-facing work actually succeed.
Backed by Sequoia Capital and Salesforce Ventures, Front has raised $204M from leading venture capital firms and independent investors including top executives at Atlassian, Okta, Qualtrics, Zoom, and PagerDuty. Front has received numerous Great Place to Work accolades, including Built In's 100 Best Midsize Places to Work in SF 2025, Top Places to Work by USA Today 2025, Y Combinator's list of Top Companies in 2023, #4 on Fortune&rsquo;s Best Workplaces in the Bay Area ,Inc. Magazine's 2022 Best Workplaces list, and Forbes Best Startup Employers 2022 List.
At Front, data is at the center of how we scale go-to-market (GTM). Our Data Engineering team builds and operates the pipelines, models, and tooling that power reliable reporting and analytics for Sales, Marketing, Partnerships, and RevOps.
This L4 Senior Data Engineer role is based in San Francisco (hybrid) and will be a key partner to the Marketing org. You&rsquo;ll own the datasets and semantic layer that power marketing performance reporting and decision-making &mdash; from campaign attribution and pipeline influence to lead-to-revenue analysis &mdash; and you&rsquo;ll build the production-grade pipelines and guardrails that make those insights trustworthy and self-serve.
What will you be doing?<ul><li>
Build and maintain end-to-end pipelines that move and transform data from GTM + Marketing systems (e.g., CRM, marketing automation, web analytics, product usage, billing) into our warehouse for analytics and operational use.</li><li>
Design and own trusted, well-documented data models for marketing + GTM concepts such as leads, contacts, accounts, opportunities, campaign touchpoints, attribution, pipeline influence, bookings, and churn.</li><li>
Partner with Marketing Ops, Growth Marketing, RevOps, and Analytics to define metrics, align definitions, and ensure consistent reporting across teams and tools.</li><li>
Improve data quality and observability by implementing monitoring, alerting, SLAs, automated tests, and incident response practices for critical marketing datasets.</li><li>
Enable self-serve analytics by building curated datasets, a semantic layer, and safe access patterns that let stakeholders explore data with confidence.</li><li>
Optimize performance and cost by tuning warehouse workloads, incremental processing patterns, and storage/compute strategies for large-scale datasets.</li><li>
Contribute to platform improvements such as orchestration, CI/CD for data, access controls (RBAC), and PII handling to keep our data secure and compliant.</li></ul>
What skills and experience do you need?<ul><li>
7+ years of dedicated data engineering, analytics engineering, or related experience building and debugging production data pipelines and data models at scale.</li><li>
Strong SQL plus experience writing clean, testable code in Python (or a similar language used for data engineering).</li><li>
Experience building data models and pipelines on top of large datasets (hundreds of TB through petabyte scale), with attention to performance and cost.</li><li>
Experience with modern data stacks and warehouses/lakes (e.g., Snowflake, Redshift, Databricks) and orchestration tools (e.g., Airflow) as well as modern SQL transformation practices (e.g., dbt).</li><li>
Ability to navigate ambiguity: translating vague, complex, or competing goals from executive stakeholders into clear, actionable, and robust data solutions.</li><li>
Strong fundamentals in data quality, testing, and debugging, including the ability to trace issues across sources, transforms, and downstream dashboards.</li><li>
Experience designing and implementing access control patterns at scale (RBAC, masking policies, row access policies, role hierarchies) in Snowflake or similar platforms.</li><li>
Mentorship &amp; engineering excellence: raising the technical bar, establishing team standards for dbt/SQL quality and CI/CD, and supporting others through reviews and pairing.</li><li>
Strong collaboration and empathy: you listen, ask the right questions, and build solutions that balance stakeholder needs with platform integrity.</li><li>
You champion data privacy and integrity, and act in the best interest of data consumers.</li></ul>
Front operates on a hybrid model &mdash; we come together in the office each Tuesday, Wednesday, and Thursday to collaborate and stay connected.
What we offer<ul><li>
Competitive salary</li><li>
Equity (we are post-series D &amp; backed by some of the best VCs in the US)</li><li>
Private health insurance, including plan options at no cost to employees</li><li>
Paid parental leave</li><li>
Flexible time off policy</li><li>
Flexibility to work from home Monday and Friday, unless posted as a fully remote role</li><li>
Mental health support with Workplace Options</li><li>
Family planning support with Maven</li><li>
$100 per month Lifestyle Stipend to spend on fitness, health and wellness, and other activities</li><li>
Wellness Days - Fronteers get an additional day off on months with no holidays</li><li>
Winter Break - Our offices are closed from Christmas to New Year's Day!</li></ul>
Front provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age or disability. By applying, you acknowledge and agree that you have read and understand the California Recruiting Privacy Notice &amp; EU Privacy Notice
Compensation Range: $239K - $271K</div>

Senior Data Engineer

YO IT Consulting

<div>
 
 Job Title:
 
 Data Engineer
 
 
 
 Job Type:
 
 Contractor
 
 
 
 Location:
 
 Remote
 
 
 
 Job Summary
 
 
 
 We are seeking an expert Data Engineer to join our customer&rsquo;s team and play a pivotal role in developing next-generation AI agents. In this fully remote role, you will leverage your strong data engineering, coding, and AI/ML expertise to help train and optimize advanced AI systems. Collaborate with talented professionals in a dynamic environment where your technical skills and innovative mindset will directly impact the project's success.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Design, implement, and manage data pipelines to support complex AI agent training initiatives.
 </li>
 <li>
 Collaborate closely with AI/ML engineers to ensure efficient data flows and high-quality training datasets.
 </li>
 <li>
 Develop and maintain scalable ETL processes using Python, MySQL, and PostgreSQL.
 </li>
 <li>
 Utilize JAVA and JavaScript to integrate diverse data sources and enable seamless data exchange.
 </li>
 <li>
 Contribute to the optimization of AI models through effective data engineering practices.
 </li>
 <li>
 Document data processes comprehensively and communicate technical concepts clearly to both technical and non-technical stakeholders.
 </li>
 <li>
 Troubleshoot and resolve data issues, ensuring data integrity and reliability for AI applications.
 
 
 </li>
 </ul>
 
 Required Skills And Qualifications
 
 
 
 <ul>
 <li>
 Bachelor&rsquo;s degree in Computer Science, Engineering, or a related field.
 </li>
 <li>
 3+ years of hands-on experience as a Data Engineer, with proven expertise in AI/ML projects.
 </li>
 <li>
 Advanced proficiency in Python, MySQL, PostgreSQL, JAVA, and JavaScript.
 </li>
 <li>
 Strong understanding of AI concepts and experience in training AI agents.
 </li>
 <li>
 Exceptional written and verbal communication skills, with a focus on clarity and collaboration.
 </li>
 <li>
 Experience implementing robust data pipelines and scalable architecture for machine learning projects.
 </li>
 <li>
 Self-motivated, detail-oriented, and able to thrive in a fully remote team environment.
 
 
 </li>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Master&rsquo;s degree in a related field.
 </li>
 <li>
 Direct experience with AI agent frameworks and real-world deployment projects.
 </li>
 <li>
 Previous work in fast-paced startup or innovation-driven environments.
 </li>
 </ul>
</div>

Data Engineer - Remote

OpenAI

<div>
 
 About The Team
 
 
 
 The Applied team works across research, engineering, product, and design to bring OpenAI&rsquo;s technology to consumers and businesses.
 
 
 We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.
 
 
 
 About The Role
 
 
 
 We're seeking a Data Engineer to take the lead in building our data pipelines and core tables for OpenAI. These pipelines are crucial for powering analyses, safety systems that guide business decisions, product growth, and prevent bad actors. If you're passionate about working with data and are eager to create solutions with significant impact, we'd love to hear from you. This role also provides the opportunity to collaborate closely with the researchers behind ChatGPT and help them train new models to deliver to users. As we continue our rapid growth, we value data-driven insights, and your contributions will play a pivotal role in our trajectory. Join us in shaping the future of OpenAI!
 
 
 
 In This Role, You Will
 
 
 
 <ul>
 <li>
 Design, build and manage our data pipelines, ensuring all user event data is seamlessly integrated into our data warehouse.
 </li>
 <li>
 Develop canonical datasets to track key product metrics including user growth, engagement, and revenue.
 </li>
 <li>
 Work collaboratively with various teams, including, Infrastructure, Data Science, Product, Marketing, Finance, and Research to understand their data needs and provide solutions.
 </li>
 <li>
 Implement robust and fault-tolerant systems for data ingestion and processing.
 </li>
 <li>
 Participate in data architecture and engineering decisions, bringing your strong experience and knowledge to bear.
 </li>
 <li>
 Ensure the security, integrity, and compliance of data according to industry and company standards.
 
 
 </li>
 </ul>
 
 You Might Thrive In This Role If You
 
 
 
 <ul>
 <li>
 Have 3+ years of experience as a data engineer and 8+ years of any software engineering experience(including data engineering).
 </li>
 <li>
 Proficiency in at least one programming language commonly used within Data Engineering, such as Python, Scala, or Java.
 </li>
 <li>
 Experience with distributed processing technologies and frameworks, such as Hadoop, Flink and distributed storage systems (e.g., HDFS, S3).
 </li>
 <li>
 Expertise with any of ETL schedulers such as Airflow, Dagster, Prefect or similar frameworks.
 </li>
 <li>
 Solid understanding of Spark and ability to write, debug and optimize Spark code.
 
 
 </li>
 </ul>
 This role is exclusively based in our San Francisco HQ. We offer relocation assistance to new employees.
 
 
 
 About OpenAI
 
 
 
 OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
 
 
 We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
 
 
 For additional information, please see OpenAI&rsquo;s Affirmative Action and Equal Employment Opportunity Policy Statement.
 
 
 Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
 
 
 To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
 
 
 We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
 
 
 OpenAI Global Applicant Privacy Policy
 
 
 At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
 
 
 Compensation Range: $230K - $385K
</div>

Data Engineer, Analytics

Twitch

<div>
 
 About Us
 
 
 
 Twitch is the world&rsquo;s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day.
 
 
 We&rsquo;re about community, inside and out. You&rsquo;ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We&rsquo;re on a quest to empower live communities, so if this sounds good to you, see what we&rsquo;re up to on LinkedIn and X, and discover the projects we&rsquo;re solving on our Blog. Be sure to explore our Interviewing Guide to learn how to ace our interview process.
 
 
 
 About The Role
 
 
 
 As a data engineer in the Data Platform organization, you will be transforming Twitch&rsquo;s largest data sets into offerings that are usable by the entire company. You&rsquo;ll be working with other senior team members, as well as other data engineers, scientists, and stakeholders from all across the business. You will help define how our core business metrics are managed, as well as how other parts of the company define their individual metrics.
 
 
 
 You Will:
 
 
 
 
 <ul>
 <li>
 Work closely with data scientists and engineers from across the company to define and create robust data architectures and pipelines
 </li>
 <li>
 Develop and manage scalable data pipelines to extract, transform, and load data from various sources
 </li>
 <li>
 Partner with a range of stakeholders to translate the company&rsquo;s needs into data offerings
 </li>
 <li>
 Automate data processing and reporting workflows to improve efficiency and data integrity
 </li>
 <li>
 Implement data quality checks and monitor processes to maintain high data accuracy
 </li>
 <li>
 Simplify and enhance the accessibility, clarity, and usability of large and complex datasets through the development of data cubes and data sharing solutions
 
 
 
 </li>
 </ul>
 
 You Have:
 
 
 
 
 <ul>
 <li>
 3+ year of experience working in a data engineering, data science, or software engineering capacity
 </li>
 <li>
 Expertise in writing and maintaining robust data pipelines in SQL and Python
 </li>
 <li>
 A track record of turning data requirements from stakeholders into actionable plans
 </li>
 <li>
 Experience with cloud-native solutions
 </li>
 <li>
 A history of implementing and upholding best practices in data pipelines, ensuring accuracy, consistency, and reliability
 
 
 
 </li>
 </ul>
 
 Bonus Points
 
 
 
 
 <ul>
 <li>
 Bachelor's degree, or Master's degree in computer science, statistics, information systems, or a related, technical field
 </li>
 <li>
 Experience with a scripting language (e.g., Python, Java, or R)
 </li>
 <li>
 Familiarity and interest in Twitch!
 
 
 
 </li>
 </ul>
 
 Perks
 
 
 
 
 <ul>
 <li>
 Medical, Dental, Vision &amp; Disability Insurance
 </li>
 <li>
 401(k)
 </li>
 <li>
 Maternity &amp; Parental Leave
 </li>
 <li>
 Flexible PTO
 </li>
 <li>
 Amazon Employee Discount
 
 
 
 </li>
 </ul>
 
 Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
 
 
 
 Job ID: TW9042
 
 
 The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
 
 
 US, CA, San Francisco
 
 
 $152,000&mdash;$205,600 USD
 
 
 
 Twitch is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
 
 
 
 
 Twitch values your privacy. Please consult our Candidate Privacy Notice, for information about how we collect, use, and disclose personal information of our candidates.
 
</div>

Whatnot

<div>
 
 
 🚀 Join the Future of Commerce with Whatnot!
 
 
 
 
 Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it's trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We're building live commerce at a scale that's never been done in the West, and there's no playbook to copy. The people here are shaping how an entirely new industry develops.
 
 
 As a remote co-located team, we're inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact.
 
 
 We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce.
 
 
 
 💻 Role
 
 
 
 At Whatnot data engineers build foundational data systems that power product development, experimentation, machine learning, and operational decision-making across the company. As an Data Engineer on the Notifications Platform, you will play a critical role in owning and evolving one of the highest-volume and highest-impact data domains at Whatnot.
 
 
 Notifications generate hundreds of millions of events per day, and the underlying data systems support everything from ML iteration and experimentation to adhoc engineering debugging. In this role, you will define the technical direction for the Notifications data mart, harden it to production-grade reliability, and set new patterns for domain-owned data engineering.
 
 
 Working in a highly cross-functional role, you will collaborate closely with Product Engineers, Data Scientists, ML Engineers, and the Analytics Platform team. You&rsquo;ll make key architectural decisions around data modeling, reliability, latency, and cost &mdash; and then make them real.
 
 
 
 On Any Given Day, You Will
 
 
 
 <ul>
 <li>
 Own data architecture end-to-end. Define how we capture, model, and serve critical business data&mdash;then implement it in production. You&rsquo;ll make architectural decisions around storage formats, compute patterns, and SLAs that balance cost, scalability, and consistency.
 </li>
 <li>
 Build mission-critical pipelines. Develop and operate batch data workflows that process high-volume events related to notifications with tight guarantees for latency, completeness, and accuracy.
 </li>
 <li>
 Design and implement canonical models. Create domain-oriented data models that serve as the source of truth for analytics, ML, and production applications. Establish and enforce modeling standards, ownership boundaries, and data contracts across teams.
 </li>
 <li>
 Enforce data quality at scale. Build tests, lineage, monitoring, and reconciliation systems that make every dataset observable and every anomaly actionable.
 </li>
 <li>
 Automate operational workflows. Partner with business systems and platform teams to eliminate manual data handoffs and reconcile data across services, warehouses, and external systems.
 </li>
 <li>
 Enable insights and experimentation. Support analytics, ML, and product engineering teams by exposing high-quality, self-healing, maintainable data assets.
 
 
 </li>
 </ul>
 
 We offer flexibility to work from home or from one of our global office hubs, and we value in-person time for planning, problem-solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs.
 
 
 
 
 👋 You
 
 
 
 Curious about who thrives at Whatnot? We&rsquo;ve found that embodying a low ego, growth mindset, and high-impact drive goes a long way here.
 
 
 As our next Data Engineer, you bring deep experience designing reliable, scalable data systems and are excited to take true ownership of a complex product domain.
 
 
 You should have 5+ years of experience in the data or software engineering domain, plus:
 
 
 <ul>
 <li>
 Strong experience building and maintaining production-grade data pipelines with clear SLAs, monitoring, and alerting
 </li>
 <li>
 Deep expertise in SQL, including complex model graphs, dependency management, and performance optimization
 </li>
 <li>
 Are comfortable writing production-grade code in Python or SQL languages, and integrating with CI/CD and infrastructure-as-code workflows.
 </li>
 <li>
 Have deep hands-on expertise with modern data tooling across ingestion (e.g., Kafka, Debezium), transformation (dbt, Spark, Flink), orchestration (Dagster, Airflow), and observability (Monte Carlo, Great Expectations).
 </li>
 <li>
 Have operated cloud data warehouses such as Snowflake, BigQuery, or Redshift, including schema design, cost optimization, and workload tuning.
 </li>
 <li>
 Proven track record working with large-scale datasets (hundreds of millions of rows per day)
 </li>
 <li>
 Experience designing data models that balance analytics, ML, and operational debugging use cases
 </li>
 <li>
 Strong systems thinking &mdash; you consider correctness, latency, cost, and maintainability together
 </li>
 <li>
 Self-starter ethic, thriving under a high level of autonomy
 </li>
 <li>
 Exceptional interpersonal and communication skills in cross-functional environments
 
 
 </li>
 </ul>
 
 💰Compensation For Full-Time (Salary)
 
 
 
 
 US based applicants:
 
 $195,000/year to $230,000/year + benefits + equity.
 
 
 The salary range may be inclusive of several levels that would be applicable to the position. Final salary will be based on a number of factors including, level, relevant prior experience, skills, and expertise. This range is only inclusive of base salary, not benefits (more details below) or equity.
 
 
 
 🎁 Benefits
 
 
 
 <ul>
 <li>
 Generous Holiday and Time off Policy
 </li>
 <li>
 Health Insurance options including Medical, Dental, Vision
 </li>
 <li>
 Work From Home Support
 </li>
 <ul>
 <li>
 Home office setup allowance
 </li>
 <li>
 Monthly allowance for cell phone and internet
 </li>
 </ul>
 <li>
 Care benefits
 </li>
 <ul>
 <li>
 Monthly allowance for wellness
 </li>
 <li>
 Annual allowance towards Childcare
 </li>
 <li>
 Lifetime benefit for family planning, such as adoption or fertility expenses
 </li>
 </ul>
 <li>
 Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
 </li>
 <li>
 Monthly allowance to dogfood the app
 </li>
 <ul>
 <li>
 All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
 </li>
 </ul>
 <li>
 Parental Leave
 </li>
 <ul>
 <li>
 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.
 </li>
 </ul>
 </ul>
 
 
 💛 EOE
 
 
 
 
 Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.
 
 
 Compensation Range: $180K - $260K
 
 
</div>

Data Engineer, Notifications

Explore 260+ Data pipeline engineer in San Francisco this April. Find roles across top companies and apply now to boost your career.

260 data pipeline engineer jobs In San Francisco

Data Engineer

Data Engineer

Senior Data Engineer

Data Engineer - Remote

Data Engineer, Analytics

Data Engineer

Data Engineer, Notifications