big data engineer

ROLLER

<div>
 
 About ROLLER
 
 
 
 ROLLER is not your average software-as-a-service company. With a global presence in over 30 countries, we're here to bring some excitement to the leisure and attractions industry and make a difference! Our mission is to help businesses operate smoothly and create fun and memorable guest experiences by providing seamless ticketing, point-of-sale, self-serve kiosks, memberships and digital waiver processes.
 
 
 But here's the best part: our team. We're a group of 300+ highly passionate, enthusiastic, and down-to-earth professionals located all around the world who are all working together to build something truly remarkable. We're aiming high and believe that the possibilities are endless. As we continue to grow globally, we're excited to write our success story and have fun along the way.
 
 
 We genuinely love what we do, and we're looking for like-minded people to join us on this amazing journey. If you're ready to be part of a dynamic team and make a real impact, come aboard, and let's create some unforgettable experiences together at ROLLER!
 
 
 
 About the Role
 
 
 
 We are seeking a highly technical, hands-on
 
 Senior
 
 
 Data Engineer
 
 to architect and scale our data infrastructure from the ground up. As a core member of the data function within our Business Technology team, you will be responsible for building the pipelines and models that power smarter decision-making and operational efficiency across the entire organization.
 
 
 In this foundational role, you will build &amp; architect the
 
 modern data stack
 
 , ensuring our infrastructure is robust, automated, and governed. You collaborate as a technical partner with
 
 GTM
 
 
 ,Product, Finance, P&amp;C
 
 to build high-performance data models and pipelines that transform raw data into actionable cross-functional insights.
 
 
 Joining ROLLER at this pivotal growth stage, you will have the opportunity to make an outsized impact on our technical landscape, directly influencing how we process data to deliver world-class experiences for our customers globally.
 
 
 
 What You'll Do
 
 
 
 <ul>
 <li>
 
 Scalable Architecture:
 
 Design and implement robust Data Modeling and Architecture strategies that support high-volume data processing and maintain long-term scalability.
 </li>
 <li>
 
 Cloud Ecosystem:
 
 Develop and manage end-to-end data pipelines using Google Cloud Platform services, specifically leveraging Cloud Run, Cloud Function for compute, BigQuery for storage, and Cloud Composer (Airflow) for orchestration.
 </li>
 <li>
 
 Transformation Excellence:
 
 Build, maintain, and document complex data transformation layers using DBT (Data Build Tool) to ensure high data quality and reliability.
 </li>
 <li>
 
 Infrastructure as Code:
 
 Automate the provisioning of cloud resources using Terraform and streamline deployment workflows via GitHub Actions CI/CD pipelines.
 </li>
 <li>
 
 Cloud Data Warehousing:
 
 Demonstrate expert-level proficiency in managing and optimizing Cloud Data Warehouses, such as Snowflake &amp; BigQuery.
 </li>
 <li>
 
 Team Collaboration:
 
 Partner with cross-functional stakeholders to build and scale high-performing data infrastructure that supports engineering, analytics, and Data Program needs.
 </li>
 <li>
 
 Stack Management:
 
 Architect and maintain a modern data stack by implementing best-in-class tools including Snowflake, Bigquery, dbt, Fivetran, Looker, Tableau and Airflow.
 </li>
 <li>
 
 Pipeline Engineering:
 
 Develop scalable ETL/ELT workflows and robust data models to deliver real-time analytics and unified business reporting.
 </li>
 <li>
 
 Data Visualization: Create and maintain intuitive, high-performance Looker dashboards will be an added advantage.
 
 
 
 </li>
 </ul>
 
 About You
 
 
 
 You are a technical builder who views data as a competitive advantage. You thrive in fast-paced environments and have a proven track record of engineering scalable data foundations from the ground up. Equal parts
 
 architect and analytical problem-solver
 
 , you excel at balancing long-term technical vision with the daily hands-on execution of complex pipelines.
 
 
 You are energized by the full lifecycle of data&mdash;moving beyond just writing code to actively leading
 
 project discovery and analysis
 
 alongside cross-functional partners. You take pride in enabling GTM, Product, Finance &amp; P&amp;C teams through clear insights and high-performance systems. Most importantly, you are excited to act as a founding technical force for a high-growth SaaS company that is transforming the guest experience for attractions businesses globally.
 
 
 <ul>
 <li>
 
 5+ years of experience
 
 in Data &amp; Analytics or Data Engineering with a focus on Scalable cloud driven data pipeline build
 </li>
 <li>
 Proven experience in dimensional modeling (Star/Snowflake schema) and designing architectures that support both historical reporting and real-time needs.
 </li>
 <li>
 Expert-level proficiency in Snowflake or BigQuery, including performance tuning, cost optimization, and access control (RBAC).
 </li>
 <li>
 Hands-on experience with Google Cloud Platform services, specifically Cloud Function, Cloud Run for containerized workloads and Cloud Composer for orchestration.
 </li>
 <li>
 Through hands-on experience of dbt (Data Build Tool) to manage transformations, including writing custom macros, implementing tests, and generating documentation.
 </li>
 <li>
 Solid experience using Terraform to provision cloud resources, ensuring that infrastructure is version-controlled and reproducible.
 </li>
 <li>
 Proficiency in GitHub Actions to automate testing and deployment pipelines for data models and infrastructure.
 </li>
 <li>
 Ability to design high-performance dashboards that prioritize user experience and fast load times.
 </li>
 <li>
 Experience collaborating with Finance, GTM, and Product to define key metrics (like CAC, LTV, or Churn) and codifying them into the data layer.
 </li>
 <li>
 Familiarity with data ingestion tools like Fivetran , Airbyte, Workato, Mulesoft to sync data from various SaaS platforms into the warehouse.
 </li>
 <li>
 Operates as a full-stack Data Engineer with the technical authority to architect and build entire data lifecycles, from raw source ingestion to high-impact data visualization.
 </li>
 <li>
 
 Familiarity with business-critical systems
 
 like Salesforce, Chargbee, Gainsight, and product analytics tools.
 </li>
 <li>
 
 Strong communicator
 
 with a track record of working across technical and non-technical teams to drive alignment.
 </li>
 <li>
 You have a high appetite for Technology and AI and a natural curiosity for how it can transform your work. You're comfortable using AI tools to automate repetitive 'busy work,' freeing you up to focus on high-impact work.
 
 
 </li>
 </ul>
 We believe AI is a career-defining inflection point. ROLLER is a fast adopter of new technology like AI, and every team member is empowered to own their learning and use the latest tools to supercharge their impact. We're looking for candidates with the proficiency and curiosity to embrace AI and technology &mdash; not just as a technical skill, but as a core competency to help us achieve big goals
 
 
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Experience partnering with IT or Business Technology teams to drive cross-functional outcomes.
 </li>
 <li>
 Exposure to customer success and revenue workflows, such as onboarding journeys, renewal metrics, or support analytics.
 </li>
 <li>
 Familiarity with AI/ML pipelines and experimentation frameworks that support data-driven innovation.
 
 
 </li>
 </ul>
 Perks!
 
 
 <ul>
 <li>
 You'll get to work on a category-leading product that customers love in a fun, high-growth industry! Check our Capterra and G2 reviews.
 </li>
 <li>
 ROLLER Recharge days to celebrate and recharge once we've hit our goals
 </li>
 <li>
 Engage in our 'Vibe Tribe' - led by our team members; you can contribute to company-wide initiatives directly. Regular events and social activities, fundraising &amp; cause-related campaigns...you name it. We're willing to make it happen!
 </li>
 <li>
 Team Member Assistance Program to proactively support our team's health and wellbeing - access to coaching, education modules, weekly webinars, and more.
 </li>
 <li>
 16 weeks paid Parental Leave for primary carers and 4 weeks paid Parental Leave for secondary carers.
 </li>
 <li>
 Work with a driven, fun, and switched-on team that likes to raise the bar in all we do!
 </li>
 <li>
 Individual learning &amp; development budget plus genuine career growth opportunities as we continue to expand!
 
 
 </li>
 </ul>
 What You Can Expect
 
 
 <ul>
 <li>
 
 Initial call with our Talent Acquisition Manager
 
 You'll have an initial call with our Talent Acquisition Manager to chat through some of your experience to date, salary expectations and you can check off any initial questions you might have.
 </li>
 <li>
 
 Interview with the Hiring Manager
 
 You'll get to meet with the hiring manager to learn more about the role &amp; ROLLER whilst also talking through your experience in more detail.
 </li>
 <li>
 
 Loop Interviews
 
 This is where you will get to meet our wider ROLLER team to do a 'vibe check' on us to make sure our culture &amp; vibe meet what you are looking for!
 </li>
 <li>
 
 Offer
 
 If all lights are green and the fit feel right, we'll conduct reference checks and you'll receive an offer to join!
 </li>
 </ul>
</div>

Data Engineer

YO IT Consulting

<div>
 
 Job Title:
 
 Data Engineer
 
 
 
 Job Type:
 
 Contractor
 
 
 
 Location:
 
 Remote
 
 
 
 Job Summary
 
 
 
 We are seeking an expert Data Engineer to join our customer&rsquo;s team and play a pivotal role in developing next-generation AI agents. In this fully remote role, you will leverage your strong data engineering, coding, and AI/ML expertise to help train and optimize advanced AI systems. Collaborate with talented professionals in a dynamic environment where your technical skills and innovative mindset will directly impact the project's success.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Design, implement, and manage data pipelines to support complex AI agent training initiatives.
 </li>
 <li>
 Collaborate closely with AI/ML engineers to ensure efficient data flows and high-quality training datasets.
 </li>
 <li>
 Develop and maintain scalable ETL processes using Python, MySQL, and PostgreSQL.
 </li>
 <li>
 Utilize JAVA and JavaScript to integrate diverse data sources and enable seamless data exchange.
 </li>
 <li>
 Contribute to the optimization of AI models through effective data engineering practices.
 </li>
 <li>
 Document data processes comprehensively and communicate technical concepts clearly to both technical and non-technical stakeholders.
 </li>
 <li>
 Troubleshoot and resolve data issues, ensuring data integrity and reliability for AI applications.
 
 
 </li>
 </ul>
 
 Required Skills And Qualifications
 
 
 
 <ul>
 <li>
 Bachelor&rsquo;s degree in Computer Science, Engineering, or a related field.
 </li>
 <li>
 3+ years of hands-on experience as a Data Engineer, with proven expertise in AI/ML projects.
 </li>
 <li>
 Advanced proficiency in Python, MySQL, PostgreSQL, JAVA, and JavaScript.
 </li>
 <li>
 Strong understanding of AI concepts and experience in training AI agents.
 </li>
 <li>
 Exceptional written and verbal communication skills, with a focus on clarity and collaboration.
 </li>
 <li>
 Experience implementing robust data pipelines and scalable architecture for machine learning projects.
 </li>
 <li>
 Self-motivated, detail-oriented, and able to thrive in a fully remote team environment.
 
 
 </li>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Master&rsquo;s degree in a related field.
 </li>
 <li>
 Direct experience with AI agent frameworks and real-world deployment projects.
 </li>
 <li>
 Previous work in fast-paced startup or innovation-driven environments.
 </li>
 </ul>
</div>

Data Engineer - Remote

Figma

<div>
 Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma&rsquo;s platform helps teams bring ideas to life&mdash;whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us!
 
 
 We are looking for an experienced Data Engineer to partner with our Data Science and Data Infrastructure teams to own and scale our data pipelines. You&rsquo;ll also work closely with stakeholders across business teams including sales, marketing, and finance to ensure that the data they need arrives promptly and reliably. You&rsquo;ll play an integral role in building the metrics and self-serve reporting capabilities to unlock Figma&rsquo;s next phase of growth.
 
 
 This is a great role for an individual who is passionate about working with data and data systems, and who loves solving problems. You&rsquo;ll have a good sense for when it makes sense to build fast, scrappy solutions to unblock a key stakeholder vs. when to push back or bring in an outside service. The ideal candidate will be a great communicator who can help coordinate across multiple internal and external teams and takes pride in building end-to-end projects.
 
 
 This is a full time role that can be held from one of our US hubs or remotely in the United States.
 
 
 
 What you'll do at Figma
 
 
 :
 
 
 
 <ul>
 <li>
 Own, build, and maintain scalable data pipelines that connect various cloud data sources.
 </li>
 <li>
 Develop a deep understanding of Figma&rsquo;s core data models and optimize data pipelines for scale.
 </li>
 <li>
 Partner with the Data Science and Data Infrastructure teams to build new foundational data sets that are trusted, well understood, and enable self-service.
 </li>
 <li>
 Work with a wide range of cross-functional stakeholders to derive requirements and architect shared datasets; ability to document, simplify and explain complex problems to different types of audiences.
 </li>
 <li>
 Establish best practices for the development of specialized data sets for analytics and modeling.
 
 
 </li>
 </ul>
 We'd love to hear from you if you have:
 
 
 <ul>
 <li>
 4+ years in a relevant field.
 </li>
 <li>
 Fluency with both SQL and Python.
 </li>
 <li>
 Familiarity with Snowflake, dbt, Dagster, and ETL/reverse ETL tools.
 </li>
 <li>
 Excellent judgment and creative problem solving skills.
 </li>
 <li>
 A self-starting mindset along with strong communication and collaboration skills.
 
 
 </li>
 </ul>
 While not required, it&rsquo;s an added plus if you also have:
 
 
 <ul>
 <li>
 Knowledge in data modeling methodologies to design and build robust data architectures for insightful analytics.
 </li>
 <li>
 Experience with business systems such as Salesforce, Customer IO, Stripe, NetSuite is a big plus.
 
 
 </li>
 </ul>
 At Figma, one of our values is Grow as you go. We believe in hiring smart, curious people who are excited to learn and develop their skills. If you&rsquo;re excited about this role but your past experience doesn&rsquo;t align perfectly with the points outlined in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.
 
 
 
 Pay Transparency Disclosure
 
 
 
 If based in Figma&rsquo;s San Francisco or New York hub offices, this role has the annual base salary range stated below.
 
 
 Job level and actual compensation will be decided based on factors including, but not limited to, individual qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), market demands, and specific work location. The listed range is a guideline, and the range for this role may be modified. For roles that are available to be filled remotely, the pay range is localized according to employee work location by a factor of between 80% and 100% of range. Please discuss your specific work location with your recruiter for more information.
 
 
 Figma offers equity to employees, as well a competitive package of additional benefits, including health, dental &amp; vision, retirement with company contribution, parental leave &amp; reproductive or family planning support, mental health &amp; wellness benefits, generous PTO, company recharge days, a learning &amp; development stipend, a work from home stipend, and cell phone reimbursement. Figma also offers sales incentive pay for most sales roles and an annual bonus plan for eligible non-sales roles. Figma&rsquo;s compensation and benefits are subject to change and may be modified in the future.
 
 
 Annual Base Salary Range:
 
 
 $140,000&mdash;$348,000 USD
 
 
 At Figma we celebrate and support our differences. We know employing a team rich in diverse thoughts, experiences, and opinions allows our employees, our product and our community to flourish. Figma is an equal opportunity workplace - we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity/expression, veteran status
 
 ,
 
 or any other characteristic protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.
 
 
 We will work to ensure individuals with disabilities are provided reasonable accommodation to apply for a role, participate in the interview process, perform essential job functions, and receive other benefits and privileges of employment. If you require accommodation, please reach out to accommodations-ext@figma.com. These modifications enable an individual with a disability to have an equal opportunity not only to get a job, but successfully perform their job tasks to the same extent as people without disabilities.
 
 
 Examples of accommodations include but are not limited to:
 
 
 <ul>
 <li>
 Holding interviews in an accessible location
 </li>
 <li>
 Enabling closed captioning on video conferencing
 </li>
 <li>
 Ensuring all written communication be compatible with screen readers
 </li>
 <li>
 Changing the mode or format of interviews
 
 
 </li>
 </ul>
 To ensure the integrity of our hiring process and facilitate a more personal connection, we require all candidates keep their cameras on during video interviews. Additionally, if hired you will be required to attend in person onboarding.
 
 
 By applying for this job, the candidate acknowledges and agrees that any personal data contained in their application or supporting materials will be processed in accordance with Figma's Candidate Privacy Notice.
</div>

Twitch

<div>
 
 About Us
 
 
 
 Twitch is the world&rsquo;s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day.
 
 
 We&rsquo;re about community, inside and out. You&rsquo;ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We&rsquo;re on a quest to empower live communities, so if this sounds good to you, see what we&rsquo;re up to on LinkedIn and X, and discover the projects we&rsquo;re solving on our Blog. Be sure to explore our Interviewing Guide to learn how to ace our interview process.
 
 
 
 About The Role
 
 
 
 As a data engineer in the Data Platform organization, you will be transforming Twitch&rsquo;s largest data sets into offerings that are usable by the entire company. You&rsquo;ll be working with other senior team members, as well as other data engineers, scientists, and stakeholders from all across the business. You will help define how our core business metrics are managed, as well as how other parts of the company define their individual metrics.
 
 
 
 You Will:
 
 
 
 
 <ul>
 <li>
 Work closely with data scientists and engineers from across the company to define and create robust data architectures and pipelines
 </li>
 <li>
 Develop and manage scalable data pipelines to extract, transform, and load data from various sources
 </li>
 <li>
 Partner with a range of stakeholders to translate the company&rsquo;s needs into data offerings
 </li>
 <li>
 Automate data processing and reporting workflows to improve efficiency and data integrity
 </li>
 <li>
 Implement data quality checks and monitor processes to maintain high data accuracy
 </li>
 <li>
 Simplify and enhance the accessibility, clarity, and usability of large and complex datasets through the development of data cubes and data sharing solutions
 
 
 
 </li>
 </ul>
 
 You Have:
 
 
 
 
 <ul>
 <li>
 3+ year of experience working in a data engineering, data science, or software engineering capacity
 </li>
 <li>
 Expertise in writing and maintaining robust data pipelines in SQL and Python
 </li>
 <li>
 A track record of turning data requirements from stakeholders into actionable plans
 </li>
 <li>
 Experience with cloud-native solutions
 </li>
 <li>
 A history of implementing and upholding best practices in data pipelines, ensuring accuracy, consistency, and reliability
 
 
 
 </li>
 </ul>
 
 Bonus Points
 
 
 
 
 <ul>
 <li>
 Bachelor's degree, or Master's degree in computer science, statistics, information systems, or a related, technical field
 </li>
 <li>
 Experience with a scripting language (e.g., Python, Java, or R)
 </li>
 <li>
 Familiarity and interest in Twitch!
 
 
 
 </li>
 </ul>
 
 Perks
 
 
 
 
 <ul>
 <li>
 Medical, Dental, Vision &amp; Disability Insurance
 </li>
 <li>
 401(k)
 </li>
 <li>
 Maternity &amp; Parental Leave
 </li>
 <li>
 Flexible PTO
 </li>
 <li>
 Amazon Employee Discount
 
 
 
 </li>
 </ul>
 
 Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
 
 
 
 Job ID: TW9042
 
 
 The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
 
 
 US, CA, San Francisco
 
 
 $152,000&mdash;$205,600 USD
 
 
 
 Twitch is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
 
 
 
 
 Twitch values your privacy. Please consult our Candidate Privacy Notice, for information about how we collect, use, and disclose personal information of our candidates.
 
</div>

Whatnot

<div>
 
 
 🚀 Join the Future of Commerce with Whatnot!
 
 
 
 
 Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it's trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We're building live commerce at a scale that's never been done in the West, and there's no playbook to copy. The people here are shaping how an entirely new industry develops.
 
 
 As a remote co-located team, we're inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact.
 
 
 We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce.
 
 
 
 💻 Role
 
 
 
 At Whatnot data engineers build foundational data systems that power product development, experimentation, machine learning, and operational decision-making across the company. As an Data Engineer on the Notifications Platform, you will play a critical role in owning and evolving one of the highest-volume and highest-impact data domains at Whatnot.
 
 
 Notifications generate hundreds of millions of events per day, and the underlying data systems support everything from ML iteration and experimentation to adhoc engineering debugging. In this role, you will define the technical direction for the Notifications data mart, harden it to production-grade reliability, and set new patterns for domain-owned data engineering.
 
 
 Working in a highly cross-functional role, you will collaborate closely with Product Engineers, Data Scientists, ML Engineers, and the Analytics Platform team. You&rsquo;ll make key architectural decisions around data modeling, reliability, latency, and cost &mdash; and then make them real.
 
 
 
 On Any Given Day, You Will
 
 
 
 <ul>
 <li>
 Own data architecture end-to-end. Define how we capture, model, and serve critical business data&mdash;then implement it in production. You&rsquo;ll make architectural decisions around storage formats, compute patterns, and SLAs that balance cost, scalability, and consistency.
 </li>
 <li>
 Build mission-critical pipelines. Develop and operate batch data workflows that process high-volume events related to notifications with tight guarantees for latency, completeness, and accuracy.
 </li>
 <li>
 Design and implement canonical models. Create domain-oriented data models that serve as the source of truth for analytics, ML, and production applications. Establish and enforce modeling standards, ownership boundaries, and data contracts across teams.
 </li>
 <li>
 Enforce data quality at scale. Build tests, lineage, monitoring, and reconciliation systems that make every dataset observable and every anomaly actionable.
 </li>
 <li>
 Automate operational workflows. Partner with business systems and platform teams to eliminate manual data handoffs and reconcile data across services, warehouses, and external systems.
 </li>
 <li>
 Enable insights and experimentation. Support analytics, ML, and product engineering teams by exposing high-quality, self-healing, maintainable data assets.
 
 
 </li>
 </ul>
 
 We offer flexibility to work from home or from one of our global office hubs, and we value in-person time for planning, problem-solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs.
 
 
 
 
 👋 You
 
 
 
 Curious about who thrives at Whatnot? We&rsquo;ve found that embodying a low ego, growth mindset, and high-impact drive goes a long way here.
 
 
 As our next Data Engineer, you bring deep experience designing reliable, scalable data systems and are excited to take true ownership of a complex product domain.
 
 
 You should have 5+ years of experience in the data or software engineering domain, plus:
 
 
 <ul>
 <li>
 Strong experience building and maintaining production-grade data pipelines with clear SLAs, monitoring, and alerting
 </li>
 <li>
 Deep expertise in SQL, including complex model graphs, dependency management, and performance optimization
 </li>
 <li>
 Are comfortable writing production-grade code in Python or SQL languages, and integrating with CI/CD and infrastructure-as-code workflows.
 </li>
 <li>
 Have deep hands-on expertise with modern data tooling across ingestion (e.g., Kafka, Debezium), transformation (dbt, Spark, Flink), orchestration (Dagster, Airflow), and observability (Monte Carlo, Great Expectations).
 </li>
 <li>
 Have operated cloud data warehouses such as Snowflake, BigQuery, or Redshift, including schema design, cost optimization, and workload tuning.
 </li>
 <li>
 Proven track record working with large-scale datasets (hundreds of millions of rows per day)
 </li>
 <li>
 Experience designing data models that balance analytics, ML, and operational debugging use cases
 </li>
 <li>
 Strong systems thinking &mdash; you consider correctness, latency, cost, and maintainability together
 </li>
 <li>
 Self-starter ethic, thriving under a high level of autonomy
 </li>
 <li>
 Exceptional interpersonal and communication skills in cross-functional environments
 
 
 </li>
 </ul>
 
 💰Compensation For Full-Time (Salary)
 
 
 
 
 US based applicants:
 
 $195,000/year to $230,000/year + benefits + equity.
 
 
 The salary range may be inclusive of several levels that would be applicable to the position. Final salary will be based on a number of factors including, level, relevant prior experience, skills, and expertise. This range is only inclusive of base salary, not benefits (more details below) or equity.
 
 
 
 🎁 Benefits
 
 
 
 <ul>
 <li>
 Generous Holiday and Time off Policy
 </li>
 <li>
 Health Insurance options including Medical, Dental, Vision
 </li>
 <li>
 Work From Home Support
 </li>
 <ul>
 <li>
 Home office setup allowance
 </li>
 <li>
 Monthly allowance for cell phone and internet
 </li>
 </ul>
 <li>
 Care benefits
 </li>
 <ul>
 <li>
 Monthly allowance for wellness
 </li>
 <li>
 Annual allowance towards Childcare
 </li>
 <li>
 Lifetime benefit for family planning, such as adoption or fertility expenses
 </li>
 </ul>
 <li>
 Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
 </li>
 <li>
 Monthly allowance to dogfood the app
 </li>
 <ul>
 <li>
 All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
 </li>
 </ul>
 <li>
 Parental Leave
 </li>
 <ul>
 <li>
 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.
 </li>
 </ul>
 </ul>
 
 
 💛 EOE
 
 
 
 
 Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.
 
 
 Compensation Range: $180K - $260K
 
 
</div>

Data Engineer, Notifications

You.com

<div>
 
 About Us
 
 
 
 At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge layer that agents, applications, and enterprises rely on to retrieve real-time, accurate, and citation-backed information.
 
 
 Our platform combines proprietary vertical indexes with LLM-optimized retrieval systems to power AI agents, applications, and enterprise workflows. We are solving hard problems across search, large language models, and large-scale infrastructure to make AI systems more reliable, transparent, and useful.
 
 
 Our team includes engineers, researchers, product builders, and operators who care about solving meaningful problems and delivering real-world impact. Whether you are improving core infrastructure, shaping product experiences, or helping bring new AI capabilities to market, your work will help define how modern AI finds and uses knowledge.
 
 
 
 About The Role
 
 
 
 We are looking for a hands-on Data Engineer to help build and scale our modern data platform. In this role, you will work closely with engineering, product, and analytics teams to develop reliable, high-performance data pipelines and systems.
 
 
 You'll contribute to both batch and real-time data processing using technologies like Databricks, AWS, and Kafka, while helping ensure data quality, accessibility, and usability across the organization. You'll play a key role in enabling data activation, ensuring that high-quality data flows not only into the warehouse but also outward to business tools like Salesforce, HubSpot, and Braze. Additionally, you will help power next-generation
 
 AI-driven applications
 
 , including agent-based systems and retrieval-augmented generation (RAG), by building robust data foundations and pipelines. This is a great opportunity for someone who enjoys solving data challenges end-to-end from ingestion to insights.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Build and maintain scalable data pipelines (batch and streaming) using tools like Databricks, Spark, Kafka, and AWS services
 </li>
 <li>
 Design, develop, and optimize ETL/ELT workflows using DBT, PySpark, SQL, and tools like Fivetran
 </li>
 <li>
 Partner closely with marketing and growth teams to enable data use cases such as segmentation, campaign targeting, and lifecycle analytics
 </li>
 <li>
 Develop and maintain reverse ETL pipelines to sync data from the warehouse to tools like Salesforce, HubSpot, Braze, and other downstream systems
 </li>
 <li>
 Create and manage curated datasets to support analytics, reporting, and go-to-market initiatives
 </li>
 <li>
 Build and maintain dashboards and reporting layers to support marketing and business performance tracking
 </li>
 <li>
 Support AI/ML and agent-based applications by preparing and serving high-quality datasets for RAG pipelines and MCP (Model Context Protocol) integrations
 </li>
 <li>
 Monitor pipeline performance, troubleshoot issues, and ensure high data reliability and quality
 </li>
 <li>
 Implement data quality checks, validations, and alerting mechanisms across both ingestion and activation layers
 </li>
 <li>
 Collaborate with cross-functional teams to define data contracts and ensure consistency across systems
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 
 6+ years
 
 of experience in data engineering or a related field
 </li>
 <li>
 Strong hands-on experience with Databricks, AWS (S3, Glue, Athena, EMR, etc.), and Kafka
 </li>
 <li>
 Proficiency in Python (PySpark) and SQL for large-scale data processing
 </li>
 <li>
 Experience building and maintaining ETL/ELT pipelines (DBT/Airflow or similar experience preferred)
 </li>
 <li>
 Experience with data ingestion tools such as Fivetran (or similar)
 </li>
 <li>
 Familiarity with reverse ETL / data activation workflows and syncing data to tools like Salesforce, HubSpot, Braze
 </li>
 <li>
 Exposure to or experience with AI/ML data pipelines, including RAG architectures, vector databases, or embeddings workflows
 </li>
 <li>
 Familiarity with agent-based systems, MCP integrations, or LLM-powered applications is a strong plus
 </li>
 <li>
 Experience working with marketing, Product or growth teams on data use cases (segmentation, attribution, campaign analytics, etc.)
 </li>
 <li>
 Understanding of data modeling and working with large-scale datasets (batch and streaming)
 </li>
 <li>
 Experience creating dashboards and supporting reporting workflows (BI tools) for both internal and external audiences
 </li>
 <li>
 Strong problem-solving skills and ability to debug production data issues
 </li>
 <li>
 Strong communication skills and ability to work collaboratively across teams
 
 
 </li>
 </ul>
 Our salary bands are structured based on a combination of geographic tiers and internal leveling. Compensation is determined by multiple factors assessed during the interview process, with the final offer reflecting these considerations.
 
 
 Salary Band
 
 
 $185,000&mdash;$225,000 USD
 
 
 
 Company Perks:
 
 
 
 <ul>
 <li>
 Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions
 </li>
 <li>
 Flexible PTO with U.S. holidays observed and a week shutdown in December to rest and recharge*
 </li>
 <li>
 A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*
 </li>
 <li>
 12 weeks of paid parental leave in the US*
 </li>
 <li>
 401k program, 3% match - vested immediately!*
 </li>
 <li>
 $500 work-from-home stipend to be used up to a year of your start date*
 </li>
 <li>
 $600 technology stipend to support a portion of our hybrid/remote team's cell phone and internet expenses*
 </li>
 <li>
 $1,200 per year Health &amp; Wellness Allowance to support your personal goals*
 </li>
 <li>
 The chance to collaborate with a team at the forefront of AI research
 </li>
 <li>
 Certain perks and benefits are limited to full-time employees only
 
 
 </li>
 </ul>
 
 You.com participates in E-Verify. We will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee's Form I-9 to confirm work authorization. (English/Spanish: E-Verify Participation/Right to Work)
 
 
 We are also an inclusive, equitable, and accessible workplace. Please let us know if you require accommodation for any portion of the recruitment and hiring process.
 
 
 
 
 
 Beware of recruiting scams: You.com will only contact you through official @You.com email addresses and will never ask for payment or sensitive personal information during the hiring process.
 
 
</div>

GoodRx

<div>
 GoodRx is America&rsquo;s healthcare marketplace. Each month, millions of people visit goodrx.com to find reliable health information and discounts for their healthcare &mdash; and we&rsquo;ve helped people save $60 billion since 2011. We provide prescription discounts that are accepted at more than 70,000 pharmacies in the U.S., as well as telehealth services including doctor visits and lab tests. Our services have been positively reviewed by Good Morning America, The New York Times, NBC News, AARP, and many others.
 
 
 Our goal is to help Americans find convenient and affordable healthcare. We offer solutions for consumers, employers, health plans, and anyone else who shares our desire to provide affordable prescriptions to all Americans.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Collaborate with product managers, data scientists, data analysts and engineers to define requirements and data specifications.
 </li>
 <li>
 Develop, deploy and maintain data processing pipelines using cloud technology such as AWS, Kubernetes, Airflow, Redshift, EMR.
 </li>
 <li>
 Develop, deploy and maintain serverless data pipelines using Event Bridge, Kinesis, AWS Lambda, S3 and Glue.
 </li>
 <li>
 Define and manage overall schedule and availability for a variety of data sets.
 </li>
 <li>
 Work closely with other engineers to enhance infrastructure, improve reliability and efficiency.
 </li>
 <li>
 Make smart engineering and product decisions based on data analysis and collaboration.
 </li>
 <li>
 Act as in-house data expert and make recommendations regarding standards for code quality and timeliness.
 </li>
 <li>
 Architect cloud-based data infrastructure solutions to meet stakeholder needs.
 
 
 </li>
 </ul>
 
 Skills &amp; Qualifications
 
 
 
 <ul>
 <li>
 Bachelor&rsquo;s degree in analytics, statistics, engineering, math, economics, science or related discipline.
 </li>
 <li>
 Experience in any one of the Cloud data spaces such as AWS, Azure or GCP.
 </li>
 <li>
 Experience in engineering data pipelines using big data technologies (Python, pySpark, Real-time data platform like Active MQ or Kafka or Kinesis) on large scale data sets.
 </li>
 <li>
 Experience writing complex SQL and ETL development with experience processing extremely large data sets.
 </li>
 <li>
 Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions.
 </li>
 <li>
 Familiarity with AWS Services (S3, Event Bridge, Glue, EMR, Redshift, Lambda).
 </li>
 <li>
 Ability to quickly learn complex domains and new technologies.
 </li>
 <li>
 Innately curious and organized with the drive to analyze data to identify deliverables, anomalies and gaps and propose solutions to address these findings.
 </li>
 <li>
 Experience using Jira, GitHub, Docker, CodeFresh, Terraform.
 </li>
 <li>
 Experience contributing to full lifecycle deployments with a focus on testing and quality.
 </li>
 <li>
 Experience with data quality processes, data quality checks, validations, data quality metrics definition and measurement.
 
 
 </li>
 </ul>
 We&rsquo;re committed to growing and empowering a more inclusive community within our company and industry. That&rsquo;s why we hire and cultivate diverse teams of the best and brightest from all backgrounds, experiences, and perspectives. We believe that true innovation happens when everyone has a seat at the table and the tools, resources, and opportunities to excel.
 
 
 With that said, research shows that women and other underrepresented groups apply only if they meet 100% of the criteria. GoodRx is committed to leveling the playing field, and we encourage women, people of color, those in the LGBTQ+ communities, and Veterans to apply for positions even if they don&rsquo;t necessarily check every box outlined in the job description. Please still get in touch - we&rsquo;d love to connect and see if you could be good for the role!
 
 
 GoodRx is America's healthcare marketplace. The company offers the most comprehensive and accurate resource for affordable prescription medications in the U.S., gathering pricing information from thousands of pharmacies coast to coast, as well as a telehealth marketplace for online doctor visits and lab tests. Since 2011, Americans with and without health insurance have saved $60 billion using GoodRx and million consumers visit goodrx.com each month to find discounts and information related to their healthcare. GoodRx is the #1 most downloaded medical app on the iOS and Android app stores. For more information, visit www.goodrx.com.
 
 
 We prioritize candidate safety. Please be aware that all official communication will only be sent from
 
 @
 
 
 goodrx.com
 
 or
 
 goodrx@myworkday.com
 
 addresses.
</div>

Data Engineer Intern

Explore 264+ Big data engineer in San Francisco this April. Find roles across top companies and apply now to boost your career.

264 big data engineer jobs In San Francisco

Data Engineer

Data Engineer - Remote

Data Engineer

Data Engineer

Data Engineer, Notifications

Data Engineer

Data Engineer Intern