software engineer

data engineer

data analyst

data scientist

data engineer, finance Jobs in San Francisco

data engineer, finance

senior data engineer

Forge Global

<div><div>At Forge, we know our team is our greatest asset. As technology innovators in the private market, our vision is to deliver a richer future for everyone. We live that vision through our values of being bold, accountable, and humble. We experience the value that our vision brings to the world every day, helping the teams behind the greatest innovations of our generation, from space travel to artificial intelligence, and more.

With liquidity solutions, exclusive data and insights, a custody offering, and a vibrant marketplace, Forge&rsquo;s goal is to build the best-in-class technology infrastructure to power a global private market that is transparent, accessible, and seamless for companies, their employees, and investors. Through Forge, employees can sell their private shares, employers can reward shareholders with pre-IPO liquidity and individual and institutional investors can participate in private unicorn growth.

Forge's differentiated global marketplace addresses rising demand among individual and institutional investors for exposure to private company stocks and is building a growing network effect.

Our ability to offer these powerful financial solutions has generated incredible interest from investors, demand from customers, and a need to grow our team to meet the needs of more companies, teams, and innovators in this way.</div><div>

The Role:

As a Senior Data Engineer focused on data engineering, you will play a key role in delivering a high-quality data platform responsible for maintaining and delivering Forge data to internal and external clients. You will implement new features, maintain existing functionality, and perform code reviews, unit testing, and production deployments using Agile methodologies. You will collaborate closely with Product, Design, and Engineering teams to ensure requirements are well defined and delivered in a timely manner.

Location: This role requires 2-3 days a week in office in San Francisco, CA.

Responsibilities
<ul>
<li>Collaborate with cross-functional teams to understand requirements and deliver high-quality software solutions</li>
<li>Implement software solutions in line with provided estimates and requirements</li>
<li>Stay current with the latest trends and technologies in data engineering and advocate for appropriate adoption</li>
</ul>
Qualifications
<ul>
<li>3&ndash;5+ years of development experience using object-oriented languages such as TypeScript, C#, or Java</li>
<li>Experience with scripting languages such as Python for data-related tasks</li>
<li>Familiarity with modern data architectures (e.g., Medallion Architecture, data lakes)</li>
<li>Experience in Private Markets or Financial Services, specifically working with financial market data</li>
<li>Proven experience setting up CI/CD pipelines, managing data orchestration, application deployments, and ensuring code quality</li>
<li>Strong project management skills, with the ability to take features from planning through deployment, including hands-on backend and frontend development</li>
<li>Proficiency in databases such as PostgreSQL and strong SQL skills</li>
<li>Experience with cloud platforms such as AWS (or equivalent like Azure or GCP)</li>
<li>Extensive experience with version control systems such as Git and platforms like GitHub</li>
<li>Familiarity with Agile project management tools such as JIRA or similar tools</li>
</ul>
Preferred Qualifications
<ul>
<li>Experience migrating systems from legacy architectures to modern tech stacks</li>
<li>Knowledge of real-time data processing and event-driven architectures using technologies such as WebSockets or Kafka</li>
<li>Experience leading offshore and nearshore engineering teams</li>
<li>Experience using large language models and agentic workflows</li>
</ul>
For residents of San Francisco, CA the annual salary range for this role is $110,000-$140,000 annual bonus. Final offers may vary from the amount listed based on geography, candidate experience and expertise, bonus, and other factors</div><div>

Upon offer, we conduct background checks that include employment and education verification, state, and county criminal history searches.

Forge is proud to be an equal opportunity employer committed to supporting a diverse and inclusive workplace. Our employment decisions are made without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), gender, gender identity, gender expression, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, marital status, sexual orientation, veteran status, or any other characteristic protected by federal, state, or local laws.</div></div>

Senior Data Engineer

Apple

Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery in hyper-scale distributed computing environments. You will work within cybersecurity software engineering team that drives Apache Spark&rsquo;s state-of-the art features and pushes the boundaries of what is possible in our industry. 
 
Description 
 
Apple is seeking an extraordinary individual to work on a team supporting and developing services which underpin mission critical information security capabilities. Spark expertise is a prerequisite. While previous experience in information security is not required, a sincere drive for security and privacy is required. This role will work closely with our engineering teams and with partner teams to ensure the successful design, development, and delivery of product objectives. The successful candidate will have a passion for technical excellence and team collaboration with a heavy focus on using cutting-edge technologies to build data intensive systems, designing and optimizing data models, and collaborating with cross-functional teams to solve complex data challenges. 
 
Preferred Qualifications 
 
5+ years experience in data engineering and demonstrated expertise with data modeling 
 
5+ years of experience with JVM languages: Java or Scala 
 
5+ years experience with big data platforms 
 
Familiarity with ML/AI workflows and feature engineering to support analytics, reporting, and machine learning use cases 
 
Knowledge engineering expertise including semantic models and knowledge graphs 
 
Experience working with cloud compute environments like OpenStack, AWS, and Azure 
 
Experience mentoring engineers, conducting code reviews, and contributing to technical best practices and documentation 
 
Knowledge of data quality frameworks and validation techniques 
 
Knowledge of data governance and compliance frameworks 
 
Minimum Qualifications 
 
4 years+ demonstrated expertise in designing and implementing relational and medallion data architectures 
 
4 Years+ demonstrated expertise in the design and implementation of production data pipelines at scale 
 
4 Years+ demonstrated proficiency with JVM languages (Scala or Java preferred), Spark, Golang, or Swift 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $147,400 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Airwallex

<div><div><div>About Airwallex</div>
Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 200,000 businesses worldwide &ndash; including Brex, Rippling, Navan, Qantas, SHEIN and many more &ndash; with fully integrated solutions to manage everything from business accounts, payments, spend management and treasury, to embedded finance at a global scale.
Proudly founded in Melbourne, we have a team of over 2,000 of the brightest and most innovative people in tech across 26 offices around the globe. Valued at US$8 billion and backed by world-leading investors including T. Rowe Price, Visa, Mastercard, Robinhood Ventures, Sequoia, Salesforce Ventures, DST Global, and Lone Pine Capital, Airwallex is leading the charge in building the global payments and financial platform of the future. If you&rsquo;re ready to do the most ambitious work of your career, join us.
Attributes We Value
We hire successful builders with founder-like energy who want real impact, accelerated learning, and true ownership. You bring strong role-related expertise and sharp thinking, and you&rsquo;re motivated by our mission and operating principles. You move fast with good judgment, dig deep with curiosity, and make decisions from first principles, balancing speed and rigor.
You're humble and collaborative; turn zero‑to‑one ideas into real products, and you &ldquo;get stuff done&rdquo; end-to-end. You use AI to work smarter and solve problems faster. Here, you&rsquo;ll tackle complex, high‑visibility problems with exceptional teammates and grow your career as we build the future of global banking. If that sounds like you, let&rsquo;s build what&rsquo;s next.
Senior Data Engineer
Hiring Location: San Francisco
What you&rsquo;ll do
Part 1. Data Modeling<ul><li><div>
Design and implement robust and scalable data models that support business intelligence, machine learning, and operational needs.</div></li><li><div>
Possess a deep understanding of data schemas and be able to select appropriate schema designs (e.g., star schema, snowflake, normalised vs denormalised) based on use cases.</div></li><li><div>
Collaborate closely with business teams to translate their data needs into clean, structured, and well-documented models.</div></li><li><div>
Understand and promote the concept of SSOT (Single Source of Truth) throughout the data layers and pipelines.</div></li><li><div>
Maintain data consistency, traceability, and quality across multiple data sources and domains.</div></li></ul>
Part 2. ETL and Data Pipeline Management<ul><li><div>
Experience building and maintaining both batch and streaming ETL pipelines, with a strong understanding of end-to-end data workflow &mdash; from data ingestion to transformation and delivery.</div></li><li><div>
Able to work closely with Data Platform Engineers (DPEs) and Product Managers (PMs) to quickly identify root causes of data issues and provide efficient, scalable solutions.</div></li><li><div>
Bonus if you&rsquo;ve worked with data across distributed or multi-datacenter systems, including solving challenges related to data migration, duplication, and consistency.</div></li></ul>
Part 3. Data Governance<ul><li><div>
Participate in and contribute to data governance strategies, policies, and standards.</div></li><li><div>
Be familiar with any of the six key pillars of traditional data governance (e.g., data quality, data stewardship, metadata management, master data management, data privacy/security, data lifecycle).</div></li></ul>
Part 4. Data + AI<ul><li><div>
We hope you have a basic understanding of AI and enjoy thinking about how data engineering and AI can work together in practical and creative ways.</div></li></ul>
These four areas are the main focuses of the DE team. Ideally, you should be strong in at least one of them &mdash; especially data modeling or data ETL. If you also have experience or skills in the other areas, that would be a big plus.
Who you are
We're looking for people who meet the minimum qualifications for this role. The preferred qualifications are great to have, but are not mandatory.
Minimum qualifications:<ul><li><div>
Bachelor&rsquo;s degree or higher in Computer Science, Information Systems, Finance, Maths or a related field.</div></li><li><div>
Minimum 5 years of proven of experience designing and implementing ETL pipelines using tools such as Informatica, Talend, Apache NiFi, or similar data integration platforms.</div></li><li><div>
Proficiency in SQL, database management systems (e.g., MySQL, PostgreSQL, Oracle), and data warehousing solutions.</div></li><li><div>
Familiarity with Google Cloud Platform (GCP), specifically BigQuery and Airflow.</div></li><li><div>
Excellent problem-solving skills, with a keen attention to detail and a commitment to producing high-quality work.</div></li><li><div>
Strong communication and collaboration skills, with the ability to work effectively in a fast-paced, team-oriented environment.</div></li><li><div>
Outstanding verbal communication skills, with the ability to effectively collaborate with globally distributed teams.</div></li></ul>
Preferred qualifications:<ul><li><div>
Experience with financial industries, payment systems, or fintech platforms.</div></li><li><div>
Knowledge of data governance practices and regulatory requirements in the financial industry.</div></li><li><div>
Experience with scripting languages (e.g., Python, R) for data analysis and automation.</div></li><li><div>
Certification in data management or related technologies</div></li></ul>
At Airwallex, you can make an impact in a rapidly growing, global fintech. We want you to share in our success, which is why you&rsquo;ll be offered a competitive salary plus valuable equity within Airwallex. We also like to ensure we create the best environment for our people by providing collaborative open office space with a fully stocked kitchen. We organise regular team-building events and we give our people the freedom to be creative.
Applicant Safety Policy: Fraud and Third-Party Recruiters
To protect you from recruitment scams, please be aware that Airwallex will not ask for bank details, sensitive ID numbers (i.e. passport), or any form of payment during the application or interview process. All official communication will come from an @airwallex.com email address. Please apply only through careers.airwallex.com or our official LinkedIn page.
Airwallex does not accept unsolicited resumes from search firms/recruiters. Airwallex will not pay any fees to search firms/recruiters if a candidate is submitted by a search firm/recruiter unless an agreement has been entered into with respect to specific open position(s). Search firms/recruiters submitting resumes to Airwallex on an unsolicited basis shall be deemed to accept this condition, regardless of any other provision to the contrary.
Equal opportunity
Airwallex is proud to be an equal opportunity employer. We value diversity and anyone seeking employment at Airwallex is considered based on merit, qualifications, competence and talent. We don&rsquo;t regard color, religion, race, national origin, sexual orientation, ancestry, citizenship, sex, marital or family status, disability, gender, or any other legally protected status when making our hiring decisions. If you have a disability or special need that requires accommodation, please let us know.</div></div>

Senior Data Engineer - Knowledge Platform

Do you believe Machine Learning and AI can change the world? We truly believe it can! We are the ML Data Team of the Intelligent System Experience (ISE) group at Apple. We are responsible for building high quality datasets at scale. Every year, our team produces datasets used in the training of ML and AI-centric features for many Apple products, including iPhone, iPad, Mac, Apple Watch and even AirPods. Our work is used in very visible and critical features, from the wallpaper on your iPhone Lock Screen, to your personalized stickers on iMessage, to Apple Intelligence features such as on-device Genmoji and other visual generative models, to the models that highlight the faces and memories of your loved ones in your Photos app. 
 
We&rsquo;re looking for an exceptional software &amp; data engineer who is passionate about Apple products and values, who has a passion for data operations at scale, is comfortable in a fast paced environment and who is committed to the hard work necessary to continuously improve our ML data pipelines. 
 
We invite you to join us at this exciting time. Grow fast and positively impact multiple critical features from your first day at Apple! 
 
Description 
 
Our team focuses on acquiring, synthesizing, annotating, and ensuring the quality of ML data, driving numerous features in collaboration with R&amp;D teams in Apple&rsquo;s SWE organization.&quot;,&quot;responsibilities&quot;:&quot;Operate and maintain data pipelines to effectively process up to billion-scale multimodal data 
 
Find creative ways to automate workflows or build self service tools, implement a variety of data tools for visualization, compliance and ML enrichment 
 
Help bring frontier generative model and agentic capabilities in our pipelines to further optimize our data operations ; and production-ize synthetic data workflows including orchestration and lineage 
 
Identify opportunities for improvement of internal infrastructure offerings, and influence roadmaps of partner teams to build or improve key components we rely on 
 
Preferred Qualifications 
 
Proven experience designing, automating and scaling large data pipelines (petabyte scale desired) using state of the art processing technologies (eg familiarity with Iceberg, BigQuery, Airflow, Spark, etc.) 
 
Expertise in Python, Go or another modern programming language; you are expected to produce high quality, efficient code and participate in code reviews 
 
Strong ability to design and lead a technical roadmap, work with cross functional teams and a diversity of profiles, proven capacity to influence and build alignment 
 
Demonstrated prior experience in delivering large scale multimodal datasets for foundation models 
 
Self-starter, able to handle ambiguity, comfortable in a fast-pace environment, identify risks, mitigate, and autonomously find the right people and tools to get the job done 
 
Proven track record of mentoring and growing engineers, lift the level of software engineering excellence in a ML data ops team typically focused on short term deliveries 
 
Minimum Qualifications 
 
7+ years of industry experience as a data engineer serving various ML applications (vision domain preferred) 
 
Bachelor's degree in Computer Science or related field 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Senior ML Data Engineer, ISE

LendingClub

<div><h3 class="jobSectionHeader">Current Employees of LendingClub: Please apply via your internal Workday Account</h3>
LendingClub Corporation (NYSE: LC) is the parent company of LendingClub Bank, National Association, Member FDIC. We are the leading digital marketplace bank in the U.S., having helped our nearly 5 million members secure over $90 billion in loans to refinance high-cost debt and achieve their financial goals. Members today have mobile-first access to a growing range of products and services designed to work seamlessly together to deliver value in new ways. Everyone deserves a better financial future, and our team is committed to making that a reality. Join the Club!<h2 class="jobSectionHeader">
About the Role</h2>
Our mission at LendingClub is to empower those who strive to achieve better financial health. The Data and Analytics team plays a crucial role in achieving our mission. 
 
We are seeking a Principal Data Engineer to lead the design and evolution of data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, data cataloging, and machine learning workflows. This role has a strong emphasis on enabling and scaling machine learning and analytics use cases, including feature engineering, model training, and inference data pipelines. 
 
In this role, you will apply deep technical expertise, architectural thinking, and hands-on development to solve complex big data and ML platform challenges. You will partner closely with Data Science, Product, and Platform teams to build reliable, scalable, and cost-efficient data foundations that support both analytics and production machine learning systems.<h2 class="jobSectionHeader">
What You'll Do</h2><ul><li>
Design, build, and own large-scale data and ML data pipelines that integrate directly with LendingClub&rsquo;s products and external vendors</li><li>
Design and operate data platforms where autonomous coding agents help maintain pipelines, schemas, and tests, while you own architecture and guardrails.</li><li>
Lead the architecture and implementation of MLOps including feature stores, training datasets, batch and real-time inference pipelines</li><li>
Work with modern data technologies such as Hadoop, Spark, DBT, Dagster/Airflow, Atlan, and modern data platforms like Databricks and Snowflake, across the AWS cloud stack</li><li>
Partner with Data Scientists to productionize ML workflows and ensure data reliability, reproducibility, and performance</li><li>
Identify, design, and implement automation of manual processes, optimizing data delivery, improving system reliability, and reducing cloud costs</li><li>
Implement processes and systems to monitor Data Quality, Observability, Governance, Lineage, and ML data consistency</li><li>
Define policies, workflows, and quality gates for using AI agents in production data systems.</li><li>
Provide technical leadership and mentorship, influencing data engineering standards, best practices, and long-term platform strategy</li><li>
Coach teams on decomposing work, supervising agents, and validating AI-generated changes.</li><li>
Support operations to manage the production environment and lead root cause analysis (RCA) for complex data and ML pipeline issues</li><li>
Write unit and integration tests, advocate for test-driven development, contribute to engineering documentation and design reviews<div>
What You'll Do</div></li><li>
Build and govern data pipelines that support model training, feature generation, retrieval-augmented workflows, or AI-driven analytics</li><li>
Enable secure, production-grade access patterns for AI use cases through curated datasets, semantic layers, metadata, monitoring, and policy-aware data services</li><li><div> 
About You</div></li><li>
You are highly fluent in modern AI data ecosystems and understand how to build the foundations required for AI and GenAI applications to succeed in production</li><li>
You know how data quality, lineage, retrieval patterns, feature access, vector storage, governance, and real-time or batch serving architectures influence AI system performance and trustworthiness</li><li>
You can evaluate tradeoffs, guide platform direction, and enable teams to build AI-ready data products responsibly and at scale</li></ul><h2 class="jobSectionHeader">
About You</h2><ul><li>
8+ years of data engineering experience with deep hands-on experience with distributed data systems including Hadoop, Spark, Hive, DBT, and Airflow/Dagster</li><li>
Bachelor&rsquo;s degree in computer science or a related field, or equivalent work experience</li><li>
5+ years of production-quality Python experience, building and maintaining large-scale data pipelines</li><li>
Strong experience building machine learning use cases through data engineering (e.g., feature engineering pipelines, training/inference data flows)</li><li>
Experience working with public cloud platforms, preferably AWS</li><li>
Experience with Databricks and/or Snowflake in production environments</li><li>
Strong working knowledge of Git, JIRA, Jenkins, shell scripting</li><li>
Familiarity with Agile methodologies, test-driven development, source control management, and test automation</li><li>
Proven ability to work across cross-functional teams in a fast-paced, dynamic environment</li><li>
Excellent collaborative problem-solving and communication skills, with the ability to influence without authority</li><li>
A track record of designing and delivering scalable, reliable, and high-quality data platforms</li><li>
Nice to have: experience building data pipelines for Digital Marketing use cases</li></ul>
Work Location
 
San Francisco 
 
The above locations are eligible offices for this role. The locations have been determined to foster in-person collaboration with this role&rsquo;s team or the related business lines. We utilize a hybrid work model, and our teams are in-office Tuesdays, Wednesdays, and Thursdays. In-person attendance is essential for this role&rsquo;s success, and remote placement will not be considered. LendingClub offers relocation, based on actual job level.
 
 
Time Zone Requirements
 
Primarily PT 
 
While the position will primarily work local hours, LendingClub is headquartered in Pacific Time and our ideal candidate will be flexible working across time zones when necessary. 
 
Travel Requirements
 
As needed travel to LendingClub offices and/or other locations, as needed.
 
 
Compensation
 
The target base salary range for this position is 198,000-230,000. The base salary of the role will be determined by job-related knowledge, experience, education, skills, and location. Base salary is just one part of LendingClub&rsquo;s Total Rewards package. You may also be eligible for long-term awards (equity) and an annual bonus (which is based on company performance, employee performance and eligible earnings). 
 
We&rsquo;re creating new financial services solutions for our members based on fairness, simplicity, and heart, and we treat our employees the same way. We offer a competitive benefits package that includes medical, dental and vision plans for employees and their families, 401(k) match, health and wellness programs, flexible time off policies for salaried employees, up to 16 weeks paid parental leave and more.
 
 
#LI-Hybrid
 
#LI-JT1 
 
LendingClub is an equal opportunity employer and dedicated to diversity, equity, and inclusion in the workplace. We do not discriminate on the basis of race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), gender, gender identity, gender expression, sexual orientation, age, marital status, veteran status, disability status, political views or activity, or other applicable legally protected characteristics. We believe that a variety of perspectives will make our teams and business stronger as we work together to transform the traditional banking system. 
We are committed to providing reasonable accommodations for qualified individuals with disabilities in our job application process. If you need assistance or an accommodation due to a disability, please contact us at interviewaccommodations@lendingclub.com.</div>

Principal Data Engineer

Arcadia

<div>
 
 
 
 ***This role is unable to provide sponsorship, a visa transfer, or work on a C2C basis. Candidates MUST be permanent residents of the United States****
 
 
 
 
 
 
 
 
 🚀 About the Role
 
 
 
 A fast-growing SaaS startup in the cloud financial management space is hiring a Data Engineer to own and scale the data infrastructure powering a platform built for large enterprises with complex cloud spending needs. This is a technically rich role for an engineer who loves wrangling massive volumes of semi-structured data, building bulletproof pipelines, and caring deeply about data quality end to end.
 
 
 
 
 
 You'll work across the full data stack, from pipeline architecture to schema design to quality control, in an environment where your work directly drives high-stakes financial decisions for enterprise customers.
 
 
 
 
 
 
 
 ***Candidates must currently be located in the San Francisco Bay Area. This role is hybrid (3 days in-office, 2 days remote) in the SF Financial District***
 
 
 
 
 
 
 
 
 
 ***This role is unable to provide sponsorship, a visa transfer, or work on a C2C basis. Candidates MUST be permanent residents of the United States***
 
 
 
 
 
 
 
 
 🛠 What You'll Do
 
 
 <ul>
 <li>
 Design efficient data storage and retrieval systems using ClickHouse, Parquet, and S3
 </li>
 <li>
 Build and maintain ETL pipelines processing hundreds of millions of rows of cloud billing data
 </li>
 <li>
 Develop robust data validation and quality control systems in Python and SQL
 </li>
 <li>
 Design and evolve data models for complex, constantly changing cloud billing schemas
 </li>
 <li>
 Build and optimize Airflow workflows for reliable, scalable data processing
 </li>
 <li>
 Collaborate with the engineering team to investigate and resolve data quality issues
 </li>
 <li>
 Scale data infrastructure as the platform expands to new cloud providers and use cases
 </li>
 </ul>
 
 
 
 
 
 ✅ What We're Looking For
 
 
 <ul>
 <li>
 3+ years of experience with data products: warehouses, lakehouses, OLAPs, ETL pipelines, or job queues
 </li>
 <li>
 Intermediate to strong Python skills with a software engineering foundation
 </li>
 <li>
 Strong SQL chops including CTEs, window functions, and query optimization
 </li>
 <li>
 Experience building data validation and quality control systems
 </li>
 <li>
 Comfort with columnar databases, Parquet, and cloud storage (S3)
 </li>
 <li>
 Startup experience and the ability to move fast in ambiguous, evolving environments
 </li>
 <li>
 A genuine fastidiousness about data quality, even when there's no answer key
 </li>
 </ul>
 
 
 
 
 
 ⭐ Bonus Points For
 
 
 <ul>
 <li>
 Hands-on experience with ClickHouse or other OLAP datastores
 </li>
 <li>
 Familiarity with cloud billing data or cost management tooling (AWS CUR, etc.)
 </li>
 <li>
 Experience with Airflow or similar workflow orchestration tools
 </li>
 <li>
 Backend engineering experience beyond data pipelines
 </li>
 </ul>
 
 
 
 
 
 💥 Why Apply?
 
 
 <ul>
 <li>
 End-to-end ownership of data products that directly impact enterprise customer outcomes
 </li>
 <li>
 Genuinely complex technical challenges at scale in a specialized, fast-growing domain
 </li>
 <li>
 Small, senior team where your contributions are visible and matter immediately
 </li>
 <li>
 Ground-floor opportunity at a well-backed startup with real revenue and strong domain expertise
 </li>
 </ul>
 
 
 
 
 
 
 ***This role is unable to provide sponsorship, a visa transfer, or work on a C2C basis. Candidates MUST be permanent residents of the United States***
 
 
 
 
 
</div>

Data Engineer

RIMEPRO INC

<div><div><h3 class="jobSectionHeader">Position Overview
</h3>The Senior Project Engineer supports the execution of mechanical and HVAC construction projects from preconstruction through closeout. This role works closely with the Project Manager and field teams to coordinate project documentation, manage technical scopes, and ensure projects are delivered on time and within budget.
This position is ideal for candidates with a strong background in commercial HVAC or mechanical systems who are looking to grow into a Project Manager role while gaining exposure to all phases of construction.
<h3 class="jobSectionHeader">Key Responsibilities
</h3><ul><li>Support the Project Manager in managing mechanical/HVAC scopes from preconstruction through completion.
</li><li>Handle project documentation including RFIs, submittals, change orders, and purchase orders.
</li><li>Coordinate with subcontractors, vendors, and field teams to ensure smooth project execution.
</li><li>Track and maintain project budgets, manpower logs, and schedules.
</li><li>Monitor project progress and assist in resolving field and coordination issues.
</li><li>Review and track submittals, equipment specs, and material deliveries.
</li><li>Assist with procurement, vendor coordination, and material planning.
</li><li>Participate in project meetings and provide updates to internal and external stakeholders.
</li><li>Maintain organized project documentation using tools such as Procore, Bluebeam, and scheduling software.
</li><li>Support quality control and ensure work aligns with project specifications and standards.
</li></ul><h3 class="jobSectionHeader">Qualifications
</h3><ul><li>3+ years of experience as a Project Engineer or Senior Project Engineer in mechanical, HVAC, or MEP construction.
</li><li>Bachelor&rsquo;s degree in Construction Management, Mechanical Engineering, or related field preferred.
</li><li>Strong understanding of HVAC systems, construction sequencing, and job costing.
</li><li>Experience managing project documentation including RFIs, submittals, and change orders.
</li><li>Proficiency with Microsoft Office, Bluebeam, Procore, Primavera (P6), and/or Viewpoint Vista.
</li><li>Strong organizational, communication, and problem-solving skills.
</li><li>Ability to manage multiple tasks and projects in various stages of construction.
</li><li>Comfortable working with field teams, subcontractors, and clients.
</li></ul><h3 class="jobSectionHeader">Compensation &amp; Benefits
</h3><ul><li>Competitive salary based on experience.
</li><li>Medical, dental, and vision insurance.
</li><li>401(k) with company match.
</li><li>Paid time off and holidays.
</li><li>Long-term growth opportunities within a strong pipeline of commercial and industrial HVAC projects.</li></ul></div></div>

Sr Project Engineer - HVAC

Explore 287+ Senior data engineer in San Francisco this April. Find roles across top companies and apply now to boost your career.

287 senior data engineer jobs In San Francisco

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Knowledge Platform

Senior ML Data Engineer, ISE

Principal Data Engineer

Data Engineer

Sr Project Engineer - HVAC