software engineer

data engineer

machine learning engineer Jobs in San Francisco

machine learning engineer

senior data engineer Jobs in San Francisco

senior data engineer

data analyst

data engineer data engineering

Plaid

<div>
 We believe that the way people interact with their finances will drastically improve in the next few years. We&rsquo;re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid&rsquo;s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Washington D.C., London and Amsterdam.
 
 
 The main goal of the DE team in 2024-25 is to build robust golden data sets to power our business goals of creating more insights based products. Making data-driven decisions is key to Plaid's culture. To support that, we need to scale our data systems while maintaining correct and complete data. We provide tooling and guidance to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively. Data Engineers heavily leverage SQL and Python to build data workflows. We use tools like DBT, Airflow, Redshift, ElasticSearch, Atlanta, and Retool to orchestrate data pipelines and define workflows. We work with engineers, product managers, business intelligence, data analysts, and many other teams to build Plaid's data strategy and a data-first mindset. Our engineering culture is IC-driven -- we favor bottom-up ideation and empowerment of our incredibly talented team. We are looking for engineers who are motivated by creating impact for our consumers and customers, growing together as a team, shipping the MVP, and leaving things better than we found them.
 
 
 You will be in a high impact role that will directly enable business leaders to make faster and more informed business judgements based on the datasets you build. You will have the opportunity to carve out the ownership and scope of internal datasets and visualizations across Plaid which is a currently unowned area that we intend to take over and build SLAs on. You will have the opportunity to learn best practices and up-level your technical skills from our strong DE team and from the broader Data Platform team. You will collaborate with and have strong and cross functional partnerships with literally all teams at Plaid from Engineering to Product to Marketing/Finance etc.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Understanding different aspects of the Plaid product and strategy to inform golden dataset choices, design and data usage principles.
 </li>
 <li>
 Have data quality and performance top of mind while designing datasets
 </li>
 <li>
 Advocating for adopting industry tools and practices at the right time
 </li>
 <li>
 Owning core SQL and Python data pipelines that power our data lake and data warehouse
 </li>
 <li>
 Well-documented data with defined dataset quality, uptime, and usefulness.
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 2+ years of dedicated data engineering experience, solving complex data pipeline issues at scale.
 </li>
 <li>
 You have experience building data models and data pipelines on top of large datasets (in the order of 500TB to petabytes)
 </li>
 <li>
 You value SQL as a flexible and extensible tool and are comfortable with modern SQL data orchestration tools like DBT, Mode, and Airflow.
 </li>
 <li>
 [Nice to have] You have experience working with different performant warehouses and data lakes; Redshift, Snowflake, Databricks
 </li>
 <li>
 [Nice to have] You have experience building and maintaining batch and real-time pipelines using technologies like Spark, Kafka.
 
 
 </li>
 </ul>
 $163,200 - $223,200 a year
 
 
 The target base salary for this position ranges from $163,200/year to $223,200/year in Zone 1. The target base salary will vary based on the job's location.
 
 
 
 Our Geographic Zones Are As Follows
 
 
 
 Zone 1 - New York City and San Francisco Bay Area
 
 
 Zone 2 - Los Angeles, Seattle, Washington D.C.
 
 
 Zone 3 - Austin, Boston, Denver, Houston, Portland, Sacramento, San Diego
 
 
 Zone 4 - Raleigh-Durham and all other US cities
 
 
 Additional compensation in the form(s) of equity and/or commission are dependent on the position offered. Plaid provides a comprehensive benefit plan, including medical, dental, vision, and 401(k). Pay is based on factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience and skillset, and location. Pay and benefits are subject to change at any time, consistent with the terms of any applicable compensation or benefit plans.
 
 
 Our mission at Plaid is to unlock financial freedom for everyone. To support that mission, we seek to build a diverse team of driven individuals who care deeply about making the financial ecosystem more equitable. We recognize that strong qualifications can come from both prior work experiences and lived experiences. We encourage you to apply to a role even if your experience doesn't fully match the job description. We are always looking for team members that will bring something unique to Plaid!
 
 
 Plaid is proud to be an equal opportunity employer and values diversity at our company. We do not discriminate based on race, color, national origin, ethnicity, religion or religious belief, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, military or veteran status, disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state, and local laws. Plaid is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance with your application or interviews due to a disability, please let us know at [email protected] .
 
 
 Please review our Candidate Privacy Notice here .
</div>

Data Engineer - Data Engineering

Hayden AI

<div>
 
 About Us
 
 
 
 At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government agencies address real-world challenges.
 
 
 From bus lane and bus stop enforcement to transportation optimization technologies and beyond, our innovative mobile perception system empowers our clients to accelerate transit, enhance street safety, and drive toward a sustainable future.
 
 
 
 Job Title:
 
 Machine Learning Operations Engineer
 
 
 
 Company:
 
 Hayden AI Technologies, Inc.
 
 
 
 Location:
 
 460 Bryant Street, Suite 100, San Francisco, CA 94107
 
 
 
 Position Duties
 
 
 
 <ul>
 <li>
 Optimize orchestration processes to ensure efficient deployment and management of AI models.
 </li>
 <li>
 Implement cost-saving strategies to minimize infrastructure expenses while maximizing performance.
 </li>
 <li>
 Upgrade throughput to enhance scalability and responsiveness of AI systems.
 </li>
 <li>
 Collaborate with cross-functional teams to identify bottlenecks and implement solutions to improve workflow efficiency.
 </li>
 <li>
 Ship new features and updates rapidly while maintaining high levels of quality and reliability.
 </li>
 <li>
 Deploy and monitor machine learning models produced by deep learning engineers.
 </li>
 <li>
 Design, deploy, and maintain performant and scalable processes for data acquisition and manipulation to enhance dataset accessibility.
 </li>
 <li>
 Participate actively in the team's software development process, including design reviews, code reviews, and brainstorming sessions.
 </li>
 <li>
 Maintain accurate and updated software development documentation.
 
 
 </li>
 </ul>
 
 Degree Requirements
 
 
 
 Bachelor of Science or Engineering degree or a foreign equivalent in Robotics, Machine Learning, Computer Science, Electrical Engineering, Electronics and Telecommunication Engineering, or a related field.
 
 
 
 Experience Requirement
 
 
 
 One (1) year of work experience in the job offered or as a Deep Learning Engineer, Perception Engineer II, MLOps, Research Engineer II, Machine Learning, Computer Vision Intern, or another related deep learning engineer role.
 
 
 
 Other Special Requirements
 
 
 
 <ul>
 <li>
 One (1) year of work experience with all of the following:
 </li>
 <ul>
 <li>
 Deploying real-world applied computer vision (including deep learning models) on edge devices
 </li>
 <li>
 Python programming and software design
 </li>
 <li>
 C++
 </li>
 <li>
 Software development tools and libraries including PyTorch, OpenCV, TensorFlow, MLflow
 </li>
 <li>
 Automated data annotation
 </li>
 <li>
 Distributed training in the cloud
 </li>
 <li>
 Deploying and managing GPU clusters for ML pipelines and workflows
 
 </li>
 </ul>
 </ul>
 
 Rate of Pay:
 
 $135,699.00 to $190,000.00 per year
 
 
 
 Location of Position and Interview:
 
 
 
 Hayden AI Technologies, Inc.
 
 
 460 Bryant Street, Suite 100
 
 
 San Francisco, CA 94107
 
 
 
 Applicants Should Submit Resumes To
 
 
 
 Janet Le-Mcintosh
 
 
 janet.le@hayden.ai
 
 
 Hayden AI Technologies, Inc.
 
 
 460 Bryant Street, Suite 100
 
 
 San Francisco, CA 94107
</div>

Machine Learning Operations Engineer

Apple

At Apple, we focus deeply on our customers&rsquo; experience. Apple Ads brings this same approach to advertising, helping people find exactly what they&rsquo;re looking for and helping advertisers grow their businesses. Our technology powers ads and sponsorships across Apple Services, including the App Store, Apple News, and MLS Season Pass. Everything we do is designed for trust, connection, and impact: We respect user privacy, integrate advertising thoughtfully into the experience, and deliver value for advertisers of all sizes-from small app developers to big, global brands. Because when advertising is done right, it benefits everyone. Data Products Engineering team is seeking an ambitious and versatile Data engineer to help lead the design and scale of key data systems, delivering data products that solve exciting business problems. Responsibilities range from designing and implementing core stream-processing and batch-processing capabilities, to supporting privacy preserving critical pipelines. You will have the opportunity to define, refine, and refactor approaches, designs, and architectures to meet the data engineering challenges we must solve. You will join a team of world-class data engineers with an appetite for applying leading-edge technologies to deliver extraordinary experiences to our customers. You will play a meaningful role building data products that deliver on Apple's privacy commitments and change the way advertising works with data. You will be a leading voice in our technology strategy and its delivery, developing and mentoring team members. You will collaborate closely with the business to deliver relevant data and insight to inform our strategy and decisions. You should have 8+ years experience in data engineering roles, ideally within the ads or media space. You will have an excellent understanding of scalable approaches and thrive working in Agile environments. The ability to be a good standout colleague under tight deadline constraints is key to success! 
 
Description 
 
At Apple Ads, we are building the next generation of privacy-focused advertising capabilities. As a part of the data organization, we work at the cutting edge of data engineering, machine learning, and privacy at Apple's scale. We are constantly developing data products to provide amazing user experiences and to drive value for developers and publishers. As a part of this team, as a Data Engineer, you will * Engineer secure and scalable data processing systems across different execution contexts such as real-time, near real-time, and batch using Spark, Hadoop, Kafka, Cassandra and beyond * Collaborate with a team of world-class data engineers and product managers to apply leading-edge techniques and technologies that process petabytes of realtime streaming and batch events * Require a strong understanding of the intersection between business, analytics, and engineering resulting in a proactive approach, focusing on reusable solutions, to improve efficiency and time to insight * Must be able to work in a rapidly changing environment and perform effectively in a sprint-based, agile development environment * Join and contribute to a culture that emphasizes reliability, resiliency, extensibility, scalability, and productivity. We are one team, nurturing each other&rsquo;s growth and supporting each other in delivering for our customers and Apple 
 
Preferred Qualifications 
 
Ability to communicate effectively with cross-functional technical and non-technical teams 
 
Comfortable working in a rapidly changing environment with ambiguous requirements 
 
Comfortable with rotating on-call for mission-critical applications 
 
Prior experience in advertising industry is a huge plus! 
 
Minimum Qualifications 
 
8+ years of industry experience building distributed, scalable data pipelines and data platforms 
 
Proven track record of successful and timely software product delivery with complex dependencies 
 
Demonstrated innovative, critical thinking and troubleshooting skills 
 
Excellent collaborative skills 
 
History of motivating teams to meet aggressive goals and innovate 
 
Proficiency with modern programming languages (e.g. Java/Scala/C++) and ease with picking up new technologies independently 
 
Strong computer science and data engineering fundamentals 
 
Expertise in data modeling and Iceberg lake house implementation 
 
Proficiency in distributed systems and data processing technologies (e.g. Spark, Kafka, Flink) 
 
Experience building and scaling systems on premise and in the cloud 
 
Strong technical skills with proven experience developing, architecting, and supporting scalable data infrastructure 
 
Passion for data quality, code elegance, clear documentation, cost saving and operational excellence 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Senior Data Engineer

Meta

<div>
 As a Data Engineer at Meta, you will shape the future of people-facing and business-facing products we build across our entire family of applications (Facebook, Instagram, Messenger, WhatsApp, Reality Labs, Threads). Your technical skills and analytical mindset will be utilized designing and building some of the world's most extensive data sets, helping to craft experiences for billions of people and hundreds of millions of businesses worldwide.In this role, you will collaborate with software engineering, data science, and product management teams to design/build scalable data solutions across Meta to optimize growth, strategy, and user experience for our 3 billion plus users, as well as our internal employee community.You will be at the forefront of identifying and solving some of the most interesting data challenges at a scale few companies can match. By joining Meta, you will become part of a world-class data engineering community dedicated to skill development and career growth in data engineering and beyond.Data Engineering: You will guide teams by building optimal data artifacts (including datasets and visualizations) to address key questions. You will refine our systems, design logging solutions, and create scalable data models. Ensuring data security and quality, and with a strong focus on efficiency, you will suggest architecture and development approaches and data management standards to address complex analytical problems.Product leadership: You will use data to shape product development, identify new opportunities, and tackle upcoming challenges. You'll ensure our products add value for users and businesses, by prioritizing projects, and driving innovative solutions to respond to challenges or opportunities.Communication and influence: You won't simply present data, but tell data-driven stories. You will convince and influence your partners using clear insights and recommendations. You will build credibility through structure and clarity, and be a trusted strategic partner.
 
 
 Data Engineer, Product Analytics Responsibilities:
 
 
 <ul>
 <li>
 Conceptualize and own the data architecture for multiple large-scale projects, while evaluating design and operational cost-benefit tradeoffs within systems
 </li>
 <li>
 Create and contribute to frameworks that improve the efficacy of logging data, while working with data infrastructure to triage issues and resolve
 </li>
 <li>
 Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights visually in a meaningful way
 </li>
 <li>
 Define and manage Service Level Agreements for all data sets in allocated areas of ownership
 </li>
 <li>
 Determine and implement the security model based on privacy requirements, confirm safeguards are followed, address data quality issues, and evolve governance processes within allocated areas of ownership
 </li>
 <li>
 Design, build, and launch collections of sophisticated data models and visualizations that support multiple use cases across different products or domains
 </li>
 <li>
 Solve our most challenging data integration problems, utilizing optimal Extract, Transform, Load (ETL) patterns, frameworks, query techniques, sourcing from structured and unstructured data sources
 </li>
 <li>
 Assist in owning existing processes running in production, optimizing complex code through advanced algorithmic concepts
 </li>
 <li>
 Optimize pipelines, dashboards, frameworks, and systems to facilitate easier development of data artifacts
 </li>
 <li>
 Influence product and cross-functional teams to identify data opportunities to drive impact
 </li>
 <li>
 Mentor team members by giving/receiving actionable feedback
 
 
 </li>
 </ul>
 Minimum Qualifications:
 
 
 <ul>
 <li>
 Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
 </li>
 <li>
 7+ years of experience where the primary responsibility involves working with data. This could include roles such as data analyst, data scientist, data engineer, or similar positions
 </li>
 <li>
 7+ years of experience with SQL, ETL, data modeling, and at least one programming language (e.g., Python, C++, C#, Scala or others.)
 
 
 </li>
 </ul>
 Preferred Qualifications:
 
 
 <ul>
 <li>
 Master's or Ph.D degree in a STEM field
 
 
 </li>
 </ul>
 About Meta:
 
 
 Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today&mdash;beyond the constraints of screens, the limits of distance, and even the rules of physics.
 
 
 Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.
 
 
 Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.
 
 
 $177,000/year to $247,000/year + bonus + equity + benefits
 
 
 Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.
</div>

Data Engineer, Product Analytics

ACR Technology Inc

Job Description: Data Engineer Eligibility: Only U.S. Citizen or Green Card Responsibilities Design, build, and maintain scalable ETL pipelines, data workflows, and data warehousing solutions for analytics and reporting. Develop and optimize data modeling solutions, databases, and large-scale datasets using platforms such as Google BigQuery, Hive, and cloud-native technologies. Write and optimize complex SQL queries and implement Python, Spark, and Scala-based data transformations. Build and maintain batch and streaming data pipelines using Spark, PySpark, Scala, and messaging systems such as Kafka. Orchestrate workflows and automate data processes using Apache Airflow. Integrate data from multiple sources, including third-party systems via REST APIs, ensuring data quality, consistency, governance, and compliance. Collaborate with product, engineering, and business teams to translate requirements into scalable technical solutions. Test, deploy, monitor, and support data solutions across cloud environments (AWS, Azure, or GCP). Document processes, contribute to continuous improvement initiatives, and provide technical guidance to users and cross-functional teams.Qualifications 5+ years of experience in data engineering, analytics, or related fields. Advanced proficiency in SQL and strong programming skills in Python and/or Scala. Hands-on experience with ETL processes, data modeling, and data warehousing concepts. Experience working with cloud data platforms such as Google BigQuery, AWS, or Azure. Strong experience with Spark (PySpark/Scala) and big data technologies such as Hive and Kafka. Experience building and managing workflows using Apache Airflow. Experience integrating systems using REST APIs. Knowledge of data governance, data quality, and compliance best practices. Bachelor&rsquo;s degree in Computer Science, Engineering, or equivalent experience.Pay: $60.00 - $70.00 per hourWork Location: In person

Data Engineer (Only local to California, W2, GC and USC )

Realign

<div>San Francisco, California 94016 Posted March 12th, 2026
 <div></div>Looking for more job opportunities? Click here!</div>
 <div>Job Type: Contract
Job Category: IT
Job Description
Role: Sr. AI/ML Engineer<ul><li> Experience &ndash; 10+ Years</li><li> Location - San Francisco, CA &ndash; LOCALS Only</li></ul><div>
Required Qualifications 
<ul><li>Deep expertise in Machine Learning, Generative AI, LLMs, RAG, and AI orchestration.</li><li>Strong understanding of Azure OpenAI, AWS Bedrock, or similar platforms.</li><li>Experience deploying AI in regulated environments.</li><li>Hands-on architectural and engineering leadership capabilities.</li><li>Strong communication skills with VP/Senior Director stakeholders.</li></ul>
 Preferred Qualifications 
<ul><li>12+ years in AI/ML, data engineering, or digital transformation.</li><li>Prior experience leading enterprise AI programs.</li><li>Utility domain experience (wildfire, grid, operations).</li><li>Knowledge of Responsible AI frameworks (NIST AI RMF, ISO 42001).</li></ul> 

Roles &amp; Responsibilities 
Role Overview 
Utilities are accelerating their enterprise AI adoption across Operations, Customer Experience, Wildfire Safety, Regulatory, and IT. The AI Lead will serve as the strategic driver for enterprise AI transformation&mdash;defining vision, governance, enterprise architecture, and leading delivery of high-impact GenAI and ML solutions.</div><div> 
Key Responsibilities 
<ul><li>Define the enterprise AI vision, roadmap, and operating model.</li><li>Identify and prioritize AI/ML/GenAI opportunities across business units.</li><li>Drive design and deployment of AI solutions including consultation agents, hazard detection, regulatory Q&amp;A automation, and contact center assistants.</li><li>Establish AI governance, compliance, model risk management, and auditability frameworks.</li><li>Lead cross-functional AI programs spanning IT, Operations, Customer Care, Regulatory, Safety, and Field Ops.</li><li>Mentor and guide data scientists, ML engineers, architects, and product owners.</li><li>Promote AI literacy, change management, and best practices across the enterprise.</li></ul></div>
Required Skills
DEVOPS ENGINEER SENIOR EMAIL SECURITY ENGINEER</div>

Sr. AI/ML Engineer-6

Explore 403+ Data engineer data engineering in San Francisco this March. Find roles across top companies and apply now to boost your career.

403 data engineer data engineering jobs In San Francisco

Data Engineer - Data Engineering

Data Engineer - Data Engineering

Machine Learning Operations Engineer

Senior Data Engineer

Data Engineer, Product Analytics

Data Engineer (Only local to California, W2, GC and USC )

Sr. AI/ML Engineer-6