software engineer

data engineer

senior data engineer Jobs in San Francisco

senior data engineer

ai application engineer Jobs in San Francisco

ai application engineer

ai engineer

database engineer

Adobe

<div>
 
 Our Company
 
 
 
 Changing the world through digital experiences is what Adobe&rsquo;s all about. We give everyone&mdash;from emerging artists to global brands&mdash;everything they need to design and deliver exceptional digital experiences! We&rsquo;re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.
 
 
 We&rsquo;re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!
 
 
 Adobe Customer Solutions is looking for a full time Data Engineer with experience in building data integrations using AWS technology stack as part of the team's Data as a Service portfolio for Adobe&rsquo;s Digital Experience enterprise customers.
 
 
 Customer facing Engineers who enjoy tackling complex technical challenges, have a passion for delighting customers and who are self-motivated to push themselves in a team oriented culture will thrive in our environment
 
 
 What you&rsquo;ll do
 
 
 <ul>
 <li>
 Collaborate with Data architects, Enterprise architects, Solution consultants and Product engineering teams to capture customer data integration requirements, conceptualize solutions &amp; build required technology stack
 </li>
 <li>
 Collaborate with enterprise customer's engineering team to identify data sources, profile and quantify quality of data sources, develop tools to prepare data and build data pipelines for integrating customer data sources and third party data sources with Adobe solutions
 </li>
 <li>
 Develop new features and improve existing data integrations with customer data ecosystem
 </li>
 <li>
 Encourage team to think out-of-the-box and overcome engineering obstacles while incorporating new innovative design principles.
 </li>
 <li>
 Collaborate with a Project Manager to bill and forecast time for customer solutions
 
 
 </li>
 </ul>
 
 Requirements
 
 
 
 <ul>
 <li>
 Experience as an enterprise Data Engineer from a consulting background
 </li>
 <li>
 AWS Certified Data Engineer &ndash; Associate or AWS Certified Cloud Practitioner
 </li>
 <li>
 5+ years experience in building/operating/maintaining fault tolerant and scalable data processing integrations using AWS
 </li>
 <li>
 7+ years experience in Python programming language preferably using PySpark
 </li>
 <li>
 Software development experience working with Apache Airflow, MongoDB, MySQL
 </li>
 <li>
 Strong capacity to manage numerous projects are a must
 </li>
 <li>
 Experience using Docker or Kubernetes is a plus
 </li>
 <li>
 BS/MS degree in Computer Science or equivalent industry experience
 </li>
 <li>
 Ability to identify and resolve problems associated with production grade large scale data processing workflows
 </li>
 <li>
 Excellent communication skills (we&rsquo;re a geographically distributed team)
 </li>
 <li>
 Experience creating and maintaining unit tests and continuous integration.
 </li>
 <li>
 Passion for creating Intelligent data pipelines that customers love to use.
 
 
 </li>
 </ul>
 Special Consideration given for
 
 
 <ul>
 <li>
 Experience &amp; knowledge with Web Analytics or Digital Marketing
 </li>
 <li>
 Experience &amp; knowledge with Customer Data Platform (CDP) or Data Management Platform (DMP)
 </li>
 <li>
 Experience &amp; knowledge with Adobe Experience Cloud solutions
 
 
 </li>
 </ul>
 Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $114,100 -- $214,950 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.
 
 
 In California, the pay range for this position is $148,500 - $214,950 In New York, the pay range for this position is $148,500 - $214,950 In Washington, the pay range for this position is $135,100 - $195,550
 
 
 At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).
 
 
 In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.
 
 
 
 State-Specific Notices:
 
 
 
 
 California:
 
 
 
 
 Fair Chance Ordinances
 
 
 
 Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and &ldquo;fair chance&rdquo; ordinances.
 
 
 
 Colorado:
 
 
 
 
 Application Window Notice
 
 
 
 If this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.
 
 
 
 Massachusetts:
 
 
 
 
 Massachusetts Legal Notice
 
 
 
 It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
 
 
 Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more.
 
 
 Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.
</div>

Data Engineer

ACR Technology Inc

Job Description: Data Engineer Eligibility: Only U.S. Citizen or Green Card Responsibilities Design, build, and maintain scalable ETL pipelines, data workflows, and data warehousing solutions for analytics and reporting. Develop and optimize data modeling solutions, databases, and large-scale datasets using platforms such as Google BigQuery, Hive, and cloud-native technologies. Write and optimize complex SQL queries and implement Python, Spark, and Scala-based data transformations. Build and maintain batch and streaming data pipelines using Spark, PySpark, Scala, and messaging systems such as Kafka. Orchestrate workflows and automate data processes using Apache Airflow. Integrate data from multiple sources, including third-party systems via REST APIs, ensuring data quality, consistency, governance, and compliance. Collaborate with product, engineering, and business teams to translate requirements into scalable technical solutions. Test, deploy, monitor, and support data solutions across cloud environments (AWS, Azure, or GCP). Document processes, contribute to continuous improvement initiatives, and provide technical guidance to users and cross-functional teams.Qualifications 5+ years of experience in data engineering, analytics, or related fields. Advanced proficiency in SQL and strong programming skills in Python and/or Scala. Hands-on experience with ETL processes, data modeling, and data warehousing concepts. Experience working with cloud data platforms such as Google BigQuery, AWS, or Azure. Strong experience with Spark (PySpark/Scala) and big data technologies such as Hive and Kafka. Experience building and managing workflows using Apache Airflow. Experience integrating systems using REST APIs. Knowledge of data governance, data quality, and compliance best practices. Bachelor&rsquo;s degree in Computer Science, Engineering, or equivalent experience.Pay: $60.00 - $70.00 per hourWork Location: In person

Data Engineer (Only local to California, W2, GC and USC )

Apple

Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery in hyper-scale distributed computing environments. You will work within cybersecurity software engineering team that drives Apache Spark&rsquo;s state-of-the art features and pushes the boundaries of what is possible in our industry. 
 
Description 
 
Apple is seeking an extraordinary individual to work on a team supporting and developing services which underpin mission critical information security capabilities. Spark expertise is a prerequisite. While previous experience in information security is not required, a sincere drive for security and privacy is required. This role will work closely with our engineering teams and with partner teams to ensure the successful design, development, and delivery of product objectives. The successful candidate will have a passion for technical excellence and team collaboration with a heavy focus on using cutting-edge technologies to build data intensive systems, designing and optimizing data models, and collaborating with cross-functional teams to solve complex data challenges. 
 
Preferred Qualifications 
 
5+ years experience in data engineering and demonstrated expertise with data modeling 
 
5+ years of experience with JVM languages: Java or Scala 
 
5+ years experience with big data platforms 
 
Familiarity with ML/AI workflows and feature engineering to support analytics, reporting, and machine learning use cases 
 
Knowledge engineering expertise including semantic models and knowledge graphs 
 
Experience working with cloud compute environments like OpenStack, AWS, and Azure 
 
Experience mentoring engineers, conducting code reviews, and contributing to technical best practices and documentation 
 
Knowledge of data quality frameworks and validation techniques 
 
Knowledge of data governance and compliance frameworks 
 
Minimum Qualifications 
 
Demonstrated expertise in designing and implementing relational and medallion data architectures 
 
Demonstrated expertise in the design and implementation of production data pipelines at scale 
 
Demonstrated proficiency with JVM languages (Scala or Java preferred), Golang, or Swift 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $147,400 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Baselayer

<div>
 
 &nbsp;
 
 
 
 About Baselayer
 
 
 Trusted by 2,200+ financial institutions, Baselayer is the intelligent business identity platform that helps verify any business, automate KYB, and monitor real-time risk. Baselayer&rsquo;s B2B risk solutions and identity graph network leverage state and federal government filings and proprietary data sources to prevent fraud, accelerate onboarding, and lower credit losses.
 
 
 &nbsp;
 
 
 
 About the Role
 
 
 We are looking for a Data Engineer to build and scale Baselayer&rsquo;s data infrastructure. You will own the pipelines and data systems that power analytics, reporting, and machine learning across the company, with a focus on reliability, performance, and data quality.
 
 
 This role is hands-on and highly cross-functional. You will work closely with Product and Engineering to ensure data is accessible, trusted, and delivered in a way that supports product capabilities in a regulated environment.
 
 
 &nbsp;
 
 
 
 What You&rsquo;ll Do
 
 
 <ul>
 <li>
 
 Design, build, and maintain scalable data pipelines that ingest, clean, validate, and transform data from internal systems and external sources
 
 </li>
 <li>
 
 Own data reliability and quality through monitoring, alerting, lineage, and validation frameworks
 
 </li>
 <li>
 
 Build and maintain data models and curated datasets that support analytics, dashboards, customer reporting, and downstream ML use cases
 
 </li>
 <li>
 
 Partner with Engineering to define best practices for data architecture, storage, access controls, and performance
 
 </li>
 <li>
 
 Implement orchestration and scheduling for batch and near-real-time workflows as needed
 
 </li>
 <li>
 
 Optimize pipeline performance, cost, and scalability as data volumes grow
 
 </li>
 <li>
 
 Develop and maintain documentation and runbooks for pipelines, datasets, and operational procedures
 
 </li>
 <li>
 
 Identify data gaps and instrumentation needs, and work with engineering teams to improve event capture and logging
 
 </li>
 </ul>
 
 &nbsp;
 
 
 
 About You
 
 
 You want to learn fast, take ownership, and do work that matters. You are not just doing this for the win. You are doing it because you have something to prove and want to be great.
 
 
 You thrive in the details, care about correctness, and take pride in building robust systems that other teams can rely on. You operate with urgency, handle ambiguity well, and consistently raise the bar on data quality and reliability.
 
 
 &nbsp;
 
 
 
 Required Experience and Skills
 
 
 <ul>
 <li>
 
 1 to 3 years of experience in data engineering, analytics engineering, or backend engineering with significant data pipeline ownership
 
 </li>
 <li>
 
 Strong Python skills and experience building production-grade data workflows
 
 </li>
 <li>
 
 Strong SQL skills with experience designing data models and transforming large datasets
 
 </li>
 <li>
 
 Experience building and maintaining ETL or ELT pipelines and working with data warehouses or analytics databases
 
 </li>
 <li>
 
 Familiarity with orchestration tools and workflow scheduling (for example Airflow, Dagster, Prefect, or similar)
 
 </li>
 <li>
 
 Strong understanding of data quality, testing, observability, and operational best practices
 
 </li>
 <li>
 
 Comfort working with large-scale datasets and troubleshooting performance issues
 
 </li>
 <li>
 
 Ability to communicate clearly with technical and non-technical stakeholders
 
 </li>
 </ul>
 
 &nbsp;
 
 
 
 What Sets You Apart
 
 
 <ul>
 <li>
 
 Experience working with identity, fraud, risk, compliance, or other regulated datasets
 
 </li>
 <li>
 
 Experience integrating with external data sources, APIs, and government or registry data
 
 </li>
 <li>
 
 Familiarity with streaming or near-real-time data patterns
 
 </li>
 <li>
 
 Highly feedback-oriented with a desire for continuous improvement
 
 </li>
 </ul>
 
 &nbsp;
 
 
 
 Work Location
 
 
 <ul>
 <li>
 
 Hybrid in SF, in office 3 days per week
 
 </li>
 </ul>
 
 
 Compensation and Benefits
 
 
 <ul>
 <li>
 
 Salary range of $122,000 to $167,000
 
 </li>
 <li>
 
 Equity package
 
 </li>
 <li>
 
 Unlimited vacation
 
 </li>
 <li>
 
 Comprehensive health coverage
 
 </li>
 <li>
 
 401(k) with company match
 
 </li>
 </ul>
</div>

Amazon Web Services

<div><h2 class="jobSectionHeader">DESCRIPTION</h2><div>
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we&rsquo;re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain &mdash; and we&rsquo;re looking for talented people who want to help. 
 
You&rsquo;ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You&rsquo;ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you&rsquo;ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. 
 
Amazon Interactive Video Service (Amazon IVS) is AWS's fully managed live streaming service, built on the same battle-tested technology that powers Twitch and trusted by thousands of enterprises across gaming, social, live commerce, sports, and entertainment.
 
 
Our mission: enable developers to build communities around live video. We handle everything from ingest to processing to delivery at global scale, so developers can focus on creating interactive, engaging live experiences for their audiences. Whether you're streaming to tens of millions of concurrent viewers or just getting started, Amazon IVS removes the complexity so developers can move fast. 
 
As a Data Infrastructure Engineer, you will be responsible for empowering internal teams and IVS customers with the data they need to make key operational and business decisions. We operate petabyte-scale data infrastructure for collecting, processing, and warehousing IVS data. We support streaming and batch pipelines to facilitate analytics, reporting, and ML workloads. We offer analytics tools and data products designed to make it easy and fast for our customers to extract the insights they need from their data. 
 
Key job responsibilities 
<ul><li>Design, implement, and maintain scalable data infrastructure in native AWS</li><li>Build and optimize data pipelines (batch and streaming) to support analytics, reporting, and ML workloads</li><li>Ensure data quality, reliability, and observability through monitoring, logging, and automated alerting</li><li>Work closely with product and analytics teams to understand requirements and deliver high-performance solutions</li><li>Champion best practices for security, compliance, and governance in data infrastructure</li><li>Identify opportunities to optimize performance and cost of data platforms</li><li>Stay current with emerging tools, frameworks, and cloud services in the data infrastructure ecosystem</li></ul> 
A day in the life 
Your primary focus will be empowering customers to succeed with their data by ensuring they can: 
<ul><li>Gather and access data at scale &ndash; Enable seamless data collection and retrieval that grows with their needs</li><li>Extract meaningful insights &ndash; Provide the right tools and capabilities to uncover the answers they're seeking</li><li>Trust their data &ndash; Maintain confidence in the completeness, accuracy, and reliability of their information</li></ul>
Achieving these goals requires close collaboration and strong partnerships with Product and Data Science teams to deliver solutions that truly meet customer needs.</div><h2 class="jobSectionHeader">
BASIC QUALIFICATIONS</h2><ul><li>5+ years of non-internship professional software development experience</li><li>5+ years of programming with at least one software programming language experience</li><li>5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience</li><li>Experience as a mentor, tech lead or leading an engineering team</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience</li><li>Bachelor's degree in computer science or equivalent</li><li>Experience in software development, or experience operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets</li></ul> 
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. 
 
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company&rsquo;s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner. 
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. 
USA, CA, San Francisco - 193,300.00 - 261,500.00 USD annually 
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually</div>

Sr. Data Infrastructure Engineer, Amazon Interactive Video Service (IVS)

Afresh

<div><div>Afresh is the leading AI company in fresh food&mdash;partnering with grocers like Albertsons, Wakefern, Meijer, and Stater Bros to order billions of dollars of fresh food in over 12,000 grocery departments nationwide.

Following record-breaking 70% growth in 2025, we've expanded our platform to cover all fresh departments, launched our full store suite, and debuted DC Fresh Buying.

We're on a mission to eliminate food waste and make fresh food accessible to all. In 2025 alone our software helped save 200M lbs of food waste. If you're looking for a role where your work directly translates into massive scale and social good, and you want to be part of the team that defines the future of fresh, there is no better time to join us.</div>
About the Role

As a Senior Data Engineer, you'll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs that reliably process large volumes of customer-provided data and build tools/improve the platform to make customer integrations faster, more accurate, and more scalable. You'll also contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily and quickly and power our machine learning grocery solution.

What You'll Do
<ul>
<li>Build tools and frameworks that streamline customer integrations, enabling faster onboarding and better handling of customer data.</li>
<li>Create robust ETLs in PySpark and DBT to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use.</li>
<li>Investigate and implement new technologies into the data platform, focusing on practical solutions that address current pain points and anticipate future needs.</li>
<li>Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features.</li>
<li>Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations.</li>
<li>Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need.</li>
<li>Support team members by mentoring engineers, leading technical discussions, and providing clear, actionable feedback.</li>
</ul>
What Makes You a Great Fit

We encourage all highly-qualified candidates to apply, even if they don't meet every listed qualification.
<ul>
<li>Significant experience designing and maintaining ETLs that process large-scale datasets.</li>
<li>Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT.</li>
<li>Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.</li>
<li>A focus on practical outcomes&mdash;you're skilled at balancing technical rigor with the need to get things done.</li>
<li>Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them.</li>
<li>A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort.</li>
<li>Excellent communication skills&mdash;you're able to explain your ideas clearly to both technical and non-technical audiences.</li>
<li>Proven leadership in technical projects, with a willingness to mentor and help others grow.</li>
</ul>
Why Work Here
<ul>
<li>Join a mission-driven company reducing millions of pounds of food waste in grocery stores per year.</li>
<li>Work on challenging, real-world problems that have a direct impact on our customers.</li>
<li>Be part of a collaborative, supportive team where your ideas are valued and acted on.</li>
<li>Use cutting-edge tools and platforms to solve meaningful data challenges.</li>
</ul>
We're looking for someone who thrives on tackling complex data problems and takes pride in building systems that work seamlessly at scale. If that sounds like you, we'd love to hear from you!

This position is not eligible for employer sponsorship.

Salary Range in U.S.: $156,000 - $211,000

Salary Range in Canada (CAD): $137,000 - $185,000<div> 
About Afresh 
 
Founded in 2017, Afresh is working on the #1 solution to curb climate change: reducing food waste. By combining human insight and transformative technology, we're helping grocers provide fresher food to customers at more affordable prices.
 
 
Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals including ICML, and we've raised over $148 million in funding from investors including former co-CEO of Whole Foods Market Walter Robb and Eric Schmidt's Innovation Endeavors.

Fresh is the past, present, and future of our food system &ndash; the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company's values of proactivity, kindness, candor, and humility. 
 
Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law.

Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AL, AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, UT, VA, WI.</div></div>

Senior Data Engineer

Plaid

<div>
 We believe that the way people interact with their finances will drastically improve in the next few years. We&rsquo;re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid&rsquo;s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Washington D.C., London and Amsterdam.
 
 
 The main goal of the DE team in 2024-25 is to build robust golden data sets to power our business goals of creating more insights based products. Making data-driven decisions is key to Plaid's culture. To support that, we need to scale our data systems while maintaining correct and complete data. We provide tooling and guidance to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively. Data Engineers heavily leverage SQL and Python to build data workflows. We use tools like DBT, Airflow, Redshift, ElasticSearch, Atlanta, and Retool to orchestrate data pipelines and define workflows. We work with engineers, product managers, business intelligence, data analysts, and many other teams to build Plaid's data strategy and a data-first mindset. Our engineering culture is IC-driven -- we favor bottom-up ideation and empowerment of our incredibly talented team. We are looking for engineers who are motivated by creating impact for our consumers and customers, growing together as a team, shipping the MVP, and leaving things better than we found them.
 
 
 You will be in a high impact role that will directly enable business leaders to make faster and more informed business judgements based on the datasets you build. You will have the opportunity to carve out the ownership and scope of internal datasets and visualizations across Plaid which is a currently unowned area that we intend to take over and build SLAs on. You will have the opportunity to learn best practices and up-level your technical skills from our strong DE team and from the broader Data Platform team. You will collaborate with and have strong and cross functional partnerships with literally all teams at Plaid from Engineering to Product to Marketing/Finance etc.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Understanding different aspects of the Plaid product and strategy to inform golden dataset choices, design and data usage principles.
 </li>
 <li>
 Have data quality and performance top of mind while designing datasets
 </li>
 <li>
 Advocating for adopting industry tools and practices at the right time
 </li>
 <li>
 Owning core SQL and Python data pipelines that power our data lake and data warehouse
 </li>
 <li>
 Well-documented data with defined dataset quality, uptime, and usefulness.
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 2+ years of dedicated data engineering experience, solving complex data pipeline issues at scale.
 </li>
 <li>
 You have experience building data models and data pipelines on top of large datasets (in the order of 500TB to petabytes)
 </li>
 <li>
 You value SQL as a flexible and extensible tool and are comfortable with modern SQL data orchestration tools like DBT, Mode, and Airflow.
 </li>
 <li>
 [Nice to have] You have experience working with different performant warehouses and data lakes; Redshift, Snowflake, Databricks
 </li>
 <li>
 [Nice to have] You have experience building and maintaining batch and real-time pipelines using technologies like Spark, Kafka.
 
 
 </li>
 </ul>
 $163,200 - $223,200 a year
 
 
 The target base salary for this position ranges from $163,200/year to $223,200/year in Zone 1. The target base salary will vary based on the job's location.
 
 
 
 Our Geographic Zones Are As Follows
 
 
 
 Zone 1 - New York City and San Francisco Bay Area
 
 
 Zone 2 - Los Angeles, Seattle, Washington D.C.
 
 
 Zone 3 - Austin, Boston, Denver, Houston, Portland, Sacramento, San Diego
 
 
 Zone 4 - Raleigh-Durham and all other US cities
 
 
 Additional compensation in the form(s) of equity and/or commission are dependent on the position offered. Plaid provides a comprehensive benefit plan, including medical, dental, vision, and 401(k). Pay is based on factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience and skillset, and location. Pay and benefits are subject to change at any time, consistent with the terms of any applicable compensation or benefit plans.
 
 
 Our mission at Plaid is to unlock financial freedom for everyone. To support that mission, we seek to build a diverse team of driven individuals who care deeply about making the financial ecosystem more equitable. We recognize that strong qualifications can come from both prior work experiences and lived experiences. We encourage you to apply to a role even if your experience doesn't fully match the job description. We are always looking for team members that will bring something unique to Plaid!
 
 
 Plaid is proud to be an equal opportunity employer and values diversity at our company. We do not discriminate based on race, color, national origin, ethnicity, religion or religious belief, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, military or veteran status, disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state, and local laws. Plaid is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance with your application or interviews due to a disability, please let us know at [email protected] .
 
 
 Please review our Candidate Privacy Notice here .
</div>

Data Engineer - Data Engineering

Explore 96+ Database engineer in San Francisco this March. Find roles across top companies and apply now to boost your career.

96 database engineer jobs In San Francisco

Data Engineer

Data Engineer (Only local to California, W2, GC and USC )

Data Engineer

Data Engineer

Sr. Data Infrastructure Engineer, Amazon Interactive Video Service (IVS)

Senior Data Engineer

Data Engineer - Data Engineering