software engineer

data engineer

machine learning engineer Jobs in San Francisco

machine learning engineer

data scientist, product analytics Jobs in San Francisco

data scientist, product analytics

senior data engineer Jobs in San Francisco

senior data engineer

data platform engineer

SS&C

<div><div>As a leading financial services and healthcare technology company based on revenue, SS&amp;C is headquartered in Windsor, Connecticut, and has 27,000+ employees in 35 countries. Some 20,000 financial services and healthcare organizations, from the world's largest companies to small and mid-market firms, rely on SS&amp;C for expertise, scale, and technology.</div><div></div><div>
Job Description</div><div></div><div>
Lead Data Engineer (SS&amp;C Technologies, Inc.; San Francisco, CA): The Lead Data Engineer is based at SS&amp;C&rsquo;s office in San Francisco, CA with a telecommuting benefit. The incumbent must reside within commuting distance from SS&amp;C&rsquo;s San Francisco office. The Data Engineer will join a team that creates a leading cloud platform with the latest big data, cloud native and machine learning technologies. Specific responsibilities will include: Build and implement models in a production environment for a revenue-driving product; Create and maintain overall optimal data pipeline architecture; Assemble large, complex data sets that meet functional / non-functional business requirements; Manage data migrations/conversions and troubleshooting data processing issues; Create the pipeline for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources; Build large scale data platform infrastructures to power other products; Lead a squad (feature team) to deliver strategic client features including data movement and data synchronization; and Work with other architect engineers to propose architecture designs that will solve a business problem with bigger impact and reduce technical debts in the long run.</div><div></div><div>
Minimum requirements: Master&rsquo;s degree or foreign equivalent in Computer Science, Data Analytics, Information Technology Management, or related field, plus 3 years of pre- or post-Master&rsquo;s experience in any occupation in which the required experience is gained.</div><div></div><div>
Alternate Education and Experience: Bachelor&rsquo;s degree or foreign equivalent in Computer Science, Data Analytics, Information Technology Management, or related field, plus 6 years of experience in any occupation in which the required experience is gained.</div><div></div><div>
Must have: Master programming skills in Python and SQL. Deep knowledge of big data platforms technologies including Spark, Hive, Airflow, Data Hub, Delta Lake or Iceberg. Strong algorithm &amp; data structure basis. Experience leading a team technically to deliver large business features. Great architecture principles and decision-making skills. Strong problem-solving skills with a can-do attitude. Great software engineering best practices with git and version control systems. Solid communication skills to explain complex data pipelines to both technical and non-technical people. Excellent writing and documenting skills.</div><div></div><div>
Salary: $194,834.00 to $210,000.00 per year.</div><div></div><div>
Apply online at <div>https://www.ssctech.com/about-us/careers</div> or send resume to: Angela Lamar, Talent Acquisition, SS&amp;C Technologies, Inc., <div>alamar@sscinc.com</div>. Ref: 00087619. An EOE.</div><div></div><div>
#LI-DNI</div><div></div><div>
Unless explicitly requested or approached by SS&amp;C Technologies, Inc. or any of its affiliated companies, the company will not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services.</div>
SS&amp;C offers excellent benefits including health, dental, 401k plan, tuition and professional development reimbursement plan.<div>
SS&amp;C Technologies is an Equal Employment Opportunity employer and does not discriminate against any applicant for employment or employee on the basis of race, color, religious creed, gender, age, marital status, sexual orientation, national origin, disability, veteran status or any other classification protected by applicable discrimination laws.</div><div></div>
Salary is determined by various factors including, but not limited to, relevant work experience, job related knowledge, skills, abilities, business needs, and geographic regions.<div></div>
California: Salary range for the position: 194,834 USD to 210,000 USD.</div><div></div>

Lead Data Engineer (SS&C Technologies, Inc.; San Francisco, CA): Ref 00087619

Qcells

<div><p><b>Description</b>
</p><h3 class="jobSectionHeader"><b>POSITION DESCRIPTION:</b></h3><p>
We are seeking a <b>Lead Data Engineer</b> to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational systems, and establishing robust data models within a modern lakehouse architecture.</p><p>
The ideal candidate brings deep SQL and Python expertise, extensive experience with distributed data platforms, and strong knowledge of data architecture, governance, and performance optimization. This individual will serve as a technical leader and mentor, partnering closely with architects, analysts, application teams, and business stakeholders to deliver reliable, scalable, and well-governed enterprise data solutions.</p><h3 class="jobSectionHeader"><b>
RESPONSIBILITIES</b></h3><ul><li>
Lead the design, development, and optimization of scalable data pipelines supporting ingestion, transformation, and enterprise-wide data consumption.</li><li>
Architect and implement enterprise-grade ETL/ELT frameworks using Azure Fabric or comparable cloud data platforms.</li><li>
Oversee and optimize data integrations from ERP (NetSuite/SAP), CRM (Salesforce), internal systems, APIs, and third-party data sources.</li><li>
Design and govern high-quality, scalable data models supporting analytics, reporting, operational systems, and advanced use cases.</li><li>
Partner with Data Architects to define and implement lakehouse patterns, Delta Lake strategies, medallion architecture, and domain-driven design principles.</li><li>
Establish and enforce data quality frameworks, validation standards, lineage tracking, and observability practices.</li><li>
Drive performance optimization, scalability, reliability, and cost governance across cloud environments.</li><li>
Provide technical leadership and mentorship to data engineers; conduct design reviews and enforce engineering best practices.</li><li>
Collaborate cross-functionally with analysts, application teams, and business stakeholders to translate requirements into scalable data solutions.</li><li>
Lead MDM, metadata management, governance, and data standardization initiatives.</li><li>
Oversee CI/CD automation, DevOps integration, testing frameworks, and monitoring strategies for data workflows.</li><li>
Evaluate emerging technologies and recommend platform improvements aligned with enterprise strategy.</li></ul><h3 class="jobSectionHeader"><b>
MINIMUM QUALIFICATIONS</b></h3><ul><li>
10+ years of experience in data engineering, data architecture, or related roles.</li><li>
Proven experience leading large-scale data platform initiatives in cloud environments.</li><li>
Extensive hands-on experience with Azure data services (Data Lake, Data Factory, Fabric, Synapse, or similar).</li><li>
Advanced proficiency in SQL and Python; experience with Spark or distributed processing frameworks.</li><li>
Deep experience designing and implementing enterprise ETL/ELT frameworks.</li><li>
Strong expertise in data modeling (dimensional modeling, star schema, lakehouse/Delta modeling).</li><li>
Experience integrating complex enterprise systems (ERP, CRM, operational platforms).</li><li>
Strong understanding of data governance, metadata management, MDM, and data quality frameworks.</li><li>
Experience with performance tuning, workload optimization, and cloud cost management.</li><li>
Demonstrated ability to lead technical teams, conduct architecture reviews, and mentor engineers.</li><li>
Strong problem-solving, debugging, and system design skills.</li><li>
Travel may be required up to 5%, depending on business needs.</li></ul><h3 class="jobSectionHeader"><b>
PREFERRED QUALIFICATIONS</b></h3><ul><li>
Experience with Delta Tables, Snowflake, Synapse, or comparable cloud data platforms.</li><li>
Experience with event-driven and streaming architectures (Kafka, Event Hub, streaming pipelines).</li><li>
Familiarity with finance, operations, energy, or ERP-driven data domains.</li><li>
Experience designing API-based data integrations and modern integration patterns.</li><li>
Azure certifications (Data Engineer Associate, Solutions Architect, or equivalent).</li><li>
Experience enabling analytics teams, data science workflows, or ML pipelines.</li><li>
Experience implementing enterprise data security and compliance frameworks.</li></ul><br>
Hanwha Q CELLS Technologies, Inc. a subsidiary of Hanwha Q CELLS, one of the world&acute;s largest and most recognized photovoltaic manufacturers for its high-performance, high-quality solar cells and modules. It is headquartered in Seoul, South Korea (Global Executive HQ) Talheim, Germany (Technology &amp; Innovation HQ) and Santa Clara, CA, USA (HW and SW Product Development HQ). Through its growing global business network spanning Europe, North America, Asia, South America, Africa, and the Middle East, the company provides excellent services and long-term partnerships to its customers in the utility, commercial, government, and residential markets. Hanwha Q CELLS is a flagship company of Hanwha Group, a FORTUNE Global 500 firm and a Top 7 business enterprise in South Korea.<br>
<br>
<div><div><div><br>
<b>PHYSICAL, MENTAL &amp; ENVIRONMENTAL DEMANDS:</b><br>
To comply with the Rehabilitation Act of 1973 the essential physical, mental and environmental requirements for this job are listed below. These are requirements <i>normally expected</i> to perform <i>regular</i> job duties. Incumbent must be able to successfully perform all of the functions of the job with or without reasonable accommodation.</div></div><div><div><div><div><b><br>
Mobility</b></div></div><br>
<div><div><br>
Standing</div><div><br>
20% of time</div></div><br>
<div><div><br>
Sitting</div><div><br>
70% of time</div></div><br>
<div><div><br>
Walking</div><div><br>
10% of time</div></div><br>
<div><div><br>
<b>
Strength</b></div></div><br>
<div><div><br>
Pulling</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Pushing</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Carrying</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
Lifting</div><div><br>
up to 10 Pounds</div></div><br>
<div><div><br>
<b>
Dexterity</b> <b>(F = Frequently, O = Occasionally, N = Never)</b></div></div><br>
<div><div><br>
Typing</div><div><br>
F</div></div><br>
<div><div><br>
Handling</div><div><br>
F</div></div><br>
<div><div><br>
Reaching</div><div><br>
F</div></div></div><div><div><div><b><br>
Agility</b> <b>(F = Frequently, O = Occasionally, N = Never)</b></div></div><br>
<div><div><br>
Turning</div><div><br>
F</div></div><br>
<div><div><br>
Twisting</div><div><br>
F</div></div><br>
<div><div><br>
Bending</div><div><br>
O</div></div><br>
<div><div><br>
Crouching</div><div><br>
O</div></div><br>
<div><div><br>
Balancing</div><div><br>
N</div></div><br>
<div><div><br>
Climbing</div><div><br>
N</div></div><br>
<div><div><br>
Crawling</div><div><br>
N</div></div><br>
<div><div><br>
Kneeling</div><div><br>
N</div></div></div></div></div><div></div><p><br>
The salary range is required by the California Pay Transparency Act and may differ depending on the location of those candidates hired nationwide. Actual compensation is influenced by a wide array of factors including but not limited to, skill set, education, licenses and certifications, essential job duties and requirements, and the necessary experience relative to the job&rsquo;s minimum qualifications.</p>
<ul><li>This target salary range is for CA positions only and should not be interpreted as an offer of compensation.</li></ul>
You may view your privacy rights by reviewing Qcells' Privacy Policy or by contacting our HR team for a copy.</div>

Lead Data Engineer

Okta

<div><div><p><b>Get to know Okta</b><br>
<br>
Okta is The World's Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and automation, placing identity at the core of business security and growth.<br>
<br>
At Okta, we celebrate a variety of perspectives and experiences. We are not looking for someone who checks every single box - we're looking for lifelong learners and people who can make us better with their unique experiences.<br>
<br>
Join our team! We're building a world where Identity belongs to you.</p></div><div>
<div>
<h3 class="jobSectionHeader"><b>About the Team</b></h3>
<p>
The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables:</p>
<ul>
<li>Streaming analytics</li>
<li>Interactive end-user reporting</li>
<li>Data and ML platform for Okta to scale</li>
<li>Telemetry of our products and data</li>
</ul>
<p>Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever.</p>
<h3 class="jobSectionHeader"><b>
About the Position</b></h3>
<p>
This is an opportunity for experienced Software Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services &amp; data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Okta to scale for years to come. As a member of the Data Platform team, you will be responsible for designing, building, and deploying the systems that power our data analytics and ML. Our analytics infrastructure stack sits on top of many modern technologies, including Kinesis, Flink, ElasticSearch, and Snowflake.</p>
<p>
We are looking for experienced Software Engineers who can help design and own the building, deploying and optimizing the streaming infrastructure. This project has a directive from engineering leadership to make OKTA a leader in the use of data and machine learning to improve end-user security and to expand that core-competency across the rest of engineering. You will have a sizable impact on the direction, design &amp; implementation of the solutions to these problems.</p>
<h3 class="jobSectionHeader"><b>
Job Duties and Responsibilities:</b></h3>
<ul><li>Design, implement and own data-intensive, high-performance, scalable platform components</li>
<li>Work with engineering teams, architects and cross functional partners on the development of projects, design, and implementation</li>
<li>Conduct and participate in design reviews, code reviews, analysis, and performance tuning</li>
<li>Coach and mentor engineers to help scale up the engineering organization</li>
<li>Debug production issues across services and multiple levels of the stack</li>
</ul><h3 class="jobSectionHeader"><b>Required Knowledge, Skills, and Abilities:</b></h3>
<ul><li>8+ years of experience in object-oriented language, preferably Java</li>
<li>Hands-on experience using a cloud-based distributed computing technologies including</li>
<li><ul><li>Messaging systems such as Kinesis, Kafka</li>
<li>Data processing systems like Flink, Spark, Beam</li>
<li>Storage &amp; Compute systems such as Snowflake, Hadoop</li>
<li>Coordinators and schedulers like the ones in Kubernetes, Hadoop, Mesos</li>
</ul></li></ul><ul><li>Experience in developing and tuning highly scalable distributed systems</li>
<li>Excellent grasp of software engineering principles</li>
<li>Solid understanding of multithreading, garbage collection and memory management</li>
<li>Experience with reliability engineering specifically in areas such as data quality, data observability and incident management</li>
</ul><h3 class="jobSectionHeader"><b>Nice to have</b></h3>
<ul><li>Maintained security, encryption, identity management, or authentication infrastructure</li>
<li>Leveraged major public cloud providers to build mission-critical, high volume services</li>
<li>Hands-on experience in developing Data Integration applications for large scale (petabyte scale) environments with experience in both batch and online systems.</li>
<li>Contributed to the development of distributed systems or used one or more at high volume or criticality such as Kafka or Hadoop</li>
<li>Experience developing Kubernetes based services on AWS Stack</li>
</ul>
<p><b>Additional requirements:</b></p>
<ul>
<li>This position requires the ability to access federal environments and/or have access to protected federal data. As a condition of employment for this position, the successful candidate must be able to submit documentation establishing U.S. Person status (e.g. a U.S. Citizen, National, Lawful Permanent Resident, Refugee, or Asylee. 22 CFR 120.15) upon hire.</li>
</ul>
<p>This role will require travel to one of our office locations for in-person onboarding.</p>
<p>
#LI-SM1</p>
<p>
#LI-Hybrid</p>
<p>
P6808_3376756</p></div></div><p></p><div><p><b><br>
What you can look forward to as a Full-Time Okta employee!</b></p>
<ul>
<li>Amazing Benefits</li>
<li>Making Social Impact</li>
<li>Developing Talent and Fostering Connection + Community at Okta</li>
</ul>
<p>Some roles may require travel to one of our office locations for in-person onboarding.</p>
<p>
Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.
<br>
<br>
If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation.<br>
<br>
<b>Notice for New York City Applicants &amp; Employees:</b> Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please <b>click here</b> to view our full NYC AEDT Notice.<br>
<br>
Okta is committed to complying with applicable data privacy and security laws and regulations. For more information, please see our Personnel and Job Candidate Privacy Notice at https://www.okta.com/legal/personnel-policy/.</p></div></div>

Staff Software Engineer, Data Platform (FedRamp)

<div><p><b>Get to know Okta</b><br>
<br>
Okta is The World&rsquo;s Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and automation, placing identity at the core of business security and growth.<br>
<br>
At Okta, we celebrate a variety of perspectives and experiences. We are not looking for someone who checks every single box - we&rsquo;re looking for lifelong learners and people who can make us better with their unique experiences.<br>
<br>
Join our team! We&rsquo;re building a world where Identity belongs to you.</p>
<h3 class="jobSectionHeader"><b>About the Team</b></h3>
<p>
The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables:</p>
<ul><li>
Streaming analytics</li>
<li>Interactive end-user reporting</li>
<li>Data and ML platform for Okta to scale</li>
<li>Telemetry of our products and data</li>
</ul><p>
Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever.</p>
<h3 class="jobSectionHeader"><b>
About the Position</b></h3>
<p>
This is an opportunity for experienced Software Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services &amp; data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Okta to scale for years to come. As a member of the Data Platform team, you will be responsible for designing, building, and deploying the systems that power our data analytics and ML. Our analytics infrastructure stack sits on top of many modern technologies, including Kinesis, Flink, ElasticSearch, and Snowflake.</p>
<p>
We are looking for experienced Software Engineers who can help design and own the building, deploying and optimizing the streaming infrastructure. This project has a directive from engineering leadership to make OKTA a leader in the use of data and machine learning to improve end-user security and to expand that core-competency across the rest of engineering. You will have a sizable impact on the direction, design &amp; implementation of the solutions to these problems.</p>
<h3 class="jobSectionHeader"><b>
Job Duties and Responsibilities:</b></h3>
<ul><li>Design, implement and own data-intensive, high-performance, scalable platform components</li>
<li>Work with engineering teams, architects and cross functional partners on the development of projects, design, and implementation</li>
<li>Conduct and participate in design reviews, code reviews, analysis, and performance tuning</li>
<li>Coach and mentor engineers to help scale up the engineering organization</li>
<li>Debug production issues across services and multiple levels of the stack</li>
</ul><h3 class="jobSectionHeader"><b>Required Knowledge, Skills, and Abilities:</b></h3>
<ul><li>8+ years of experience in object-oriented language, preferably Java</li>
<li>Hands-on experience using a cloud-based distributed computing technologies including</li>
<li><ul><li>Messaging systems such as Kinesis, Kafka</li>
<li>Data processing systems like Flink, Spark, Beam</li>
<li>Storage &amp; Compute systems such as Snowflake, Hadoop</li>
<li>Coordinators and schedulers like the ones in Kubernetes, Hadoop, Mesos</li>
</ul></li></ul><ul><li>Experience in developing and tuning highly scalable distributed systems</li>
<li>Excellent grasp of software engineering principles</li>
<li>Solid understanding of multithreading, garbage collection and memory management</li>
<li>Experience with reliability engineering specifically in areas such as data quality, data observability and incident management</li>
</ul><h3 class="jobSectionHeader"><b>Nice to have</b></h3>
<ul><li>Maintained security, encryption, identity management, or authentication infrastructure</li>
<li>Leveraged major public cloud providers to build mission-critical, high volume services</li>
<li>Hands-on experience in developing Data Integration applications for large scale (petabyte scale) environments with experience in both batch and online systems.</li>
<li>Contributed to the development of distributed systems or used one or more at high volume or criticality such as Kafka or Hadoop</li>
<li>Experience developing Kubernetes based services on AWS Stack</li>
</ul><p><b>
Additional requirements:</b></p>
<ul><li>
This position requires the ability to access federal environments and/or have access to protected federal data. As a condition of employment for this position, the successful candidate must be able to submit documentation establishing U.S. Person status (e.g. a U.S. Citizen, National, Lawful Permanent Resident, Refugee, or Asylee. 22 CFR 120.15) upon hire.</li>
</ul><p>
This role will require travel to one of our office locations for in-person onboarding.</p>
<p>
#LI-SM1</p>
<p>
#LI-Hybrid</p>
<p>
P6808_3376756</p><p></p><p><br>
Below is the annual base salary range for candidates located in San Francisco Bay Area. Your actual base salary will depend on factors such as your skills, qualifications, experience, and work location. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental and vision insurance, 401(k), flexible spending account, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program please visit: https://rewards.okta.com/us.
</p>The annual base salary range for this position for candidates located in the San Francisco Bay area is between: $194,000&mdash;$267,000 USD<p><b>
What you can look forward to as a Full-Time Okta employee!</b></p>
<ul><li>
Amazing Benefits</li>
<li>Making Social Impact</li>
<li>Developing Talent and Fostering Connection + Community at Okta</li>
</ul><p>
Some roles may require travel to one of our office locations for in-person onboarding.</p>
<p>
Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.
<br>
<br>
If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation.<br>
<br>
<b>Notice for New York City Applicants &amp; Employees:</b> Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please<br>
<br>
Okta is committed to complying with applicable data privacy and security laws and regulations. For more information, please see our Personnel and Job Candidate Privacy Notice at https://www.okta.com/legal/personnel-policy/.</p></div>
<br><div></div><div><div><div><div><div><div>Okta
<div>The foundation for secure connections between people and technology</div>
</div></div></div><div><p>Okta is the leading independent provider of identity for the enterprise. The Okta Identity Cloud enables organizations to securely connect the right people to the right technologies at the right time. With over 7,000 pre-built integrations to applications and infrastructure providers, Okta customers can easily and securely use the best technologies for their business. More than 19,300 organizations, including JetBlue, Nordstrom, Slack, T-Mobile, Takeda, Teach for America, and Twilio, trust Okta to help protect the identities of their workforces and customers.</p></div></div></div></div><div></div>

Staff Software Engineer, Data Platform

Plaid

<div>
 We believe that the way people interact with their finances will drastically improve in the next few years. We&rsquo;re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid&rsquo;s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Washington D.C., London and Amsterdam.
 <br/>
 <br/>
 The main goal of the DE team in 2024-25 is to build robust golden data sets to power our business goals of creating more insights based products. Making data-driven decisions is key to Plaid's culture. To support that, we need to scale our data systems while maintaining correct and complete data. We provide tooling and guidance to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively. Data Engineers heavily leverage SQL and Python to build data workflows. We use tools like DBT, Airflow, Redshift, ElasticSearch, Atlanta, and Retool to orchestrate data pipelines and define workflows. We work with engineers, product managers, business intelligence, data analysts, and many other teams to build Plaid's data strategy and a data-first mindset. Our engineering culture is IC-driven -- we favor bottom-up ideation and empowerment of our incredibly talented team. We are looking for engineers who are motivated by creating impact for our consumers and customers, growing together as a team, shipping the MVP, and leaving things better than we found them.
 <br/>
 <br/>
 You will be in a high impact role that will directly enable business leaders to make faster and more informed business judgements based on the datasets you build. You will have the opportunity to carve out the ownership and scope of internal datasets and visualizations across Plaid which is a currently unowned area that we intend to take over and build SLAs on. You will have the opportunity to learn best practices and up-level your technical skills from our strong DE team and from the broader Data Platform team. You will collaborate with and have strong and cross functional partnerships with literally all teams at Plaid from Engineering to Product to Marketing/Finance etc.
 <br/>
 <br/>
 <strong>
  Responsibilities
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Understanding different aspects of the Plaid product and strategy to inform golden dataset choices, design and data usage principles.
  </li>
  <li>
   Have data quality and performance top of mind while designing datasets
  </li>
  <li>
   Advocating for adopting industry tools and practices at the right time
  </li>
  <li>
   Owning core SQL and Python data pipelines that power our data lake and data warehouse
  </li>
  <li>
   Well-documented data with defined dataset quality, uptime, and usefulness.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Qualifications
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   2+ years of dedicated data engineering experience, solving complex data pipeline issues at scale.
  </li>
  <li>
   You have experience building data models and data pipelines on top of large datasets (in the order of 500TB to petabytes)
  </li>
  <li>
   You value SQL as a flexible and extensible tool and are comfortable with modern SQL data orchestration tools like DBT, Mode, and Airflow.
  </li>
  <li>
   [Nice to have] You have experience working with different performant warehouses and data lakes; Redshift, Snowflake, Databricks
  </li>
  <li>
   [Nice to have] You have experience building and maintaining batch and real-time pipelines using technologies like Spark, Kafka.
   <br/>
   <br/>
  </li>
 </ul>
 $163,200 - $223,200 a year
 <br/>
 <br/>
 The target base salary for this position ranges from $163,200/year to $223,200/year in Zone 1. The target base salary will vary based on the job's location.
 <br/>
 <br/>
 <strong>
  Our Geographic Zones Are As Follows
  <br/>
  <br/>
 </strong>
 Zone 1 - New York City and San Francisco Bay Area
 <br/>
 <br/>
 Zone 2 - Los Angeles, Seattle, Washington D.C.
 <br/>
 <br/>
 Zone 3 - Austin, Boston, Denver, Houston, Portland, Sacramento, San Diego
 <br/>
 <br/>
 Zone 4 - Raleigh-Durham and all other US cities
 <br/>
 <br/>
 Additional compensation in the form(s) of equity and/or commission are dependent on the position offered. Plaid provides a comprehensive benefit plan, including medical, dental, vision, and 401(k). Pay is based on factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience and skillset, and location. Pay and benefits are subject to change at any time, consistent with the terms of any applicable compensation or benefit plans.
 <br/>
 <br/>
 Our mission at Plaid is to unlock financial freedom for everyone. To support that mission, we seek to build a diverse team of driven individuals who care deeply about making the financial ecosystem more equitable. We recognize that strong qualifications can come from both prior work experiences and lived experiences. We encourage you to apply to a role even if your experience doesn't fully match the job description. We are always looking for team members that will bring something unique to Plaid!
 <br/>
 <br/>
 Plaid is proud to be an equal opportunity employer and values diversity at our company. We do not discriminate based on race, color, national origin, ethnicity, religion or religious belief, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, military or veteran status, disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state, and local laws. Plaid is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance with your application or interviews due to a disability, please let us know at [email protected] .
 <br/>
 <br/>
 Please review our Candidate Privacy Notice here .
</div>


Data Engineer - Data Engineering

Adobe

<div>
 <strong>
  Our Company
  <br/>
  <br/>
 </strong>
 Changing the world through digital experiences is what Adobe&rsquo;s all about. We give everyone&mdash;from emerging artists to global brands&mdash;everything they need to design and deliver exceptional digital experiences! We&rsquo;re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.
 <br/>
 <br/>
 We&rsquo;re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!
 <br/>
 <br/>
 Adobe Customer Solutions is looking for a full time Data Engineer with experience in building data integrations using AWS technology stack as part of the team's Data as a Service portfolio for Adobe&rsquo;s Digital Experience enterprise customers.
 <br/>
 <br/>
 Customer facing Engineers who enjoy tackling complex technical challenges, have a passion for delighting customers and who are self-motivated to push themselves in a team oriented culture will thrive in our environment
 <br/>
 <br/>
 What you&rsquo;ll do
 <br/>
 <br/>
 <ul>
  <li>
   Collaborate with Data architects, Enterprise architects, Solution consultants and Product engineering teams to capture customer data integration requirements, conceptualize solutions &amp; build required technology stack
  </li>
  <li>
   Collaborate with enterprise customer's engineering team to identify data sources, profile and quantify quality of data sources, develop tools to prepare data and build data pipelines for integrating customer data sources and third party data sources with Adobe solutions
  </li>
  <li>
   Develop new features and improve existing data integrations with customer data ecosystem
  </li>
  <li>
   Encourage team to think out-of-the-box and overcome engineering obstacles while incorporating new innovative design principles.
  </li>
  <li>
   Collaborate with a Project Manager to bill and forecast time for customer solutions
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Requirements
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Experience as an enterprise Data Engineer from a consulting background
  </li>
  <li>
   AWS Certified Data Engineer &ndash; Associate or AWS Certified Cloud Practitioner
  </li>
  <li>
   5+ years experience in building/operating/maintaining fault tolerant and scalable data processing integrations using AWS
  </li>
  <li>
   7+ years experience in Python programming language preferably using PySpark
  </li>
  <li>
   Software development experience working with Apache Airflow, MongoDB, MySQL
  </li>
  <li>
   Strong capacity to manage numerous projects are a must
  </li>
  <li>
   Experience using Docker or Kubernetes is a plus
  </li>
  <li>
   BS/MS degree in Computer Science or equivalent industry experience
  </li>
  <li>
   Ability to identify and resolve problems associated with production grade large scale data processing workflows
  </li>
  <li>
   Excellent communication skills (we&rsquo;re a geographically distributed team)
  </li>
  <li>
   Experience creating and maintaining unit tests and continuous integration.
  </li>
  <li>
   Passion for creating Intelligent data pipelines that customers love to use.
   <br/>
   <br/>
  </li>
 </ul>
 Special Consideration given for
 <br/>
 <br/>
 <ul>
  <li>
   Experience &amp; knowledge with Web Analytics or Digital Marketing
  </li>
  <li>
   Experience &amp; knowledge with Customer Data Platform (CDP) or Data Management Platform (DMP)
  </li>
  <li>
   Experience &amp; knowledge with Adobe Experience Cloud solutions
   <br/>
   <br/>
  </li>
 </ul>
 Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $114,100 -- $214,950 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.
 <br/>
 <br/>
 In California, the pay range for this position is $148,500 - $214,950 In New York, the pay range for this position is $148,500 - $214,950 In Washington, the pay range for this position is $135,100 - $195,550
 <br/>
 <br/>
 At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).
 <br/>
 <br/>
 In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.
 <br/>
 <br/>
 <strong>
  State-Specific Notices:
  <br/>
  <br/>
 </strong>
 <strong>
  California:
  <br/>
  <br/>
 </strong>
 <strong>
  Fair Chance Ordinances
  <br/>
  <br/>
 </strong>
 Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and &ldquo;fair chance&rdquo; ordinances.
 <br/>
 <br/>
 <strong>
  Colorado:
  <br/>
  <br/>
 </strong>
 <strong>
  Application Window Notice
  <br/>
  <br/>
 </strong>
 If this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.
 <br/>
 <br/>
 <strong>
  Massachusetts:
  <br/>
  <br/>
 </strong>
 <strong>
  Massachusetts Legal Notice
  <br/>
  <br/>
 </strong>
 It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
 <br/>
 <br/>
 Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more.
 <br/>
 <br/>
 Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.
</div>


Data Engineer

Lumina Tech Group

<div>
 <p>
  <strong>
   About the Role
  </strong>
 </p>
 <p>
  We partner with hundreds of high-growth companies to build tools that solve complex problems at scale.
 </p>
 <p>
  We&rsquo;re looking for a product-minded engineer to help build impactful products used by thousands of users. This is an opportunity to work on systems that influence one of the largest markets in the world.
 </p>
 <p>
  You&rsquo;ll have end-to-end ownership across product and engineering, working with valuable proprietary datasets to build scalable solutions.
 </p>
 <p>
  <strong>
   What You&rsquo;ll Work On
  </strong>
 </p>
 <ul>
  <li>
   Intelligently matching millions of users and organizations using unique proprietary data
  </li>
  <li>
   Designing incentive systems that improve collaboration and platform engagement
  </li>
  <li>
   Building core tooling to power user workflows, including AI note-taking, email sequencing, browser extensions, and related tools
  </li>
  <li>
   Creating new ways for users to discover opportunities and connections
  </li>
  <li>
   Developing creative strategies to drive marketplace liquidity across industries such as Legal, Finance, and Healthcare
  </li>
 </ul>
 <p>
  <strong>
   What We&rsquo;re Looking For
  </strong>
 </p>
 <ul>
  <li>
   Product-minded engineer with strong ownership and execution skills
  </li>
  <li>
   Ability to work across the stack, with a lean toward product engineering
  </li>
  <li>
   Strong problem-solving ability, sound judgment, and high EQ
  </li>
  <li>
   Interest in building user-facing products in a fast-moving environment
  </li>
  <li>
   Excited by startup intensity and the opportunity to help scale both product and team
  </li>
 </ul>
 <p>
  <strong>
   Team &amp; Opportunity
  </strong>
 </p>
 <ul>
  <li>
   Small, high-talent-density engineering team with plans to grow significantly
  </li>
  <li>
   Open to both junior and senior candidates
  </li>
  <li>
   Looking for engineers who can contribute to both building product and shaping culture
  </li>
  <li>
   High ownership environment with direct impact on company growth and product direction
  </li>
 </ul>
 <p>
  <strong>
   Compensation &amp; Benefits
  </strong>
 </p>
 <ul>
  <li>
   Salary:
   <strong>
    $150,000 &ndash; $275,000
   </strong>
  </li>
  <li>
   Competitive equity
  </li>
  <li>
   Relocation support available
  </li>
  <li>
   Visa sponsorship on a case-by-case basis
  </li>
  <li>
   Unlimited PTO
  </li>
  <li>
   Gym membership
  </li>
  <li>
   Global offsites
  </li>
  <li>
   Meals covered
  </li>
 </ul>
 <p>
  <strong>
   Location
  </strong>
 </p>
 <ul>
  <li>
   Onsite in
   <strong>
    San Francisco
   </strong>
  </li>
 </ul>
 <p>
  <strong>
   Why Join
  </strong>
 </p>
 <ul>
  <li>
   Build impactful products powered by AI and large-scale data
  </li>
  <li>
   Join a lean engineering team where individual impact is high
  </li>
  <li>
   Work on meaningful user problems at the intersection of software, marketplaces, and modern infrastructure
  </li>
 </ul>
 <p>
 </p>
</div>


Software Engineer

Explore 352+ Data platform engineer in San Francisco this March. Find roles across top companies and apply now to boost your career.