engineer, supercomputing & distributed systems

software engineer

data engineer

ai engineer

data systems software engineer Jobs in San Francisco

data systems software engineer

engineer, supercomputing & distributed systems Jobs in San Francisco

systems engineer

Lawrence Berkeley National Laboratory

<div></div><div><p>Lawrence Berkeley National Laboratory is hiring a Data Systems Software Engineer within the Scientific Data division. In this exciting role, you will work with researchers and application scientists from the DOE Office of Science community, and faculty and students from universities both domestically and abroad, on a wide array of software development and data science issues serving the broader SciData mission.</p><p></p><p><br>
We&rsquo;re here for the same mission, to bring science solutions to the world. Join our team and YOU will play a supporting role in our goal to address global challenges! Have a high level of impact and work for an organization associated with 17 Nobel Prizes!</p><p></p><p><i><br>
Why join Berkeley Lab?</i></p><p></p><p><br>
We invest in our employees by offering a total rewards package you can count on:</p><ul><li><div>
Exceptional health and retirement benefits, including pension or 401K-style plans</div></li><li><div>
A culture where you&rsquo;ll belong - we are invested in our teams!</div></li><li><div>
In addition to accruing vacation and sick time, we also have a Winter Holiday Shutdown every year.</div></li><li><div>
Parental bonding leave (for both mothers and fathers)</div></li><li><p>
Pet insurance</p></li></ul><p></p><p><br>
You will:</p><ul><li><p>
Apply modern data management practices and tools to scientific data challenges, using current best-practices in database architectures, storage formats, query languages, and metadata standards.</p></li><li><div>
Build software tools to perform complex data engineering, analysis, and curation tasks for both long- and short-term needs using best-in-class algorithms, methodologies, and/or practices.</div></li><li><div>
Apply and follow current and effective cybersecurity practices for systems administration, data management, software development, and communications.</div></li><li><div>
Use and adapt AI (and ML) tools and practices for both the software development lifecycle and as part of delivered functionality to meet both current and future requirements of scientific teams and projects.</div></li><li><div>
Collaborate and communicate effectively within cross-functional teams including domain scientists, facility staff, and computer scientists and engineers.</div></li><li><div>
Apply state of the art software engineering techniques and principles:</div><ul><li><div>
Create tests and software documentation (both developer and user-focused).</div></li><li><div>
Optimize, debug, and maintain software once it is deployed into production.</div></li><li><div>
Employ software development lifecycle, devops and release management practices.</div></li><li><div>
Collaborate with other developers through modern tools and practices.</div></li></ul></li><li><div>
Network with senior internal and external personnel in their own area of expertise.</div></li><li><div>
Work on and resolve problems of diverse scope where analysis of data requires evaluation of identifiable factors.</div></li><li><p>
Demonstrate good judgment in selecting methods and techniques for obtaining solutions.</p></li></ul><p></p><div><br>
In addition, the Computer Systems Engineer Level 3 will:</div><ul><li><div>
Coordinate and/or lead software engineering and science teams with defining requirements and features for software systems.</div></li><li><div>
Architect and implement division-wide or cross-project data management tools, methods, or strategies to optimize data integrity, access, and scale.</div></li><li><div>
 Lead the design and development of major software systems or components, setting the technical direction and ensuring the integration of best-in-class algorithms and methodologies across multiple projects.</div></li><li><div>
Strategically evaluate, pioneer, and integrate novel AI/ML tools and agentic computing practices to deliver transformative capabilities, addressing complex, future-looking scientific requirements.</div></li><li><div>
Champion and evolve the group's software engineering standards, including testing, documentation, deployment, and operations.</div></li><li><div>
Mentor junior staff and developers, and proactively establish and nurture strategic partnerships with internal and external research teams to advance collaborative project goals.</div></li><li><div>
Establish and maintain relationships with stakeholders in the external scientific computing community.</div></li><li><div>
Present to audiences within and outside the lab.</div></li><li><div>
Work at a higher level of independence when completing assignments.</div></li><li><div>
Work on and resolve complex issues where analysis of situations or data requires an in-depth evaluation of variable factors.</div></li><li><div>
Exercise judgment in selecting methods, techniques and evaluation criteria for obtaining results.</div></li><li><div>
Determine methods and procedures on new assignments and may coordinate activities of other personnel.</div></li><li><p>
Network with key contacts outside your own area of expertise.</p></li></ul><p></p><div><br>
Requirements:</div><div>
Computer Systems Engineer Level 2:</div><ul><li><div>
Bachelor's degree and 5 years of related experience, or 3 years and a Master's degree, or three years and a PhD degree, or an equivalent combination of education and work experience.</div></li><li><div>
Familiarity with command-line and system administration tools in UNIX-based operating systems like Linux or MacOS.</div></li><li><div>
Proficiency in Python.</div></li><li><div>
Proficiency in multiple general-purpose and/or domain specific programming languages such as JavaScript, Typescript, C/C++, Java, MATLAB, R, etc.</div></li><li><div>
Familiarity with current major data storage, data management, and data analysis methodologies, tools, and frameworks, such as &quot;data lakehouse&quot; architectures.</div></li><li><div>
Experience and expertise with AI tools and frameworks, including those for agentic workflows.</div></li><li><div>
Familiarity and some experience with AI and related technologies to develop, document, test, and deploy software</div></li><li><div>
Excellent English written and oral communication.</div></li><li><div>
Strong interpersonal skills for working in a diverse team environment.</div></li><li><p>
Ability to obtain security clearance sufficient to interact with CUI and/or Classified information.</p></li></ul><p></p><div><br>
In Addition, Computer Systems Engineer Level 3:</div><ul><li><p>
Bachelor&rsquo;s degree and 8 years of related experience, or 6 years and a Master&rsquo;s degree, or three years and a PhD degree, or an equivalent combination of education and work experience.</p></li><li><div>
Demonstrated experience with the entire software development process, from requirements through design, to implementation, release and deployment.</div></li><li><div>
Experience and expertise with current major data storage, data management, and data analysis methodologies, tools, and frameworks, such as &quot;data lakehouse&quot; architectures</div></li><li><p>
Experience with AI tools and frameworks, including those for agentic workflows.</p></li></ul><p></p><p><br>
Desired skills/knowledge:</p><ul><li><p>
Experience and expertise with cybersecurity theory and practice.</p></li><li><div>
Domain expertise in chemical engineering, chemistry, physics, or a related field.</div></li><li><div>
Deep understanding of the software development lifecycle.</div></li><li><div>
Understanding of HPC and large-scale systems.</div></li><li><div>
Familiarity with orchestration platforms (kubernetes), OS systems and tools, parallel programming, databases, data management, resource management.</div></li><li><div>
Ability to troubleshoot and solve problems of diverse scope where analysis of data requires evaluation of identifiable factors.</div></li><li><p>
Ability to network with senior internal and external personnel in their own area of expertise.</p></li></ul><p></p><div><br>
In Addition, Computer Systems Engineer Level 3:</div><ul><li><p>
Experience with software project management and system administration.</p></li><li><div>
Experience leading cross-functional teams.</div></li><li><div>
Experience serving as a subject matter expert in cybersecurity practices for scientific computing, conducting security reviews, and establishing organizational standards for secure software development and data handling.</div></li><li><div>
Experience identifying and securing new collaborative opportunities and resources.</div></li><li><div>
Demonstrated ability to work effectively as part of a cross-disciplinary team.</div></li><li><div>
Ability to resolve complex issues in creative and effective ways.</div></li><li><div>
Ability to exercise judgment in selecting methods, techniques and evaluation criteria for obtaining results.</div></li><li><p>
Ability to network and collaborate with key contacts outside their own area of expertise.</p></li></ul><div></div><p><br>
Additional information:</p><ul><li><div>
Application Date: Priority consideration will be given to candidates who apply by May 1, 2026. Applications will be accepted until the job posting is removed.</div></li><li><div>
Appointment Type: This is a full-time, 1 year, term appointment with the possibility of extension or conversion to Career appointment based upon satisfactory job performance, continuing availability of funds and ongoing operational needs.</div></li><li><div>
Two openings for this position</div></li><li><div>
Salary Information:</div><ul><li><div>
The expected annual salary for the Computer Systems Engineer Level 2 position is $132,000 - $161,000, which fits into the full salary of $117,132- $197,676 depending upon the candidate&rsquo;s skills, knowledge, and abilities. This includes education, certifications, and years of experience.</div></li><li><div>
 The expected annual salary for the Computer Systems Engineer Level 3 position is $157,000 - $192,000, which fits into the full salary of $139,440- $235,308 depending upon the candidate&rsquo;s skills, knowledge, and abilities. This includes education, certifications, and years of experience.</div></li></ul></li></ul><ul><li><div>
Background Check: This position is subject to a background check. Any convictions will be evaluated to determine if they directly relate to the responsibilities and requirements of the position. Having a conviction history will not automatically disqualify an applicant from being considered for employment.</div></li><li><div>
Work Modality: Work may be performed on-site, hybrid, full-time telework. The primary location for this role is Lawrence Berkeley National Lab, 1 Cyclotron Road, Berkeley, CA. Work must be performed within the United States.</div></li><li><div>
Work Authorization: The selected incumbent for this position is required to be a U.S. Citizen at time of hire.</div></li><li><p>
Multi-level Posting: This position will be hired at a level commensurate with the business needs and the skills, knowledge, and abilities of the successful candidate.</p></li></ul><p></p><p><br>
Want to learn more about working at Berkeley Lab? Please visit: careers.lbl.gov</p><div></div><p><br>
Equal Employment Opportunity Employer:</p><p>
The foundation of Berkeley Lab is our Stewardship Values: Team Science, Service, Trust, Innovation, and Respect; and we strive to build community with these shared values and commitments. Berkeley Lab is an Equal Opportunity Employer. We heartily welcome applications from all who could contribute to the Lab's mission of leading scientific discovery, excellence, and professionalism. In support of our rich global community, all qualified applicants will be considered for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, protected veteran status, or other protected categories under State and Federal law.</p><div></div><p><br>
Misconduct Disclosure Requirement: As a condition of employment, the finalist will be required to disclose if they are subject to any final administrative or judicial decisions within the last seven years determining that they committed any misconduct, are currently being investigated for misconduct, left a position during an investigation for alleged misconduct, or have filed an appeal with a previous employer.</p></div><div></div>

Data Systems Software Engineer

Capital One

<div>Distinguished AI Engineer<p></p><p>
At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent &mdash; along with our deep experience in machine learning &mdash; position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI &amp; ML are bringing humanity and simplicity to banking. We are committed to continuing to build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build.</p><p></p><p><b>
Team Description:</b></p><p></p><p>
The Intelligent Foundations and Experiences (IFX) team is at the center of bringing our vision for AI at Capital One to life. We work hand-in-hand with our partners across the company to advance the state of the art in science and AI engineering, and we build and deploy proprietary solutions that are central to our business and deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance their products with the transformative power of AI, in responsible and scalable ways for the highest leverage impact.</p><p><b><br>
In this role, you will:</b></p><p></p><ul><li><p>
Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.</p></li></ul><p></p><ul><li><p>
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.</p></li></ul><p></p><ul><li><p>
Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.</p></li></ul><p></p><ul><li><p>
Invent and introduce state-of-the-art LLM optimization techniques to improve the performance &mdash; scalability, cost, latency, throughput &mdash; of large scale production AI systems.</p></li></ul><p></p><ul><li><p>
Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.</p></li></ul><p></p><p>
The Ideal Candidate:</p><p></p><ul><li><p>
You love to build systems, take pride in the quality of your work, and also share our passion to do the right thing. You want to work on problems that will help change banking for good.</p></li></ul><p></p><ul><li><p>
Passion for staying abreast of the latest research, and an ability to intuitively understand scientific publications and judiciously apply novel techniques in production.</p></li></ul><p></p><ul><li><p>
You adapt quickly and thrive on bringing clarity to big, undefined problems. You love asking questions and digging deep to uncover the root of problems and can articulate your findings concisely with clarity. You have the courage to share new ideas even when they are unproven.</p></li></ul><p></p><ul><li><p>
You are deeply Technical. You possess a strong foundation in engineering and mathematics, and your expertise in hardware, software, and AI enable you to see and exploit optimization opportunities that others miss.</p></li></ul><p></p><ul><li><p>
You are a resilient trail blazer who can forge new paths to achieve business goals when the route is unknown.</p></li></ul><p></p><p><b>
Basic Qualifications:</b></p><ul><li><p>
Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies</p></li><li><p>
At least 8 years of experience programming with Python, Go, Scala, or Java</p></li></ul><p></p><p><b>
Preferred Qualifications:</b></p><ul><li><p>
8 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)</p></li><li><p>
Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems</p></li><li><p>
Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level</p></li><li><p>
Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang</p></li><li><p>
Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost</p></li><li><p>
Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production</p></li><li><p>
Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers</p></li></ul><p></p><p><b><i><br>
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.</i></b></p><p></p><p>
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.</p><p></p>
McLean, VA: $269,100 - $307,200 for Distinguished AI Engineer<br>
<p></p>
New York, NY: $293,600 - $335,100 for Distinguished AI Engineer<br>
<p></p>
Richmond, VA: $244,700 - $279,200 for Distinguished AI Engineer<br>
<p></p>
San Francisco, CA: $293,600 - $335,100 for Distinguished AI Engineer<br>
<p></p>
San Jose, CA: $293,600 - $335,100 for Distinguished AI Engineer<p></p><p><br>
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.</p><p></p>
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<p></p><p>
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</p><p></p>
This role is expected to accept applications for a minimum of 5 business days.<p></p>
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.<p></p><p>
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.</p><p></p><p>
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com</p><p></p><p>
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.</p><p></p><p>
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</p></div>

Distinguished AI Engineer

Uber

<div>
 <strong>
  Employer:
 </strong>
 Uber Technologies, Inc.
 <br/>
 <br/>
 <strong>
  Job Title:
 </strong>
 Software Engineer
 <br/>
 <br/>
 <strong>
  Job Location:
 </strong>
 San Francisco, California
 <br/>
 <br/>
 <strong>
  Job Type:
 </strong>
 Full Time
 <br/>
 <br/>
 <strong>
  Rate of Pay:
 </strong>
 $198,000 to $242,000 per year
 <br/>
 <br/>
 You will be eligible to participate in Uber's bonus program, and may be offered other types of comp. You will also be eligible for various benefits. More details can be found at the following link https://www.uber.com/careers/benefits .
 <br/>
 <br/>
 <strong>
  Duties:
 </strong>
 Design, develop, and test software applications. Design, develop, and/or test software applications using company technology stack. Apply technical knowledge to evaluate complex data, developments, and projects in order to provide recommendations to resolve technical issues. Support the company's business operations and improve engineering productivity. Build software components that can be integrated into a fully functional software system. Solve production issues in product and system reliability. May telecommute.
 <br/>
 <br/>
 Employer will accept a Bachelor's degree in Computer Science, Engineering (Any), Information Technology, Mathematics, Physics, or related field, and two years of experience in the job offered or related occupation.
 <br/>
 <br/>
 <strong>
  Position Requires Two Years In
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   C++, Python, Java, Go, GIT, or SVN;
  </li>
  <li>
   SQL or MySQL;
  </li>
  <li>
   Data structures and algorithms development and functionality;
  </li>
  <li>
   Designing technology stacks;
  </li>
  <li>
   Debugging and monitoring for production services;
  </li>
  <li>
   Distributed systems;
  </li>
  <li>
   Software Development Lifecycle;
  </li>
  <li>
   Product development;
  </li>
  <li>
   Machine Learning;
  </li>
  <li>
   Working with Design, Data Science, and Product teams.
  </li>
 </ul>
</div>


Software Engineer

Shields Group Search

<div>
 <p>
  <strong>
   Machine Learning Engineer: LLM Interpretability &amp; Systems
  </strong>
 </p>
 <p>
  <strong>
   Location:
  </strong>
  San Francisco, CA - 5 days a week onsite
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   About Our Client &amp; The Mission
  </strong>
 </p>
 <p>
  We are partnering with a San Francisco-based AI company pushing open-source Large Language Models beyond what most teams think is possible. They do not just prompt models. They open the black box. By leveraging cutting-edge interpretability techniques (XAI), they manipulate model internals to push open-source models to rival and beat Frontier models in both capability and cost-efficiency.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   They are primarily looking for a highly driven Machine Learning Engineer who can take complex, cutting-edge XAI research and translate it into robust, deployable production systems.
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   The Role
  </strong>
 </p>
 <p>
  This is not a prompt engineering or RAG-wrapper position. You will be operating deep within the stack, interacting directly with model weights, activations, and architectures. Your mandate is simple but exceptionally difficult: state exactly how a model can be improved for a specific purpose using interpretability, and then build the system to do it.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   What You Will Do:
  </strong>
 </p>
 <ul>
  <li>
   <strong>
    Translate Research to Production:
   </strong>
   Take and improve the latest papers in mechanistic interpretability, activation engineering, and representation engineering and turn them into scalable production code.
  </li>
  <li>
   <strong>
    Model Surgery:
   </strong>
   Apply techniques like control vectors, activation patching, and feature extraction to fundamentally alter and enhance model capabilities.
  </li>
  <li>
   <strong>
    Maximize Open-Source:
   </strong>
   Squeeze every ounce of performance out of open-weight models to make them hyper-efficient and highly competitive against closed-source Frontier models.
  </li>
  <li>
   <strong>
    Build the Pipeline:
   </strong>
   Design and implement the infrastructure required to deploy these modified, highly-optimized models into production environments.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Who You Are
  </strong>
 </p>
 <ul>
  <li>
   <strong>
    Deep Technical Fundamentals:
   </strong>
   You possess a rigorous understanding of Transformer architectures, PyTorch internals, and the mathematical foundations of deep learning.
  </li>
  <li>
   <strong>
    Beyond the API:
   </strong>
   You have hands-on experience training, fine-tuning, and dissecting LLMs. You understand the difference between superficial augmentation and structural model improvement.
  </li>
  <li>
   <strong>
    High Agency &amp; Conviction:
   </strong>
   You do not wait for tasks to be assigned. You identify bottlenecks, propose deeply technical solutions, and execute them with absolute conviction.
  </li>
  <li>
   <strong>
    Mission-Obsessed:
   </strong>
   You are fundamentally aligned with the mission to democratize state-of-the-art AI capabilities through open-source optimization.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   The Anti-Persona (Who this role is NOT for)
  </strong>
 </p>
 <p>
  If your primary experience involves calling the OpenAI API, chaining together prompts with LangChain, or building standard RAG pipelines without touching the underlying model infrastructure, this role is not a fit. We need someone who can go into the matrix, not just interact with the interface.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   What We Offer
  </strong>
 </p>
 <ul>
  <li>
   <strong>
    Aggressive Equity &amp; Compensation:
   </strong>
   Highly competitive salaries and significant equity stakes to incentivize the hard work required. $180-260K, 0.5-1% equity
  </li>
  <li>
   <strong>
    Impact:
   </strong>
   Pioneering work at the intersection of XAI and production engineering, directly shaping the capabilities of the core product.
  </li>
  <li>
   <strong>
    Autonomy:
   </strong>
   A high-trust environment where technical conviction is valued and supported.
  </li>
 </ul>
</div>


Machine Learning Engineer

KREA

<div><p><b>About Krea</b></p><p>
At Krea, we are building next-generation AI creative tools.</p><p>
We are dedicated to making AI intuitive and controllable for creatives. Our mission is to build tools that empower human creativity, not replace it.</p><p>
We believe AI is a new medium that allows us to express ourselves through various formats&mdash;text, images, video, sound, and even 3D. We're building better, smarter, and more controllable tools to harness this medium.</p><p></p><p><b>
Supercomputing / AI Infra at Krea</b></p><p>
We build and operate the infrastructure for Krea's research and inference. Distributed training, 1000+ K8s GPU clusters, petabyte scale data pipelines, etc. We build a lot of this from scratch &mdash; custom distributed datastores, job orchestration systems, and streaming pipelines that replace tools like Kafka and Ray for modern AI workloads at scale.</p><p></p><p><b>
Example projects:</b></p><p><i>
Distributed data systems</i></p><ul><li><p>
Design multi-stage pipelines that turn petabytes of raw data into clean, annotated datasets</p></li><li><p>
Run classification models on billions of images</p></li><li><p>
Deploy and combine LLMs to caption massive multimedia data</p></li></ul><p><i>
GPU infrastructure</i></p><ul><li><p>
Manage distributed training and inference on 1000+ GPU Kubernetes clusters</p></li><li><p>
Solve orchestration and scaling for large-scale GPU job processing</p></li><li><p>
Scale workloads and research between clusters in multiple datacenters</p></li></ul><p><i>
Distributed training</i></p><ul><li><p>
Profile and optimize dataloaders streaming thousands of images per second</p></li><li><p>
Profile and debug InfiniBand networking on huge training runs</p></li><li><p>
Build fault tolerance systems for large-scale pretraining</p></li><li><p>
Collaborate with researchers on evolving RL infrastructure</p></li></ul><p><i>
Applied ML pipelines</i></p><ul><li><p>
Find clean scenes in millions of videos using distributed shot-boundary detection</p></li><li><p>
Customize and train models to filter billions of images for questions like &quot;is this a screenshot?&quot;</p></li><li><p>
Build the systems that bridge raw cluster capacity and research output</p></li></ul><p></p><p><b>
Who we're looking for:</b></p><p>
Systems people. If you've read a blog post about InfiniBand debugging or building a custom distributed database and thought &quot;I want to do that&quot; &mdash; this is that team.</p><p>
You'll spend your time working heavily with Python, Kubernetes, Torch, and data tools like DuckDB, Arrow, etc. It's OK if you don't have K8s or ML experience &mdash; the main thing we hire for is an intuition for distributed systems, and a great mental model of how systems interact and function under different conditions.</p><p></p><p><b>
Strong candidates may have experience with&hellip;</b></p><ul><li><p>
Python, PyArrow, DuckDB, SQL, massive relational databases, PyTorch, Pandas, NumPy&hellip;</p></li><li><p>
Kubernetes</p></li><li><p>
Designing and implementing large-scale ETL systems</p></li><li><p>
Fundamental knowledge of containerization, operating systems, file-systems, and networking</p></li><li><p>
Distributed systems design</p></li><li><p>
Distributed training systems (NCCL, InfiniBand, RDMA)</p></li><li><p>
Streaming and event processing systems (Kafka, Pulsar, or similar)</p></li><li><p>
PyTorch internals, custom dataloaders, and training infrastructure</p></li></ul></div><p></p>

Engineer, Supercomputing & Distributed Systems

Coinbase

<div><div><p>Ready to be pushed beyond what you think you're capable of?</p>
<p>
At Coinbase, our mission is to increase economic freedom in the world. It's a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform &mdash; and with it, the future global financial system.</p>
<p>
To achieve our mission, we're seeking a very specific candidate. We want someone who is passionate about our mission and who believes in the power of crypto and blockchain technology to update the financial system. We want someone who is eager to leave their mark on the world, who relishes the pressure and privilege of working with high caliber colleagues, and who actively seeks feedback to keep leveling up. We want someone who will run towards, not away from, solving the company's hardest problems.</p>
<p>
Our work culture is intense and isn't for everyone. But if you want to build the future alongside others who excel in their disciplines and expect the same from you, there's no better place to be.</p>
<p>
While many roles at Coinbase are remote-first, we are not remote-only. In-person participation is required throughout the year. Team and company-wide offsites are held multiple times annually to foster collaboration, connection, and alignment. Attendance is expected and fully supported.</p></div><p>
We're looking for a Senior Software Engineer to join the Blockchain Data Storage team!</p>
<p>
Our team has built the fundamental Web3 infrastructure, the data layer, by delivering an open-source, industry-leading suite of data availability solutions, ChainStack, to ensure efficient and scalable access. ChainStack is designed to ingest, index, and parse vast amounts of crypto data with minimal latency, providing a comprehensive solution to a widespread industry challenge. Come join us!</p>
<p><b>
What you'll be doing:</b></p>
<ul>
<li>Architect and develop distributed systems</li>
<li>Provide technical structure to teams and work closely with management and stakeholders to define strategic roadmaps</li>
<li>Manage individual projects priorities, deadlines and deliverables with your technical expertise</li>
<li>Mentor and train other team members on design techniques and coding standards</li>
<li>Design and implement foundational infrastructure components used by every engineering team in production (e.g. dynamic configuration, secrets storage, container orchestration, etc)</li>
<li>Write high quality, well tested code to meet the needs of your customers</li>
</ul>
<p><b>What we look for in you:</b></p>
<ul>
<li>5+ years of experience in software engineering</li>
<li>Very strong in distributed systems or data systems. If you are experienced with Crypto, it's a big plus!</li>
<li>You've experienced architecting and developing solutions to ambiguous problems with significant impact</li>
<li>You're passionate about building an indexing platform that brings the Web3 and Web2 world together</li>
<li>Demonstrates the ability to responsibly use generative AI tools and copilots (e.g., LibreChat, Gemini, Glean) in daily workflows, continuously learn as tools evolve, and apply human-in-the-loop practices to deliver business-ready outputs and drive measurable improvements in efficiency, cost, and quality.</li>
</ul>
<p><b> Nice to haves:</b></p>
<ul>
<li>You have gone through a rapid growth in your company (from 10 to 100s of engineers)</li>
<li>You have experience with Blockchains (such as Bitcoin, Ethereum etc.)</li>
<li>You have experience decomposing a large monolith into microservices</li>
<li>You've worked with Golang, Kafka, Redis, S3, Clickhouse, MongoDB</li>
<li>You've built financial, high reliability or security system</li>
</ul>
<p>Job #: P74888</p>
<div></div><div><p>
Please be advised that each candidate may submit a maximum of four applications within any 30-day period. We encourage you to carefully evaluate how your skills and interests align with Coinbase's roles before applying.</p>
<h3 class="jobSectionHeader"><b>
Commitment to Equal Opportunity</b></h3>
<p>
Coinbase is proud to be an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, creed, gender, national origin, age, disability, veteran status, sex, gender expression or identity, sexual orientation or any other basis protected by applicable law. Coinbase will also consider for employment qualified applicants with criminal histories in a manner consistent with applicable federal, state and local law. For US applicants, you may view the Employee Rights and the Know Your Rights notices by clicking on their corresponding links. Additionally, Coinbase participates in the E-Verify program in certain locations, as required by law.</p>
<p>
Coinbase is also committed to providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process, please contact us at accommodations[at]coinbase.com to let us know the nature of your request and your contact information. For quick access to screen reading technology compatible with this site click here to download a free compatible screen reader (free step by step tutorial can be found here).</p>
<h3 class="jobSectionHeader"><b>
Global Data Privacy Notice for Job Candidates and Applicants</b></h3>
<p>
Depending on your location, the General Data Protection Regulation (GDPR) and California Consumer Privacy Act (CCPA) may regulate the way we manage the data of job applicants. Our full notice outlining how data will be processed as part of the application procedure for applicable locations is available here. By submitting your application, you are agreeing to our use and processing of your data as required. For US applicants only, by submitting your application you are agreeing to arbitration of disputes as outlined here.
</p><h3 class="jobSectionHeader"><b>AI Disclosure</b></h3>
<p><i>
For select roles, Coinbase is piloting an AI tool based on machine learning technologies to conduct initial screening interviews to qualified applicants. The tool simulates realistic interview scenarios and engages in dynamic conversation. A human recruiter will review your interview responses, provided in the form of a voice recording and/or transcript, to assess them against the qualifications and characteristics outlined in the job description.
</i></p><p><i>For select roles, Coinbase is also piloting an AI interview intelligence platform to transcribe and summarize interview notes, allowing our interviewers to fully focus on you as the candidate.</i></p>
<p><b><i>
The above pilots are for testing purposes and Coinbase will not use AI to make decisions impacting employment</i></b><i>. To request a reasonable accommodation due to disability, please contact accommodations[at]coinbase.com</i></p></div></div><p></p>

Senior Software Engineer, Blockchain Data Storage

Whatnot

<div>
 <strong>
  <strong>
   🚀 Join the Future of Commerce with Whatnot!
   <br/>
   <br/>
  </strong>
 </strong>
 Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it's trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We're building live commerce at a scale that's never been done in the West, and there's no playbook to copy. The people here are shaping how an entirely new industry develops.
 <br/>
 <br/>
 As a remote co-located team, we're inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact.
 <br/>
 <br/>
 We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce.
 <br/>
 <br/>
 <strong>
  💻 Role
  <br/>
  <br/>
 </strong>
 At Whatnot data engineers build foundational data systems that power product development, experimentation, machine learning, and operational decision-making across the company. As an Data Engineer on the Notifications Platform, you will play a critical role in owning and evolving one of the highest-volume and highest-impact data domains at Whatnot.
 <br/>
 <br/>
 Notifications generate hundreds of millions of events per day, and the underlying data systems support everything from ML iteration and experimentation to adhoc engineering debugging. In this role, you will define the technical direction for the Notifications data mart, harden it to production-grade reliability, and set new patterns for domain-owned data engineering.
 <br/>
 <br/>
 Working in a highly cross-functional role, you will collaborate closely with Product Engineers, Data Scientists, ML Engineers, and the Analytics Platform team. You&rsquo;ll make key architectural decisions around data modeling, reliability, latency, and cost &mdash; and then make them real.
 <br/>
 <br/>
 <strong>
  On Any Given Day, You Will
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Own data architecture end-to-end. Define how we capture, model, and serve critical business data&mdash;then implement it in production. You&rsquo;ll make architectural decisions around storage formats, compute patterns, and SLAs that balance cost, scalability, and consistency.
  </li>
  <li>
   Build mission-critical pipelines. Develop and operate batch data workflows that process high-volume events related to notifications with tight guarantees for latency, completeness, and accuracy.
  </li>
  <li>
   Design and implement canonical models. Create domain-oriented data models that serve as the source of truth for analytics, ML, and production applications. Establish and enforce modeling standards, ownership boundaries, and data contracts across teams.
  </li>
  <li>
   Enforce data quality at scale. Build tests, lineage, monitoring, and reconciliation systems that make every dataset observable and every anomaly actionable.
  </li>
  <li>
   Automate operational workflows. Partner with business systems and platform teams to eliminate manual data handoffs and reconcile data across services, warehouses, and external systems.
  </li>
  <li>
   Enable insights and experimentation. Support analytics, ML, and product engineering teams by exposing high-quality, self-healing, maintainable data assets.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  We offer flexibility to work from home or from one of our global office hubs, and we value in-person time for planning, problem-solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs.
  <br/>
  <br/>
 </strong>
 <strong>
  👋 You
  <br/>
  <br/>
 </strong>
 Curious about who thrives at Whatnot? We&rsquo;ve found that embodying a low ego, growth mindset, and high-impact drive goes a long way here.
 <br/>
 <br/>
 As our next Data Engineer, you bring deep experience designing reliable, scalable data systems and are excited to take true ownership of a complex product domain.
 <br/>
 <br/>
 You should have 5+ years of experience in the data or software engineering domain, plus:
 <br/>
 <br/>
 <ul>
  <li>
   Strong experience building and maintaining production-grade data pipelines with clear SLAs, monitoring, and alerting
  </li>
  <li>
   Deep expertise in SQL, including complex model graphs, dependency management, and performance optimization
  </li>
  <li>
   Are comfortable writing production-grade code in Python or SQL languages, and integrating with CI/CD and infrastructure-as-code workflows.
  </li>
  <li>
   Have deep hands-on expertise with modern data tooling across ingestion (e.g., Kafka, Debezium), transformation (dbt, Spark, Flink), orchestration (Dagster, Airflow), and observability (Monte Carlo, Great Expectations).
  </li>
  <li>
   Have operated cloud data warehouses such as Snowflake, BigQuery, or Redshift, including schema design, cost optimization, and workload tuning.
  </li>
  <li>
   Proven track record working with large-scale datasets (hundreds of millions of rows per day)
  </li>
  <li>
   Experience designing data models that balance analytics, ML, and operational debugging use cases
  </li>
  <li>
   Strong systems thinking &mdash; you consider correctness, latency, cost, and maintainability together
  </li>
  <li>
   Self-starter ethic, thriving under a high level of autonomy
  </li>
  <li>
   Exceptional interpersonal and communication skills in cross-functional environments
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  💰Compensation For Full-Time (Salary)
  <br/>
  <br/>
 </strong>
 <strong>
  US based applicants:
 </strong>
 $195,000/year to $230,000/year + benefits + equity.
 <br/>
 <br/>
 The salary range may be inclusive of several levels that would be applicable to the position. Final salary will be based on a number of factors including, level, relevant prior experience, skills, and expertise. This range is only inclusive of base salary, not benefits (more details below) or equity.
 <br/>
 <br/>
 <strong>
  🎁 Benefits
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Generous Holiday and Time off Policy
  </li>
  <li>
   Health Insurance options including Medical, Dental, Vision
  </li>
  <li>
   Work From Home Support
  </li>
  <ul>
   <li>
    Home office setup allowance
   </li>
   <li>
    Monthly allowance for cell phone and internet
   </li>
  </ul>
  <li>
   Care benefits
  </li>
  <ul>
   <li>
    Monthly allowance for wellness
   </li>
   <li>
    Annual allowance towards Childcare
   </li>
   <li>
    Lifetime benefit for family planning, such as adoption or fertility expenses
   </li>
  </ul>
  <li>
   Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
  </li>
  <li>
   Monthly allowance to dogfood the app
  </li>
  <ul>
   <li>
    All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
   </li>
  </ul>
  <li>
   Parental Leave
  </li>
  <ul>
   <li>
    16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.
   </li>
  </ul>
 </ul>
 <strong>
  <strong>
   💛 EOE
   <br/>
   <br/>
  </strong>
 </strong>
 Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce.
 <br/>
 <br/>
 Compensation Range: $180K - $260K
 <br/>
 <br/>
</div>


Data Engineer, Notifications

Explore 298+ Systems engineer in San Francisco this April. Find roles across top companies and apply now to boost your career.