software engineer

ai engineer

ai engineer – remote work Jobs in San Francisco

ai engineer – remote work

backend software engineer Jobs in San Francisco

backend software engineer

data infrastructure engineer Jobs in San Francisco

data infrastructure engineer

infrastructure engineer

Alljoined

<div><h2 class="jobSectionHeader">About Alljoined</h2>
Alljoined is creating a future where humans are fully understood and augmented by technology. Our work solves the communication bottleneck between humans and computers by decoding thoughts from the brain, entirely non-invasively. We apply deep learning research to large scale EEG datasets to decode multimedia input, eventually moving to internal thought. We are state-of-the art in capabilities and are fully vertically integrated. Our goal is to develop a general consumer interface to completely transform how we can live our lives.
We are actively growing our founding engineering team to build the underlying infrastructure that makes this ambitious future a reality.<h2 class="jobSectionHeader">
About the Role
</h2>As a Data Infrastructure Engineer, you will build the backend and hardware architecture that allows us to do high-quality and fast research. You'll be owning our entire data lifecycle, from building pipelines that process massive multimodal datasets (video, audio, text, time-series) to provisioning and managing both cloud and bare metal compute clusters we use to train on it. You will be powering our foundational model training by bridging the gap between physical neuro hardware and our central repositories, working alongside world-class researchers to ensure they have a high-throughput, low-latency pipeline straight to the GPUs.<h2 class="jobSectionHeader">
You might be a good fit if you</h2><ul><li>
Have 3+ years of production software engineering experience with deep expertise in systems-level architecture and languages like Python, Rust, C++, or Go.</li><li>
Have built and maintained high-performance ETL pipelines capable of processing, buffering, and storing terabytes of daily unstructured data.</li><li>
Are comfortable architecting, provisioning, and maintaining bare-metal local compute clusters, storage servers, and high-speed networking for intensive ML workloads.</li><li>
Have a background in handling continuous, highly concurrent data streams from heterogeneous hardware peripherals without data loss.</li><li>
Are capable of working across hybrid environments to define storage topologies, manage databases (TimescaleDB, ClickHouse), and sync massive datasets between on-premise edge servers and the cloud (AWS/GCP/Azure).</li><li>
Enjoy owning the entire technical lifecycle of infrastructure, from optimizing low-level I/O bound operations to production deployment.</li></ul><h2 class="jobSectionHeader">
Strong candidates may have</h2><ul><li>
A deep understanding of modern ML frameworks (PyTorch/TensorFlow) and know how to build datasets that maximize and saturate GPU utilization.</li><li>
Experience managing networking for distributed GPU training (InfiniBand, RoCE) or optimizing zero-copy networking and shared memory.</li><li>
Built infrastructure involving programmatic video processing (FFmpeg, GStreamer, OpenCV)
</li></ul><h2 class="jobSectionHeader">Compensation Range</h2>
$140,000 - $180,000/year
While this represents our expected range based on market data, final compensation will be determined based on your specific skills and experience and may be outside this range.<h2 class="jobSectionHeader">
Benefits</h2><ul><li>
Competitive equity compensation at a seed stage startup</li><li>
Options for housing support</li><li>
Visa sponsorship</li><li>
3% 401k matching</li><li>
Health insurance</li></ul>
Compensation Range: $140K - $180K</div>

Data Infrastructure Engineer

Amazon Web Services

<div><h2 class="jobSectionHeader">DESCRIPTION</h2><div>
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we&rsquo;re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain &mdash; and we&rsquo;re looking for talented people who want to help. 
 
You&rsquo;ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You&rsquo;ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you&rsquo;ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. 
 
Amazon Interactive Video Service (Amazon IVS) is AWS's fully managed live streaming service, built on the same battle-tested technology that powers Twitch and trusted by thousands of enterprises across gaming, social, live commerce, sports, and entertainment.
 
 
Our mission: enable developers to build communities around live video. We handle everything from ingest to processing to delivery at global scale, so developers can focus on creating interactive, engaging live experiences for their audiences. Whether you're streaming to tens of millions of concurrent viewers or just getting started, Amazon IVS removes the complexity so developers can move fast. 
 
As a Data Infrastructure Engineer, you will be responsible for empowering internal teams and IVS customers with the data they need to make key operational and business decisions. We operate petabyte-scale data infrastructure for collecting, processing, and warehousing IVS data. We support streaming and batch pipelines to facilitate analytics, reporting, and ML workloads. We offer analytics tools and data products designed to make it easy and fast for our customers to extract the insights they need from their data. 
 
Key job responsibilities 
<ul><li>Design, implement, and maintain scalable data infrastructure in native AWS</li><li>Build and optimize data pipelines (batch and streaming) to support analytics, reporting, and ML workloads</li><li>Ensure data quality, reliability, and observability through monitoring, logging, and automated alerting</li><li>Work closely with product and analytics teams to understand requirements and deliver high-performance solutions</li><li>Champion best practices for security, compliance, and governance in data infrastructure</li><li>Identify opportunities to optimize performance and cost of data platforms</li><li>Stay current with emerging tools, frameworks, and cloud services in the data infrastructure ecosystem</li></ul> 
A day in the life 
Your primary focus will be empowering customers to succeed with their data by ensuring they can: 
<ul><li>Gather and access data at scale &ndash; Enable seamless data collection and retrieval that grows with their needs</li><li>Extract meaningful insights &ndash; Provide the right tools and capabilities to uncover the answers they're seeking</li><li>Trust their data &ndash; Maintain confidence in the completeness, accuracy, and reliability of their information</li></ul>
Achieving these goals requires close collaboration and strong partnerships with Product and Data Science teams to deliver solutions that truly meet customer needs.</div><h2 class="jobSectionHeader">
BASIC QUALIFICATIONS</h2><ul><li>3+ years of non-internship professional software development experience</li><li>2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience</li><li>1+ years of software development engineer or related occupational experience</li><li>1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience</li><li>1+ years of Object Oriented Design experience</li><li>Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field</li><li>Experience programming with at least one software programming language</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience</li><li>Bachelor's degree in computer science or equivalent</li><li>Experience operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets, or experience in software development</li></ul> 
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. 
 
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company&rsquo;s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner. 
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. 
USA, CA, San Francisco - 165,200.00 - 223,600.00 USD annually 
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually</div>

Data Infrastructure Engineer, Amazon Interactive Video Service (IVS)

<div><h2 class="jobSectionHeader">DESCRIPTION</h2><div>
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we&rsquo;re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain &mdash; and we&rsquo;re looking for talented people who want to help. 
 
You&rsquo;ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You&rsquo;ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you&rsquo;ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. 
 
Amazon Interactive Video Service (Amazon IVS) is AWS's fully managed live streaming service, built on the same battle-tested technology that powers Twitch and trusted by thousands of enterprises across gaming, social, live commerce, sports, and entertainment.
 
 
Our mission: enable developers to build communities around live video. We handle everything from ingest to processing to delivery at global scale, so developers can focus on creating interactive, engaging live experiences for their audiences. Whether you're streaming to tens of millions of concurrent viewers or just getting started, Amazon IVS removes the complexity so developers can move fast. 
 
As a Data Infrastructure Engineer, you will be responsible for empowering internal teams and IVS customers with the data they need to make key operational and business decisions. We operate petabyte-scale data infrastructure for collecting, processing, and warehousing IVS data. We support streaming and batch pipelines to facilitate analytics, reporting, and ML workloads. We offer analytics tools and data products designed to make it easy and fast for our customers to extract the insights they need from their data. 
 
Key job responsibilities 
<ul><li>Design, implement, and maintain scalable data infrastructure in native AWS</li><li>Build and optimize data pipelines (batch and streaming) to support analytics, reporting, and ML workloads</li><li>Ensure data quality, reliability, and observability through monitoring, logging, and automated alerting</li><li>Work closely with product and analytics teams to understand requirements and deliver high-performance solutions</li><li>Champion best practices for security, compliance, and governance in data infrastructure</li><li>Identify opportunities to optimize performance and cost of data platforms</li><li>Stay current with emerging tools, frameworks, and cloud services in the data infrastructure ecosystem</li></ul> 
A day in the life 
Your primary focus will be empowering customers to succeed with their data by ensuring they can: 
<ul><li>Gather and access data at scale &ndash; Enable seamless data collection and retrieval that grows with their needs</li><li>Extract meaningful insights &ndash; Provide the right tools and capabilities to uncover the answers they're seeking</li><li>Trust their data &ndash; Maintain confidence in the completeness, accuracy, and reliability of their information</li></ul>
Achieving these goals requires close collaboration and strong partnerships with Product and Data Science teams to deliver solutions that truly meet customer needs.</div><h2 class="jobSectionHeader">
BASIC QUALIFICATIONS</h2><ul><li>5+ years of non-internship professional software development experience</li><li>5+ years of programming with at least one software programming language experience</li><li>5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience</li><li>Experience as a mentor, tech lead or leading an engineering team</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience</li><li>Bachelor's degree in computer science or equivalent</li><li>Experience in software development, or experience operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets</li></ul> 
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. 
 
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company&rsquo;s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner. 
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. 
USA, CA, San Francisco - 193,300.00 - 261,500.00 USD annually 
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually</div>

Sr. Data Infrastructure Engineer, Amazon Interactive Video Service (IVS)

Domu

<div>
 At Domu.ai, we're building the infrastructure that will replace call centers at the world's largest financial institutions. Voice AI that handles thousands of live calls every day for Fortune 500 banks and insurers, end-to-end. Call volume is 3x-ing monthly. We're hitting problems most startups never see: real-time voice AI at scale, legacy banking infrastructure, enterprise telephony, and regulatory constraints.
 
 
 The role
 
 
 \ As the
 
 Software Engineer
 
 you'll.....
 
 
 <ul>
 <li>
 Build and own core product features: Backend systems, APIs, voice infrastructure, wherever the product needs you. Code ships daily and goes live for Fortune 500 clients.
 </li>
 <li>
 Work on things most engineers never touch: telephony systems, real-time voice processing, and integrations with legacy financial infrastructure. The problems are hard. That's the point.
 </li>
 <li>
 95%+ of your time will be coding and building.
 </li>
 <li>
 We're looking for engineers who can own one of these areas: the orchestration layer that coordinates our voice AI systems, infrastructure scaling and low-level performance, security as a generalist building for Fortune 500 financial institutions, or product engineering close to users finding high-leverage wins.
 </li>
 <li>
 Know what it feels like when things are working: real customers, real revenue, a product people actually need. You also know the chaos, the pace, the things that break at the worst possible time. You've seen both sides and you want to do it again with a team that's already found traction.
 
 
 </li>
 </ul>
 How we work
 
 
 <ul>
 <li>
 Four engineers. Everyone ships to production.
 </li>
 <li>
 We do dailies. We groom tickets. But we keep process light and in service of the work, not the other way around. We'd rather spend time building than talking about building.
 </li>
 <li>
 We care about doing great work. Not just shipping, but shipping something you're proud of. Clean abstractions. Systems that don't page you at 3am. Code you wouldn't be embarrassed to open-source. We build things that last because we're the ones maintaining them.
 </li>
 <li>
 Ownership here is real. You won't be handed tasks from a backlog. You'll see what needs to happen and do it. That's how a small team ships to Fortune 500 customers.
 </li>
 <li>
 We hire people whose judgment we trust, then get out of their way. No passengers.
 
 
 </li>
 </ul>
 What you bring
 
 
 <ul>
 <li>
 3+ years of experience as a software engineer
 </li>
 <li>
 Previously worked at a Series A (or similar stage) startup and went through the same hypergrowth challenges Domu is facing
 </li>
 <li>
 Experience dealing with legacy systems and refactoring them into sustainable, scalable architectures
 </li>
 <li>
 Strong backend fundamentals - can own features end-to-end from design to production
 </li>
 <li>
 Proficiency in TypeScript and/or Python
 </li>
 <li>
 Cares about doing great work - clean abstractions, reliable systems, code you'd be proud to open-source
 
 
 </li>
 </ul>
 Extras we'd be excited about
 
 
 <ul>
 <li>
 Telephony/Voice infrastructure - SIP, SRTP, WebRTC, or platforms like Telnyx, Twilio, LiveKit
 </li>
 <li>
 High-throughput distributed systems - queue workers, event-driven architectures, handling 1M+ daily transactions
 </li>
 <li>
 PostgreSQL at scale - query optimization, replication, connection pooling
 </li>
 <li>
 Kubernetes - production deployments, scaling stateful services
 </li>
 <li>
 Real-time data pipelines - ClickHouse, Kafka, or similar OLAP/streaming solutions
 </li>
 <li>
 AWS infrastructure - SQS, containerized deployments
 </li>
 <li>
 Compliance-conscious environments - SOC 2, ISO 27001, or fintech/enterprise security requirements
 </li>
 <li>
 Experience with AI/ML integrations in production (LLMs, voice AI)
 </li>
 <li>
 Familiarity with contact center / dialer systems
 </li>
 <li>
 You've been through the early stages of a startup before.
 </li>
 <li>
 You care about the craft. You want to build something good, not just something that works.
 
 
 </li>
 </ul>
 Why Domu
 
 
 <ul>
 <li>
 You'll be engineer #5. Small team, high leverage. Your work ships immediately.
 </li>
 <li>
 Real traction. Post-revenue, Fortune 500 customers, 3x monthly growth. This isn't a bet on an idea. The product works and customers are paying for it.
 </li>
 <li>
 You'll learn how enterprise deals work from an engineering seat. You'll see the direct line between your code and revenue.
 </li>
 <li>
 Early enough to shape the product, the team, and the culture.
 
 
 </li>
 </ul>
 What we offer
 
 
 <ul>
 <li>
 Healthcare
 </li>
 <li>
 weekly stipend for food and transportation
 </li>
 <li>
 gym membership
 </li>
 <li>
 equipment budget (strict rules on noisy mechanical keyboards)
 </li>
 <li>
 whatever tools you need
 </li>
 </ul>
</div>

Software Engineer

Software Engineer, Infrastructure

DigitalOcean

<div><div>Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you'll find your place here. We value winning together&mdash;while learning, having fun, and making a profound difference for the dreamers and builders in the world.</div>
DigitalOcean is expanding its AI Infrastructure layer to support the next generation of AI-driven applications. We are seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In this role, you will be a key technical leader responsible for designing, developing, and delivering high-scale, resilient data plane services that power our &quot;Inference as a Service&quot; offering. You will work at the intersection of distributed systems and specialized AI hardware to ensure our customers can deploy and scale their models with industry-leading performance and reliability. This is a hands-on role, requiring you to be able to develop high quality software while availing of all the productivity boosts granted by the latest AI coding agents.
<h2 class="jobSectionHeader">
What You'll Do:</h2>
<ul><li>Technical Leadership: Act as a technical leader on the team, driving the end-to-end design, development, and delivery of critical data plane components hosting large generative AI models.</li>
<li>System Design: Architect and refine system design proposals for our high-scale, multi-tenant AI inference cloud ecosystem, ensuring they meet rigorous availability and resiliency standards.</li>
<li>Performance Optimization: Implement and optimize distributed inference hosting using techniques like tensor/data parallelism, KV cache optimizations, and smart routing.</li>
<li>Collaboration: Work cross-functionally with Product Managers, customer-facing teams, and other engineering teams to align technical roadmaps with customer needs.</li>
<li>Mentorship: Coach and mentor junior engineers, fostering a culture of technical excellence and continuous improvement.</li>
<li>Operational Excellence: Maintain and operate critical, high-scale services, utilizing observability tools and defining SLOs to ensure superior platform health.</li>
</ul><h2 class="jobSectionHeader">What You'll Bring to DigitalOcean:</h2>
<ul><li>Distributed Systems Expertise: Strong experience with microservices, messaging systems, databases, and infrastructure as code.</li>
<li>AI/ML Domain Knowledge: Hands-on experience hosting large language or multimodal models using inference engines like vLLM, SGLang, or Modular.</li>
<li>Inference Frameworks: Familiarity with distributed inference serving frameworks such as llm-d, NVIDIA Dynamo, or Ray Serve.</li>
<li>Hardware &amp; Interconnects: Understanding of GPU-level optimization and experience with interconnect technologies like NVlink, XGMI, or RoCE.</li>
<li>Architecture Proficiency: Knowledge of common LLM architectures and optimization techniques (e.g., continuous batching, quantization).</li>
<li>Software Engineering: Expert-level proficiency in GoLang or Python and familiarity with gRPC.</li>
<li>Cloud Operations: Proven experience shipping customer-facing software products and running critical services in a high-scale environment similar to DigitalOcean.</li>
<li>Open Source Mindset: Experience integrating and building with open-source software.</li>
</ul><h2 class="jobSectionHeader">Compensation Range:</h2>
<ul><li>$167,200.00 - $209,000</li>
</ul>
<ul><li>This is a remote role</li></ul>

JR: 2026-7591

#LI-Remote<div><h2 class="jobSectionHeader">
Why You'll Like Working for DigitalOcean</h2>
<ul><li>We innovate with purpose. You'll be a part of a cutting-edge technology company with an upward trajectory, who are proud to simplify cloud and AI so builders can spend more time creating software that changes the world. As a member of the team, you will be a Shark who thinks big, bold, and scrappy, like an owner with a bias for action and a powerful sense of responsibility for customers, products, employees, and decisions.</li>
<li>We prioritize career development. At DO, you'll do the best work of your career. You will work with some of the smartest and most interesting people in the industry. We are a high-performance organization that will always challenge you to think big. Our organizational development team will provide you with resources to ensure you keep growing. We provide employees with reimbursement for relevant conferences, training, and education. All employees have access to LinkedIn Learning's 10,000+ courses to support their continued growth and development.</li>
<li>We care about your well-being. Regardless of your location, we will provide you with a competitive array of benefits to support you from our Employee Assistance Program to Local Employee Meetups to flexible time off policy, to name a few. While the philosophy around our benefits is the same worldwide, specific benefits may vary based on local regulations and preferences.</li>
<li>We reward our employees. The salary range for this position is based on market data, relevant years of experience, and skills. You may qualify for a bonus in addition to base salary; bonus amounts are determined based on company and individual performance. We also provide equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program.</li>
<li>DigitalOcean is an equal-opportunity employer. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.</li>
</ul>
Application Limit: You may apply to a maximum of 3 positions within any 180-day period. This policy promotes better role-candidate matching and encourages thoughtful applications where your qualifications align most strongly.</div></div>

Senior Engineer 2: Inference Data Plane

OpenAI

<div>
 
 About The Team
 
 
 
 OpenAI&rsquo;s Hardware organization develops silicon and system-level solutions designed for the unique demands of advanced AI workloads. The team is responsible for building the next generation of AI-native silicon while working closely with software and research partners to co-design hardware tightly integrated with AI models. In addition to delivering production-grade silicon for OpenAI&rsquo;s supercomputing infrastructure, the team also creates custom design tools and methodologies that accelerate innovation and enable hardware optimized specifically for AI.
 
 
 
 About The Role
 
 
 
 As a software engineer on the Scaling team, you&rsquo;ll help build and optimize the low-level stack that orchestrates computation and data movement across OpenAI&rsquo;s supercomputing clusters. Your work will involve designing high-performance runtimes, building custom kernels, contributing to compiler infrastructure, and developing scalable simulation systems to validate and optimize distributed training workloads.
 
 
 You will work at the intersection of systems programming, ML infrastructure, and high-performance computing, helping to create both ergonomic developer APIs and highly efficient runtime systems. This means balancing ease of use and introspection with the need for stability and performance on our evolving hardware fleet.
 
 
 This role is based in San Francisco, CA, with a hybrid work model (3 days/week in-office). Relocation assistance is available.
 
 
 
 In This Role, You Will
 
 
 
 <ul>
 <li>
 Design and build APIs and runtime components to orchestrate computation and data movement across heterogeneous ML workloads.
 </li>
 <li>
 Contribute to compiler infrastructure, including the development of optimizations and compiler passes to support evolving hardware.
 </li>
 <li>
 Engineer and optimize compute and data kernels, ensuring correctness, high performance, and portability across simulation and production environments.
 </li>
 <li>
 Profile and optimize system bottlenecks, especially around I/O, memory hierarchy, and interconnects, at both local and distributed scales.
 </li>
 <li>
 Develop simulation infrastructure to validate runtime behaviors, test training stack changes, and support early-stage hardware and system development.
 </li>
 <li>
 Rapidly deploy runtime and compiler updates to new supercomputing builds in close collaboration with hardware and research teams.
 </li>
 <li>
 Work across a diverse stack, primarily using Rust and Python, with opportunities to influence architecture decisions across the training framework.
 
 
 </li>
 </ul>
 
 You Might Thrive In This Role If You
 
 
 
 <ul>
 <li>
 Have a deep curiosity for how large-scale systems work and enjoy making them faster, simpler, and more reliable.
 </li>
 <li>
 Are proficient in systems programming (e.g., Rust, C++) and scripting languages like Python.
 </li>
 <li>
 Have experience in one or more of the following areas: compiler development, kernel authoring, accelerator programming, runtime systems, distributed systems, or high-performance simulation.
 </li>
 <li>
 Are excited to work in a fast-paced, highly collaborative environment with evolving hardware and ML system demands.
 </li>
 <li>
 Value engineering excellence, technical leadership, and thoughtful system design.
 
 
 </li>
 </ul>
 
 About OpenAI
 
 
 
 OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
 
 
 We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
 
 
 For additional information, please see OpenAI&rsquo;s Affirmative Action and Equal Employment Opportunity Policy Statement.
 
 
 Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
 
 
 To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
 
 
 We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
 
 
 OpenAI Global Applicant Privacy Policy
 
 
 At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
 
 
 Compensation Range: $225K - $455K
</div>

Software Engineer, Hardware

Explore 141+ Infrastructure engineer in San Francisco this March. Find roles across top companies and apply now to boost your career.