software engineer

security engineer

backend engineer, integrations Jobs in San Francisco

backend engineer, integrations

backend software engineer Jobs in San Francisco

backend software engineer

cloud security engineer Jobs in San Francisco

cloud security engineer

distributed systems engineer

DigitalOcean

<div><div>Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you'll find your place here. We value winning together&mdash;while learning, having fun, and making a profound difference for the dreamers and builders in the world.</div>
DigitalOcean is expanding its AI Infrastructure layer to support the next generation of AI-driven applications. We are seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In this role, you will be a key technical leader responsible for designing, developing, and delivering high-scale, resilient data plane services that power our &quot;Inference as a Service&quot; offering. You will work at the intersection of distributed systems and specialized AI hardware to ensure our customers can deploy and scale their models with industry-leading performance and reliability. This is a hands-on role, requiring you to be able to develop high quality software while availing of all the productivity boosts granted by the latest AI coding agents.
<h2 class="jobSectionHeader">
What You'll Do:</h2>
<ul><li>Technical Leadership: Act as a technical leader on the team, driving the end-to-end design, development, and delivery of critical data plane components hosting large generative AI models.</li>
<li>System Design: Architect and refine system design proposals for our high-scale, multi-tenant AI inference cloud ecosystem, ensuring they meet rigorous availability and resiliency standards.</li>
<li>Performance Optimization: Implement and optimize distributed inference hosting using techniques like tensor/data parallelism, KV cache optimizations, and smart routing.</li>
<li>Collaboration: Work cross-functionally with Product Managers, customer-facing teams, and other engineering teams to align technical roadmaps with customer needs.</li>
<li>Distributed Serving at Scale: Build on Kubernetes-native distributed inference frameworks like llm-d (or alternatives such as NVIDIA Dynamo, Ray Serve, KServe) to deliver prefill/decode disaggregation, KV-cache-aware routing, tiered prefix caching, and wide expert parallelism for MoE models.</li>
<li>Flow Control &amp; Load Balancing: Solve the distributed-systems problems unique to LLM serving &mdash; inference-aware load balancing on queue depth, cache locality, and predicted latency; flow control and fairness across tenants; autoscaling inference pools; and moving gigabytes of KV-cache between prefill and decode instances with negligible overhead.</li>
<li>Open Source Contributions: Contribute upstream to llm-d, vLLM, and the inference gateway ecosystem, and represent DigitalOcean in these communities.</li>
<li>Mentorship: Coach and mentor junior engineers, fostering a culture of technical excellence and continuous improvement.</li>
<li>Operational Excellence: Maintain and operate critical, high-scale services, utilizing observability tools and defining SLOs to ensure superior platform health.</li>
</ul><h2 class="jobSectionHeader">What You'll Bring to DigitalOcean:</h2>
<ul><li>AI/ML Domain Knowledge: Hands-on experience hosting large language or multimodal models using inference engines like vLLM, SGLang, or TensorRT.</li>
<li>Inference Frameworks: Familiarity with distributed inference serving frameworks such as llm-d, NVIDIA Dynamo, or Ray Serve.</li>
<li>Inference Engine Depth: Hands-on experience with vLLM or alternatives (SGLang, TensorRT-LLM, TGI, Modular MAX), including internals like continuous batching, paged attention, and prefix caching.</li>
<li>Distributed Inference Fluency: Understanding of why cluster-scale serving is hard: KV-cache locality is partitioned across workers, naive round-robin routing destroys cache hit rates and tail latency, and disaggregated prefill/decode requires fast cross-pod KV transfer (e.g., NIXL).</li>
<li>Upstream Track Record: Merged contributions to vLLM, llm-d, SGLang, or similar projects strongly preferred.</li>
<li>Architecture Proficiency: Knowledge of common LLM architectures and optimization techniques (e.g., continuous batching, quantization).</li>
<li>Software Engineering: Expert-level proficiency in GoLang or Python and familiarity with gRPC.</li>
<li>Cloud Operations: Proven experience shipping customer-facing software products and running critical services in a high-scale environment similar to DigitalOcean.</li>
<li>Open Source Mindset: Experience integrating and building with open-source software.</li>
</ul><h2 class="jobSectionHeader">Compensation Range:</h2>
<ul><li>$139,200 - $174,000</li>
</ul>
<ul><li>This is a remote role</li></ul>

JR: 2026-7624

#LI-Remote<div><h2 class="jobSectionHeader">
Why You'll Like Working for DigitalOcean</h2>
<ul><li>We innovate with purpose. You'll be a part of a cutting-edge technology company with an upward trajectory, who are proud to simplify cloud and AI so builders can spend more time creating software that changes the world. As a member of the team, you will be a Shark who thinks big, bold, and scrappy, like an owner with a bias for action and a powerful sense of responsibility for customers, products, employees, and decisions.</li>
<li>We prioritize career development. At DO, you'll do the best work of your career. You will work with some of the smartest and most interesting people in the industry. We are a high-performance organization that will always challenge you to think big. Our organizational development team will provide you with resources to ensure you keep growing. We provide employees with reimbursement for relevant conferences, training, and education. All employees have access to LinkedIn Learning's 10,000+ courses to support their continued growth and development.</li>
<li>We care about your well-being. Regardless of your location, we will provide you with a competitive array of benefits to support you from our Employee Assistance Program to Local Employee Meetups to flexible time off policy, to name a few. While the philosophy around our benefits is the same worldwide, specific benefits may vary based on local regulations and preferences.</li>
<li>We reward our employees. The salary range for this position is based on market data, relevant years of experience, and skills. You may qualify for a bonus in addition to base salary; bonus amounts are determined based on company and individual performance. We also provide equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program.</li>
<li>DigitalOcean is an equal-opportunity employer. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.</li>
</ul>
Application Limit: You may apply to a maximum of 3 positions within any 180-day period. This policy promotes better role-candidate matching and encourages thoughtful applications where your qualifications align most strongly.</div></div>

Senior Software Engineer I - AI Inference Data Plane

David Joseph & Company

<div>San Francisco, CA &middot; On-site &middot; Full-time 
Compensation: $120,000&ndash;$300,000 + Competitive Equity<h2 class="jobSectionHeader">
About the Company</h2>
An early-stage, venture-backed FinTech building AI compliance analysts that automate AML, KYC, KYB, and transaction monitoring end-to-end for banks and fintechs. The product operates inside browsers, APIs, and internal systems the way a human analyst would, and is already live with financial institutions across multiple regions.
Founded 2024 &middot; Seed stage &middot; Small team &middot; Industry: FinTech<h2 class="jobSectionHeader">
The Role</h2>
A backend-leaning Member of Technical Staff building the end-to-end systems that power production AI compliance workflows &mdash; high-performance infrastructure, reliability, and backend architecture supporting mission-critical automation.
What you'll be doing<ul><li>
Architect agent behaviors and build the backend systems behind production AI compliance workflows</li><li>
Build browser agents that navigate legacy systems, portals, and third-party platforms, interpreting unstructured data</li><li>
Process risk signals at the speed money moves &mdash; millions of transactions, sub-second decisions &mdash; via distributed inference, caching, queue orchestration, and self-healing data pipelines on AWS</li><li>
Contribute to an in-house deep-research pipeline that keeps LLMs from conflating similar entities</li><li>
Optimize ML pipelines and ship product features, owning problems vertically</li></ul>
Tech stack: Python, AWS; browser automation, computer vision, LLM systems.<h2 class="jobSectionHeader">
Requirements</h2><ul><li>
Experience with backend development and/or ML, especially in Python and AWS</li><li>
Hands-on experience deploying software to production environments</li><li>
Strong communication skills and willingness to interact with clients</li></ul><h2 class="jobSectionHeader">
Green Flags</h2><ul><li>
Experience with browser automation and computer vision</li><li>
Background with distributed inference and optimization on AWS</li><li>
Familiarity with LLM systems and deep research pipelines</li><li>
Experience building systems that process millions of transactions at scale</li><li>
Knowledge of compliance, AML, KYC, or financial crime domains</li><li>
Competitive coding background</li><li>
Contributions to open-source projects or personal projects on GitHub</li><li>
Prior experience as a founder or at an early-stage startup</li></ul><h2 class="jobSectionHeader">
Red Flags</h2><ul><li>
Candidates from a pure data science background who lack strong technical skills</li><li>
Lack of hands-on experience deploying software to production</li><li>
Primarily academic or research experience without practical engineering work</li></ul><h2 class="jobSectionHeader">
Why Join</h2><ul><li>
Build frontier AI agents in production, solving hard problems with no off-the-shelf answers</li><li>
Large, underserved market with real customer traction and measurable impact</li><li>
Small team with wide surface area &mdash; own features end-to-end across backend, ML, and product</li></ul><h2 class="jobSectionHeader">
Details</h2><ul><li>
Location: San Francisco, CA</li><li>
Work policy: On-site</li><li>
Compensation: $120,000&ndash;$300,000 + equity</li><li>
Visa sponsorship: H-1B, O-1, OPT</li><li>
Experience: 1+ years</li><li>
Employment type: Full-time</li></ul></div>

Member of Technical Staff

Amazon Web Services

<div><h2 class="jobSectionHeader">DESCRIPTION</h2><div>
Amazon Interactive Video Service (Amazon IVS) is AWS's fully managed live streaming service, built on the same battle-tested technology that powers Twitch and trusted by thousands of enterprises across gaming, social, live commerce, sports, and entertainment. 
 
Our mission: enable developers to build communities around live video. We handle everything from ingest to processing to delivery at global scale, so developers can focus on creating interactive, engaging live experiences for their audiences. Whether you're streaming to tens of millions of concurrent viewers or just getting started, Amazon IVS removes the complexity so developers can move fast. 
 
As a Software Dev Engineer on the IVS's Data team, you will be responsible for empowering internal teams and IVS customers with the data they need to make key operational and business decisions. We operate petabyte-scale data infrastructure for collecting, processing, and warehousing IVS data. We support streaming and batch pipelines to facilitate analytics, reporting, and ML workloads. We offer analytics tools and data products designed to make it easy and fast for our customers to extract the insights they need from their data. 
 
Key job responsibilities 
<ul><li>Design, implement, and maintain scalable data infrastructure in native AWS</li><li>Build and optimize data pipelines (batch and streaming) to support analytics, reporting, and ML workloads</li><li>Ensure data quality, reliability, and observability through monitoring, logging, and automated alerting</li><li>Work closely with product and analytics teams to understand requirements and deliver high-performance solutions</li><li>Champion best practices for security, compliance, and governance in data infrastructure</li><li>Identify opportunities to optimize performance and cost of data platforms</li><li>Stay current with emerging tools, frameworks, and cloud services in the data infrastructure ecosystem</li></ul> 
A day in the life 
Your primary focus will be empowering customers to succeed with their data by ensuring they can: 
<ul><li>Gather and access data at scale &ndash; Enable seamless data collection and retrieval that grows with their needs</li><li>Extract meaningful insights &ndash; Provide the right tools and capabilities to uncover the answers they're seeking</li><li>Trust their data &ndash; Maintain confidence in the completeness, accuracy, and reliability of their information</li></ul>
Achieving these goals requires close collaboration and strong partnerships with Product and Data Science teams to deliver solutions that truly meet customer needs. 
 
About the team 
Amazon Interactive Video Service (Amazon IVS) is a managed live streaming solution from AWS that enables low-latency and real-time video experiences for millions of viewers worldwide. We power engaging live experiences for some of the largest customers in the live video space and continuously push the boundaries of what&rsquo;s possible with interactive video technology.</div><h2 class="jobSectionHeader"> 
BASIC QUALIFICATIONS</h2><ul><li>3+ years of non-internship professional software development experience</li><li>2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience</li><li>1+ years of software development engineer or related occupational experience</li><li>1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience</li><li>1+ years of Object Oriented Design experience</li><li>Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field</li><li>Experience programming with at least one software programming language</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience</li><li>Bachelor's degree in computer science or equivalent</li></ul> 
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. 
 
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company&rsquo;s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner. 
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. 
USA, CA, San Francisco - 165,200.00 - 223,600.00 USD annually 
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually</div>

Software Dev Engineer II, Amazon Interactive Video Service (IVS)

OpenAI

<div>
 
 About The Team
 
 
 
 The Support Automation team at OpenAI scales the organization by applying cutting-edge AI models to real-world challenges, automating and enhancing work across the organization. From customer operations to engineering, we develop an ecosystem of automation products that empower our colleagues and drive impact. We're passionate about crafting products that serve those around us, blending rapid prototyping with a focus on long-term quality and reliability. By creating reusable solutions, we create patterns that can be applied across diverse domains within OpenAI.
 
 
 TLDR: this team leverages OpenAI technology to improve OpenAI, and you&rsquo;ll have the opportunity to leverage the full extent of our tech (both public and pre-released) to accomplish this mission.
 
 
 
 About The Role
 
 
 
 We&rsquo;re looking for a
 
 Backend Software Engineer
 
 with experience working in ML/LLM-heavy domains to help to design and build an evals infrastructure that measures the quality of OpenAI&rsquo;s support automation. This is a deeply technical and highly cross-functional role where you&rsquo;ll build robust systems and backend services that serve as the foundation for how knowledge is created, accessed, and applied across OpenAI. The role will especially focus on working closely with Data Science and Research partners to design and build evals at scale.
 
 
 
 In This Role, You Will
 
 
 
 <ul>
 <li>
 Design eval pipelines that are reliable, reproducible, and extendable
 </li>
 <li>
 Build the infrastructure for continuous eval monitoring frameworks (regression/drift monitoring, building robust golden datasets) along with feedback loops that ultimately strengthen support automation
 </li>
 <li>
 Design, build, and maintain backend services and APIs to support intelligent automation and knowledge systems
 </li>
 <li>
 Integrate and structure data across internal platforms, transforming it into formats optimized for use by downstream systems and AI workflows.
 </li>
 <li>
 Collaborate closely with data, research, and engineering teams to integrate OpenAI models into high-leverage workflows
 </li>
 <li>
 Own the full development lifecycle of new backend systems and internal platform capabilities
 </li>
 <li>
 Build with scale and maintainability in mind, while rapidly iterating on new ideas
 
 
 </li>
 </ul>
 
 You Might Be a Great Fit If You Have
 
 
 
 <ul>
 <li>
 4+ years of backend engineering experience at product-driven companies (excluding internships)
 </li>
 <li>
 Proficiency in backend technologies. Our tech stack includes Python, FastAPI, and Postgres
 </li>
 <li>
 Experience designing and scaling distributed systems, APIs, or data processing pipelines
 </li>
 <li>
 Have experience building AI agents or applications, including designing evals and improving performance through prompting or scaffolding
 </li>
 <li>
 Are familiar with evaluation methods for LLMs and have worked with patterns like multi-agent workflows, tool use, or long context.
 </li>
 <li>
 Experience creating production evals and/or measuring performance of ML/LLM models at scale
 </li>
 <li>
 A pragmatic mindset. You&rsquo;re comfortable shipping iteratively while building toward a long-term vision
 
 
 </li>
 </ul>
 
 About OpenAI
 
 
 
 OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
 
 
 We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
 
 
 For additional information, please see OpenAI&rsquo;s Affirmative Action and Equal Employment Opportunity Policy Statement.
 
 
 Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
 
 
 To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.
 
 
 We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
 
 
 OpenAI Global Applicant Privacy Policy
 
 
 At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
 
 
 Compensation Range: $230K - $385K
 
 
</div>

Backend Software Engineer (Evals)

HARVEY

<div><div><h2 class="jobSectionHeader">Location</h2>
San Francisco
</div><div><h2 class="jobSectionHeader">Employment Type</h2>
Full time
</div><div><h2 class="jobSectionHeader">Location Type</h2>
Hybrid
</div><div><h2 class="jobSectionHeader">Department</h2>
Engineering
</div><div><h2 class="jobSectionHeader">Compensation</h2>
<ul><li>$161.3K &ndash; $241.9K &bull; Offers Equity &bull; Offers Bonus</li>
</ul><div>Additionally, this role is eligible to participate in our equity plan and benefits program. Benefits include, but not limited to: Comprehensive health, dental and vision coverage, retirement benefits (401k match up to 4%), and flexible PTO.</div></div></div>
 <div><h1 class="jobSectionHeader">Why Harvey</h1>
At Harvey, we&rsquo;re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we&rsquo;re reshaping how critical knowledge work gets done for decades to come.
This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We&rsquo;re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth &mdash; personal, professional, and financial &mdash; is unmatched.
Our team moves fast, takes ownership, and is deeply committed to the mission &mdash; operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you.
At Harvey, the future of professional services is being written today &mdash; and we&rsquo;re just getting started.
<h1 class="jobSectionHeader">Role Overview</h1>
Harvey is building the AI platform trusted by the world&rsquo;s leading law firms and enterprises. Our infrastructure is the foundation that powers every customer interaction, every model inference, and every production workload.
We&rsquo;re looking for a Production Engineer to help build and operate Harvey&rsquo;s core compute and networking infrastructure, Kubernetes platform, workflow orchestration platform, and production infrastructure foundations. You&rsquo;ll work on the systems that enable engineering teams to move quickly and operate reliable services at scale.
In this role, you&rsquo;ll improve the reliability, scalability, security, and efficiency of Harvey&rsquo;s infrastructure platform. You&rsquo;ll solve complex production challenges across compute fleet management, capacity planning, infrastructure automation, and production operations. You&rsquo;ll partner closely with Product Engineering, Security, AI Infrastructure, and Platform teams to ensure our infrastructure scales with Harvey&rsquo;s rapid growth.
At Harvey, we value Decisiveness, Simplicity, and the belief that Job&rsquo;s Not Finished. We move quickly, prioritize clarity, and continuously raise the bar for engineering excellence.
<h1 class="jobSectionHeader">What You'll Do</h1>
<h2 class="jobSectionHeader">Infrastructure Engineering &amp; Technical Leadership</h2>
<ul><li>Design, build, and operate the production infrastructure that powers Harvey&rsquo;s products and AI workloads.
</li><li>Drive technical direction across compute infrastructure, networking, Kubernetes, workflow orchestration, and production operations.
</li><li>Lead complex, cross-functional technical initiatives that improve reliability, scalability, security, operational efficiency, and infrastructure cost.
</li><li>Partner with Product Engineering, Security, AI Infrastructure, and Platform teams to translate product and business requirements into resilient infrastructure solutions.
</li><li>Establish reusable patterns, tooling, and paved paths that help engineering teams ship and operate production services safely.
</li><li>Raise the engineering bar through thoughtful design reviews, clear technical documentation, operational rigor, and mentorship.
</li></ul><h2 class="jobSectionHeader">Infrastructure Foundation &amp; Production Operations</h2>
<ul><li>Build and operate Harvey&rsquo;s global compute and network infrastructure, ensuring high availability, scalability, reliability, and performance.
</li><li>Improve compute utilization, performance, and service availability while supporting rapidly growing AI workloads.
</li><li>Develop capacity models, demand forecasts, and fleet lifecycle automation to help infrastructure scale efficiently with business growth.
</li><li>Operate and continuously improve Harvey&rsquo;s Kubernetes platform, including cluster provisioning, upgrades, networking, monitoring, reliability, performance, and operational automation.
</li><li>Drive infrastructure cost efficiency through capacity management, resource rightsizing, workload optimization, and utilization monitoring.
</li><li>Build secure infrastructure foundations, including identity and access management, network isolation, secrets management, auditing, and compliance controls.
</li><li>Develop scalable Infrastructure-as-Code and automation frameworks using technologies such as Terraform and Pulumi.
</li><li>Improve observability, monitoring, alerting, incident response, and operational readiness across the infrastructure platform.
</li><li>Participate in the on-call rotation, lead incident response when needed, and turn production learnings into durable engineering improvements.
</li></ul><h1 class="jobSectionHeader">What You Have</h1>
<ul><li>5+ years of software, infrastructure, site reliability, or production engineering experience.
</li><li>Deep experience building and operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
</li><li>Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability.
</li><li>Experience building and operating distributed systems with strong reliability, scalability, and performance characteristics.
</li><li>Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi.
</li><li>Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.
</li><li>Experience designing and operating observability systems, including monitoring, logging, alerting, and incident response.
</li><li>Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices.
</li><li>A track record of driving complex, cross-functional technical initiatives and influencing engineering decisions without relying on formal authority.
</li><li>Excellent communication skills and the ability to explain technical concepts clearly to engineering partners and other stakeholders.
</li><li>A systems-thinking mindset and a passion for building simple, reliable, and scalable infrastructure platforms.
</li></ul><h2 class="jobSectionHeader">Nice to Have</h2>
<ul><li>Experience supporting AI/ML or LLM infrastructure at scale.
</li><li>Experience operating GPU fleets, high-performance compute infrastructure, or large-scale capacity planning.
</li><li>Experience with multi-cloud infrastructure or hybrid cloud environments.
</li><li>Experience building internal platforms or developer tooling that improves engineering velocity and production safety.
</li></ul><h1 class="jobSectionHeader">Compensation</h1>
$161,300 - $241,900 USD
<h3 class="jobSectionHeader">Depending on your location, an Applicant Privacy Notice may apply to you. You can find all of our Applicant Privacy Notices here.</h3>
#LI-AN2
Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing accommodations@harvey.ai</div>

Senior Software Engineer, Production Engineering

<div><h1 class="jobSectionHeader">Why Join Ivo?</h1>
Every civilization runs on the same infrastructure: agreements between people who don't fully trust each other. Sumerians pressed them into clay. Romans carved them into stone. We bury them in 80-page PDFs.
The way those agreements are reviewed hasn't changed in four thousand years - a human reads the whole thing and tries not to miss anything. We're building the AI that finally changes that. Ivo is the contract intelligence platform of choice for companies like Uber, Meta, Canva, IBM, and Shopify. We recently raised our Series B and have grown 800% over the last 12 months.<h1 class="jobSectionHeader">
Engineering at Ivo</h1>
Engineers at Ivo are inventors. Ivo was first-to-market with:<ul><li>An AI agent that lives in MS word and edits the document for you [2023]</li><li>Ditching imprecise embeddings models in favor of agentic RAG [2023]</li><li>Large-scale LLM-based legal fact extraction [2024]</li><li>A legal assistant that can search large contract databases, without sacrificing accuracy [2024]</li><li>Clustering legal documents descended from the same family [2025]</li><li>Automatic deviation analysis to locate buried risk in huge contract databases [2025]</li><li>Merging contracts with their amendments to make a time series of &ldquo;composite&rdquo; contracts (a customer actually cried when we showed her this) [2025]</li></ul><h1 class="jobSectionHeader">
The Role: Why, What and the Who</h1>
Why? Infrastructure Engineers build the foundation for Ivo&rsquo;s entire platform. Customers are cagey about their contracts, so each customer gets their isolated environment with containers, database, VPC, etc. Things break. Regions go down. Cloud and LLM providers have &ldquo;incidents.&rdquo; Customers still expect us to hit our SLAs.
What? We&rsquo;re looking for a Staff DevOps Engineer as part of Infrastructure team to:<ul><li>
Build and maintain Docker-based environments across dev/staging/prod</li><li>
Own and improve our deployment and release pipelines (GitHub Actions)</li><li>
Manage infrastructure using Pulumi (Infrastructure as Code)</li><li>
Support backend services (APIs, workers, jobs) and frontend apps (builds, deployments, performance issues)</li><li>
Debug issues across the stack: infra backend frontend</li><li>
Improve developer experience: faster builds, cleaner environments</li><li>
Help define and improve CI/CD workflows</li><li>
Automate repetitive processes wherever possible</li></ul>
Who? We need someone with:<ul><li>
Minimum 7 years of experience</li><li>
Strong expertise in DevOps / infrastructure + some full-stack exposure</li><li>
Hands-on experience with Pulumi (or similar IaC tools like Terraform), Docker / containerization, GitHub + CI/CD pipelines</li><li>
Good debugging skills: debugging ambiguous issues, tracing problems across systems</li></ul>
This isn&rsquo;t a &ldquo;keep the lights on&rdquo; role. You&rsquo;ll be building the system that keeps the company running. In addition to helping us run a solid, high-performance distributed system, we&rsquo;d love someone who&rsquo;s as excited about LLMs as we are. You&rsquo;d be deeply embedded into the engineering team and highly encouraged to push the frontiers.<h1 class="jobSectionHeader">
Ivo might be a good fit for you if you:</h1><ul><li>
You love writing code, but you love having impact more: We&rsquo;re a team of engineers at heart, but our #1 goal is building the best possible product. That means making pragmatic choices and looking for 80/20 solutions.</li><li>
Would describe yourself as being relentlessly resourceful.</li><li>
You have a strong internal sense of urgency. You have a bias towards doing things *today*, rather than tomorrow.</li><li>
Experience working in a startup environment is preferred but not required.</li><li>
Are excited about the adventure of building a company!</li></ul><h1 class="jobSectionHeader">
What We Offer</h1><ul><li>
Competitive Compensation: Final offer details are determined based on experience, expertise, and overall fit.</li><li>
Equity: Meaningful ownership in a company that's scaling fast</li><li>
Relocation and Visa Support: We also offer relocation assistance for successful applicants moving to SF, as well as support for visa and green card applications where applicable.</li><li>
Health &amp; Wellness: Comprehensive medical, dental, and vision plans to suit the needs of you and your family.</li><li>
Flexible Spending &amp; Insurance: Access to HSA and FSA accounts, plus life insurance coverage.</li><li>
401(k) Program: Save for the future with our 401(k) program.</li><li>
Commuter Benefits: We help make getting to and from the office easier and more convenient.</li><li>
Unlimited PTO: So you can take the time you need to recharge, stay healthy, and bring your best self to work.</li><li>
Office Perks: Enjoy a vibrant Downtown San Francisco office with catered lunch five days a week, premium snacks and coffee, an in-building gym, and a dog-friendly environment.</li></ul><h2 class="jobSectionHeader">
FAQ</h2><ul><li>
What stage of growth is Ivo at?: We launched in early access in 2023. Since then, we&rsquo;ve had an incredible response from the market and are growing rapidly. We 6x'd in ARR in the last 12 months. Our clients include companies like Uber, Reddit, IBM, Canva, Pinterest, WordPress, and more. We're happy to share more details with candidates who go through our interview process.</li><li>
Is this a chill gig?: Startups are very hard, especially if they&rsquo;re growing fast. You&rsquo;ll have a ton of responsibility, and there&rsquo;s always an enormous amount of stuff to do. It&rsquo;s hard work but the payoff is uncapped.</li><li>
Can I work remotely?: We require candidates to work with us in-person 5 days a week in our San Francisco office.</li></ul>
Ivo is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Compensation Range: $249K - $405K</div>

Staff DevOps Engineer

Smvsoft LLC

Founding Engineer - Applied AI San francisco, CA (Full time)- In-Office$180k-$230k per annumNO C2CAbout the RoleHiring a world-class Applied AI Engineer to build the core systems behind their automation engine for hardware engineering.This is a deeply technical, high-impact role. You will be among the first technical hires and will own mission-critical systems end-to-end. The problems are ambiguous, the constraints are real, and the expectations are high. If you move fast from idea to production, care deeply about customer experience, and want to build foundational AI infrastructure for the world's most impactful industries, this role is for you.Key Responsibilities<ul><li>Design and implement core workflows and infrastructure for hardware engineering agents, including intelligent context management, novel indexing approaches, and post-training</li><li>Build agents and ML models that can interpret, reason over, and manipulate complex engineering design data, integrating with enterprise-grade engineering tools and systems</li><li>Work closely with customers and the engineering team to deliver AI-powered workflows that are reliable, intuitive, and trusted in production environments</li><li>Prototype rapidly, validate ideas with real users, and ship frequently</li><li>Influence engineering culture, architecture decisions, and the future of the product</li></ul>RequirementsMust-Have<ul><li>Bachelor's or higher in Computer Science, Machine Learning, or equivalent experience</li><li>Strong familiarity with LLM architectures and agent research trends</li><li>Excellent programming skills with experience using ML libraries such as PyTorch, Hugging Face, and W&amp;B</li><li>Experience building production ML or AI systems</li><li>Solid practical experience with search and information retrieval</li><li>Moves fast from idea to production, with a genuine care for customer experience</li><li>Based in or willing to relocate to San Francisco, or an exceptional remote candidate</li></ul>Nice-to-Have<ul><li>2+ years in applied machine learning, backend engineering, or AI infrastructure</li><li>Experience working with machine learning over geometric data, including CAD</li><li>Track record of high-impact contributions or published papers at top-tier AI labs or teams</li></ul>Pay: $180,000.00 - $230,000.00 per yearWork Location: In person

Founding Engineer - Applied AI

Explore 58+ Distributed systems engineer in San Francisco this August. Find roles across top companies and apply now to boost your career.