machine learning engineer

software development engineer Jobs in Seattle

software development engineer

adversarial machine learning engineer Jobs in Seattle

adversarial machine learning engineer

ai engineer (intern)

ai research scientist - mllm training Jobs in Seattle

ai research scientist - mllm training

aiml sr data engineer evaluation

Apple

The SWE Data organization seeks to improve products by using data as the voice of our customers. Within this organization, the Search Data Engineering team builds systems that process data reliably at scale to generate high-quality datasets that support confident, data informed decision-making for improving understanding capabilities of Search capabilities. 
 
We&rsquo;re looking for exceptional data engineers who are passionate about our product and values; who love working with data at scale, and who are committed to continuously improve. As a part of this group, you will work with petabytes of data daily using diverse technologies. You will be expected to effectively partner with upstream engineering &amp; privacy teams and downstream consumers, including data scientists and ML engineers. 
 
Description 
 
In this role, you will be building ultra large scale batch &amp; streaming datasets to support analytics, experimentation and machine learning and helping to drive our self-serve strategy for reporting on-behalf of data scientists and product engineers as we collectively make product better. 
 
You will help design instrumentation required to log data from device and server side upholding Apple&rsquo;s privacy promise and validate data is flowing in the correct shape, frequency, and quality into the Data Warehouse. Curate a high performance and easy to understand data model that meets the needs of the many. Identify common patterns and build self-serve tools to scale data engineering, and automate lifecycle of datasets with the highest standards of data quality. Educate your consumers on how to access your products, assuring transparency and understanding in logic definitions and enabling self-service. 
 
&quot;,&quot;responsibilities&quot;:&quot; 
 
Preferred Qualifications 
 
Proficiency in at least one high-level programming language (Python, Java, Scala, Go or equivalent). 
 
Experience with large, complex, highly dimensional data sets; hands-on experience with SQL. 
 
Experience working with cross-functional teams to collect business requirements, build consensus, and manage expectations 
 
You are self-directed and capable of operating amidst ambiguity. 
 
You are humble, continually growing in self-awareness, and possessing a growth mindset. 
 
You are curious and have excellent written and verbal communication as well as problem-solving skills. 
 
You are excited about digging into massive petabyte-scale semi-structured datasets. 
 
MS in CS, Engineering, Math, Statistics, or a related field or equivalent practical experience in data engineering. 
 
Minimum Qualifications 
 
5+ years of technical experience designing, building, and maintaining distributed data processing platforms. 
 
3+ years of industry experience working with batch or streaming distributed data processing technologies (e.g. Spark, Flink, Kafka, Presto, Hadoop, MapReduce, etc.) for building efficient &amp; large-scale data pipelines. 
 
3+ years of data modeling experience designing data warehouse table schemas and logging schemas. 
 
BS in CS, Engineering, Math, Statistics, or a related field or equivalent practical experience in data engineering. 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $139,500 and $258,100, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

AIML - Sr Data Engineer, Evaluation

Amazon.com

<div><h2 class="jobSectionHeader">DESCRIPTION</h2><div>
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we&rsquo;re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain &mdash; and we&rsquo;re looking for talented people who want to help. 
 
You&rsquo;ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You&rsquo;ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you&rsquo;ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. 
 
Are you interested in developing solutions that have big impact? Are you someone who likes to challenge the status quo and work on developing innovative product solutions? If you are a mechanical engineer and looking for an exciting career in cloud infrastructure, come join a team that constantly seeks ways to build things better &amp; faster for our customers. 
 
AWS is looking for a Sr. Mechanical Product Engineer to become part of Mechanical Products and Services team, responsible for the design and continuous innovation within our rapidly expanding data center footprint. This position can be based out of Seattle, Washington or Herndon, Virginia. 
 
Our Senior Mechanical Product Engineers take full ownership to design resilient, cost effective mechanical systems. As engineers at Amazon, we are responsible for achieving a world class uptime for our customers. We drive continuous advancements and improvements with our designs, and communicate technical direction to Sr. Management. We seek new ways to enhance the reliability, scalability, and cost effectiveness of our engineering designs. As an engineer at Amazon, you have the ability to drive change and make a substantial impact in the systems our customers rely on. 
 
At Amazon, team work is absolutely necessary for us to accomplish our goals. We work within a team and depend on others to accomplish the required work. As a mechanical engineer at Amazon you will be working with other internal groups as well as external groups including manufacturers, vendors, and contractors. 
 
If you are a creative, smart and driven individual that enjoys working with complex problems we want you! At Amazon, you will be responsible for working on multi-million-dollar designs and supporting our wide variety of customers. Great ideas are encouraged and supported. Ingenuity is the main mechanism which supports our focus on quality, speed, and cost. 
 
<ul><li>Work in a cross-disciplinary setting with ability to influence and drive others.</li><li>Work has deep and far-reaching impact on overall product design/solutions</li><li>Advises peer engineers and management team.</li><li>Deep-dive and perform root cause analysis.</li><li>Make technical trade-offs between short-term project goals and long-term business needs.</li><li>Develop integrated systems extending the life of data center infrastructure products.</li><li>Simplify, optimize and lower costs of data center mechanical and associated sub components.</li></ul> 
Key job responsibilities 
<ul><li>Define and design liquid cooling equipment and related infrastructure.</li><li>Collaborate with internal and external ecosystem partners to design and develop new data center product solutions.</li><li>Support field engineering and data center operation teams for performing root cause analysis and implementation of corrective actions.</li><li>Leverage economy of scale through standardization and modularization of data center products.</li><li>Maintain and develop technical design procedures associated with piping and pipe support analysis activities.</li><li>Provide technical subject matter expertise to peers, senior management and partner teams.</li><li>Develop business justification and narratives to promote new concepts and ideas.</li><li>Lead key initiatives for the organization while demonstrating ownership.</li><li>Work with global suppliers and manufacturers to specify appropriate mechanical and associated sub components.</li><li>Provide product design support to other team members.</li><li>Writing functional specifications, design verification plans, and functional test procedures.</li><li>Ability and willingness to travel domestic and internationally for up to 25% of the year.</li></ul></div><h2 class="jobSectionHeader">
BASIC QUALIFICATIONS</h2><ul><li>6+ years of data center design, construction, operations, or facility maintenance experience</li><li>6+ years of industrial or commercial engineering in mission critical facilities including but not limited to: data centers, power generation or oil and gas facilities experience</li><li>Bachelor's degree in Engineering or a related field</li><li>Experience researching new designs, technologies, and construction methods of data center equipment and facilities</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>Professional Engineering or Architectural License</li><li>Knowledge of building codes and regulations for your region</li><li>Experience carrying design concepts through exploration, development, and into deployment or mass production</li><li>Experience reading, interpreting, and creating construction drawings, specifications, and submittal documents</li></ul> 
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. 
 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner. 
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. 
USA, VA, Herndon - 136,600.00 - 184,800.00 USD annually 
USA, WA, Seattle - 136,600.00 - 184,800.00 USD annually</div>

Senior Mech Product Engineer, Data Center Eng , Mechanical Products and Services

The Applied Machine Learning team builds production multimodal systems that understand and transform large-scale image, audio, and video content. Our work spans diffusion-based image generation, transcription and diarization, face and object detection, OCR and image description for search, and automated quality control of media pipelines. 
 
We are looking for a Staff Machine Learning Engineer to strengthen our diffusion and video models, adapt small and mid-sized LLMs, and turn our uniquely large corpus of weakly labeled media into a durable product advantage. This is an opportunity to shape the next generation of multimodal experiences end-to-end, from data and models to evaluation and user impact. 
 
Description 
 
The Staff Machine Learning Engineer - Multimodal Generation &amp; Post-Training will be a senior individual contributor on a small, applied ML team focused on production multimodal systems. The role will lead fine-tuning and adaptation of diffusion and emerging video models, as well as post-training of small and medium LLMs for captioning, moderation, and retrieval-friendly descriptions. 
 
The engineer will design data and evaluation workflows that use our large archive of weakly labeled music, podcast, film, TV, and short-form content to drive measurable quality and efficiency improvements. The role includes close collaboration with partner infra teams for model serving and with adjacent product and research groups to bring new capabilities into production. 
 
Preferred Qualifications 
 
PhD in Computer Science, Machine Learning, or a related technical field. 
 
8+ years of industry experience with production multimodal systems spanning image, audio, and/or video. 
 
Deep expertise with diffusion and video generation techniques (e.g., ControlNet/IP-Adapter, temporal consistency methods, sampling and latency optimization). 
 
Experience with PEFT/QLoRA and post-training approaches such as DPO or related preference-based methods for small and mid-sized LLMs. 
 
Background in ASR/VAD/diarization, OCR, multimodal retrieval, or face recognition with fine-grained temporal alignment. 
 
Familiarity collaborating with infra/platform teams on model serving (e.g., batching strategies, quantization, observability) and translating requirements into reliable production deployments. 
 
Demonstrated ability to define metrics, build evaluation harnesses, and communicate results clearly to cross-functional partners. 
 
Track record of publications, patents, or open-source contributions in relevant areas of machine learning or multimodal modeling. 
 
Minimum Qualifications 
 
Master&rsquo;s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience. 
 
5+ years of hands-on industry experience building and shipping machine learning systems to production. 
 
Proven experience training and fine-tuning diffusion or other image/video generative models, including adapter-based methods such as LoRA. 
 
Proficiency in Python and at least one major deep learning framework such as PyTorch. 
 
Experience designing and operating ML pipelines for noisy or weakly labeled data, including offline evaluation and monitoring in production. 
 
Strong software engineering skills, including code quality, experimentation discipline, and debugging/profiling of model performance. 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $201,300 and $302,200, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Staff Machine Learning Engineer, Apple Services Engineering

From our origins in iPhone keyboard input, the Input Experience NLP team has expanded to a broad charter: improve the user experience with robust language understanding and personalized text composition, across languages and Apple platforms. We build the ML models that underlie Summarization, Smart Reply, Writing Tools, and other features deeply integrated into Apple products. Generative AI is a transformative technology that we have only just begun to incorporate into our digital lives, to help everyday people digest the deluge of information they receive and express themselves more clearly. On our team, you will help build the future and have a voice in the shape it takes. 
 
We are looking for a Machine Learning Engineer to develop the next generation of our ML models, so that they better serve the full range of our customers, across languages, writing styles, and other personal context, in a privacy-preserving way. You will build, run, and refine the training and evaluation pipelines that define our slice of Apple Intelligence, driving the focused experimentation and iteration that makes the user experience magical. You will join an ambitious, organized, and collaborative team. We&rsquo;re in a unique position to integrate the latest innovations from the ML community and work on features that reach everyday users, including your family and friends. You&rsquo;ll work closely with teams across Apple, collaborating on human interfaces, user studies, internationalization, ML technologies, system integration, and more. 
 
Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other&rsquo;s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It&rsquo;s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you&rsquo;ll do more than join something-you&rsquo;ll add something. 
 
Description 
 
As a Machine Learning Engineer on our team, you will enable next-generation AI applications by building toolkits and workflows that scale to increasingly sophisticated modeling tasks. You will design the abstractions and implement the algorithms that facilitate efficient data synthesis, data curation, prompt engineering, and model evaluation. You will contribute to a company-wide effort to build robust modeling pipelines that optimize our ability to iterate rapidly and continuously deliver improvements to our customers. Finally, you will help define and refine new features that expand both the depth of Apple Intelligence&rsquo;s capabilities and the breadth of its support for the full spectrum of Apple customers&quot;,&quot;responsibilities&quot;:&quot;Development and maintenance of data and model pipelines that scale to deployment in production 
 
Building toolkits for iterating on model quality via data synthesis and prompt engineering 
 
Definition of robust automated evaluation mechanisms to facilitate hillclimbing on model quality 
 
Failure analysis from user feedback to understand shortcomings of our models and evaluation data 
 
Research into state-of-the-art techniques for improving model quality and robustness 
 
Implementation of experiments and simulations to assess the value of model changes 
 
Preferred Qualifications 
 
Familiarity with LLMs, such as SFT, RHLF, prompt engineering, data synthesis, automatic evaluation, and RAG 
 
Expertise in MLOps and a passion for software quality, based on CI/CD principles 
 
Excellent written and verbal communication skills 
 
Background in linguistics, fluency in multiple languages, or a passion for scaling NLP features for global audiences 
 
History of developing Python packages and supporting users and other teams 
 
Minimum Qualifications 
 
MS or PhD in Computer Science or related field with at least 2 years of industry experience 
 
Strong Python programming skills, with experience developing production-quality Python modules 
 
Experience building and maintaining model pipelines end-to-end, from data curation to evaluation 
 
Solid background in machine learning, data science, natural language processing, or statistics 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $139,500 and $258,100, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Machine Learning Engineer, Natural Language Generation

<div>Do you want to play a part in the next revolution in Foundation Models? Contribute to model hillclimbing for Apple Intelligence features that leverage Apple Foundation Models, and work with the people who built the intelligent products that helps millions of people get things done - just by asking or typing? 
 
The vision for the AI/ML FM Data organization is to improve Foundation Models by leveraging data from a variety of sources: crawl, license, vendor and internal crowd-sourcing. As a Sr Software Engineering on the team, you will drive backend innovations, identify key opportunity areas where data can play a crucial role and experiment with various data augmentation strategies to improve model training efficiency and performance.. 
 
Description 
 
We are looking for people with a track record in building scalable pipelines and services. Join us, and impact hundreds of millions of customers across billions of their interactions with foundation model powered Apple Intelligence features, that are available on iPhone, iPad, HomePod, Mac, Watch, CarPlay, and tv across more than 30 languages! 
 
As a Sr Backend Software engineer, you will be responsible for the following areas. 
 
<ul><li>Training data pipeline development. Convert raw data into format acceptable by training jobs on GCP and AWS. Leverage internal and open-sourced training modules.</li></ul> 
<ul><li>Large scale inferences: Leverage internal and open-sourced inference stack to generate inferences with fine-tuned LLMs on massive amounts of data, for pre-train and post-training</li></ul> 
<ul><li>Data processing and data filtering: Have the ability to efficiently process and filter very large amounts of data, often times messy.</li></ul> 
<ul><li>Scalable web services backend and APIs to support data access and data inspection tools</li></ul> 

Preferred Qualifications 
 
Familiarity with streaming-processing (Kafka). Familiarity with a variety of build tools (Jenkins, Maven, Docker, Gradle). 
 
Experience providing architecture and design guidance. 
 
A good communicator with clear and concise, active listening and empathy skills. 
 
Are self-motivated and curious. Strive to continually learn on the job. 
 
Have demonstrated creative and critical thinking with an innate drive to improve how things work. Have a high tolerance for ambiguity. 
 
Minimum Qualifications 
 
BS in Computer Science or Equivalent. 
 
10+ years of programming experience in Python. Extensive experiences in concurrency and parallelism, functional programming, decorators. Familiarity in other programming languages (Java/GoLang/Rust/Swift). 
 
Proficient in REST API, Redis, VectorDB or other large scale data storage systems. 
 
Solid foundational programming skills (algorithms, data structures, OOP, etc). 
 
Experience designing, writing, reviewing, testing and delivering software for applications and systems at scale. 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $139,500 and $258,100, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</div>

AIML - Sr Backend Engineer, Data and ML Innovation

We&rsquo;re building the next generation of AI evaluation systems - and we&rsquo;re looking for a 
 
motivated early-career engineer who&rsquo;s excited to work at the intersection of ML, 
 
software, and product. You&rsquo;ll join a team focused on making AI systems - including 
 
LLMs and agentic AI - more measurable, testable, and trustworthy in real-world 
 
scenarios. 
 
This is a hands-on, collaborative role ideal for someone with a strong foundation in 
 
software engineering and machine learning, and an eagerness to grow by building tools 
 
and systems that help evaluate advanced AI behavior at scale. 
 
Description 
 
As an Applied ML Engineer on our team, you&rsquo;ll help develop simulation systems, 
 
support data tooling, and contribute to evaluation workflows that improve the reliability 
 
of modern AI. You&rsquo;ll collaborate closely with experienced engineers and researchers, 
 
learning how to instrument, monitor, and analyze model behavior - especially for 
 
language models and agent-style systems. 
 
This is a great opportunity for someone early in their career to work with cutting-edge AI 
 
technologies in a high-impact, supportive environment. You&rsquo;ll gain experience working 
 
with large-scale ML systems, learn best practices in applied AI, and grow your skills 
 
across engineering, product, and research.&quot;,&quot;responsibilities&quot;:&quot;Contribute to systems that simulate interactive behaviors (including LLM-driven 
 
agents) 
 
Help build tools to support dataset generation and evaluation workflows 
 
Assist in developing pipelines for structured insights from model behavior 
 
Collaborate with teammates to debug and improve evaluation systems 
 
Write clean, testable code to support scalable and reliable infrastructure 
 
Learn how to define metrics that connect model behavior to real-world outcomes 
 
Preferred Qualifications 
 
Coursework or internship experience in ML, AI systems, or applied data science 
 
Familiarity with training or evaluating models (even via coursework or personal 
 
projects) 
 
Exposure to tools like PyTorch, TensorFlow, or Hugging Face 
 
Interest in AI observability, behavior simulation, or synthetic data 
 
Passion for working cross-functionally in fast-moving, exploratory teams 
 
Minimum Qualifications 
 
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Machine Learning, or related field 
 
Strong programming skills in Python or another modern language (e.g., Java, Swift, 
 
Go) 
 
Basic understanding of machine learning principles 
 
Interest in LLMs, generative AI, or agent-based systems 
 
Curiosity about how to evaluate and improve real-world AI performance 
 
Strong collaboration and communication skills 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $120,300 and $210,100, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Applied ML Engineer - AI/ML Evaluation & Simulation

<div>Imagine what you could do here. At Apple, great new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish! Are you passionate about music, movies, and the world of Artificial Intelligence and Machine Learning? So are we! Join our Human-Centered AI team for Apple Products. In this role, you'll represent the user perspective on new features, review and analyze data, and evaluate AI models powering everything from search and recommendations to other innovative features. Collaborate with Data Scientists, Researchers, and Engineers to drive improvements across our platforms. 
 
Description 
 
We are looking for an Evaluation &amp; Insights Engineer for the Human-Centered AI team to help evaluate and improve AI systems by combining data science, model behavior analysis, and qualitative insights. In this role, you will analyze AI outputs, develop evaluation frameworks, design qualitative, and translate findings into actionable improvements for product and engineering teams. This role blends deep technical expertise with strong analytical judgment to assess, interpret, and improve the behavior of advanced AI models. You will work cross-functionally with the Engineering and Project Managers, Product, and Research teams to ensure that AI experience is reliable, safe, and aligned with human expectations.&quot;,&quot;responsibilities&quot;:&quot;AI Evaluation &amp; Data Analysis - Lead complex evaluations of model behavior, identifying issues in reasoning, factuality, interaction quality, safety, fairness, and user alignment. 
 
Build evaluation datasets, annotation schemas, and guidelines for qualitative assessments. 
 
Develop qualitative + semi-quantitative scoring rubrics for measuring human-perceived quality (e.g., helpfulness, factuality, clarity, trustworthiness). 
 
Run structured evaluations of model iterations and summarize strengths/weaknesses based on qualitative evidence. 
 
Translate qualitative findings into clear loss patterns and actionable insights. 
 
Data Science &amp; Modeling - Collaborate with model developers to refine model behavior using findings from qualitative outputs. 
 
Use statistical and computational methods to identify patterns in qualitative data (e.g., assigning loss patterns, error taxonomies, thematic categorization). 
 
Integrate qualitative evaluations with quantitative metrics (e.g., Precision@k, MRR, perplexity, accuracy, performance KPIs). 
 
Build dashboards, scripts, or workflows that codify evaluation metrics and automate portions of qualitative assessments. 
 
Framework &amp; Pipeline Development - Create scalable pipelines for reviewing, annotating, and analyzing model outputs. 
 
Define evaluation frameworks that capture nuanced human factors (e.g., uncertainty, trust calibration, conversational quality, interpretability). 
 
Develop automated evaluation pipelines that collect, automatically judge, and analyze model outputs with respect to evaluation guidelines, at scale 
 
Develop processes to track feature quality and model performance over time and flag regressions. 
 
Work with product teams to ensure AI behaviors align with real-world user expectations. 
 
Cross-Functional Collaboration with ML and data scientists, software developers, project managers, and other teams at Apple to understand requirements and translate them into scalable, reliable, and efficient evaluation frameworks. 
 
Preferred Qualifications 
 
<ul><li>Experience working directly with LLMs, generative AI systems, or NLP models.</li></ul> 
Familiarity with evaluations specific to AI quality, hallucination detection, or model alignment. 
 
Experience building internal tools, scripts, or dashboards for evaluation workflows. 
 
Familiarity with prompt engineering, RAG systems, or model fine-tuning. 
 
Experience evaluating LLMs, multimodal models, or other generative AI systems at scale. 
 
Expertise in designing annotation guidelines and managing large scale annotation projects. 
 
Background in human factors, social science, or qualitative assessment methodologies. 
 
Proficiency in a language besides English. 
 
Minimum Qualifications 
 
Bachelor&rsquo;s or Master&rsquo;s degree in Data Science, Computer Science, Linguistics, Cognitive Science, HCI, Psychology, or a related field. 
 
At least 5+ years of relevant job experience. 
 
Proficiency in Python for data analysis (pandas, NumPy, Jupyter, etc.). 
 
Experience working with large datasets and designing model-evaluation pipelines, taxonomies, categorization schemes, or structured rating frameworks. 
 
Analytical Strength: Ability to interpret unstructured data (text, transcripts, user sessions) and stitch together qualitative and quantitative findings into actionable guidance. 
 
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $139,500 and $258,100, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</div>

Evaluation & Insights Engineer

Explore 185+ Aiml sr data engineer evaluation in Seattle this March. Find roles across top companies and apply now to boost your career.