aiml - applied ml engineer, data generation & verification

aiml - sr backend engineer, data and ml innovation

store designer, worldwide grocery real estate

associate creative director (hybrid - seattle, wa)

machine learning engineer Jobs in Seattle

machine learning engineer

agentic ai engineer — healthcare ai Jobs in Seattle

agentic ai engineer — healthcare ai

aiml - applied ml engineer, data generation & verification Jobs in Seattle

aiml - sr backend engineer, data and ml innovation Jobs in Seattle

aws data engineer

cloud hardware dev engineer aws generative ai ml servers aws generative ai ml servers

Amazon.com

<div><h2 class="jobSectionHeader">DESCRIPTION</h2>
Do you want to build the backbone of Generative AI cloud at AWS? Do you want to build the future of the cloud for AI training and inference? Want to do industry leading work delivering continuous price performance improvements in the cloud for AI model training for multi billion variable LLMs? Come Join us in designing, delivering and operating AWS cloud offerings that enable high performance and scalability in AI/ML and HPC workloads. 
 
Utility Computing (UC) 
AWS Utility Computing (UC) provides product innovations &mdash; from foundational services such as Amazon&rsquo;s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS&rsquo;s services and features apart in the industry. As a member of the UC organization, you&rsquo;ll support the development and management of Compute, Database, Storage, Internet of Things (IoT), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for their cloud services. 
 
You&rsquo;ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You&rsquo;ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you&rsquo;ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. 
 
Key job responsibilities 
As a Cloud Hardware Development Engineer on the AWS Generative AI &amp; ML Servers team, you will partner with EC2 to define server architectures based on workload demand and customer requirements. You will translate these architectures into detailed supporting designs and component specifications that enable high-performance AI training and inference at scale. 
You will define and drive validation strategies from PCBA bring-up through server and rack integration, ensuring designs meet performance, thermal, mechanical, power, and signal integrity requirements. Working with interdisciplinary teams of component, firmware, test, qualification, and integration engineers, you will lead design and manufacturing partners through development and production. 
You will be responsible for triaging hardware issues at both ODM facilities and datacenters, conducting root cause analysis, and implementing corrective actions. After launch, you will oversee the fleet of servers you develop, monitoring quality metrics and ensuring they meet customer requirements while identifying opportunities for continuous improvement. 
 
A day in the life 
Your day to day responsibilities will include interfacing with internal customers to understand project requirements and facilitate system development. You will work directly with EC2 teams to align on architecture decisions and translate workload requirements into technical specifications. You will be responsible for learning operational challenges in the existing fleet with the goal of improving customer experience and developing improved systems for future designs. You will work directly with vendors and ODM/JDM design teams to develop and manufacture your product at scale, driving design reviews, resolving technical issues, and ensuring quality throughout the development lifecycle. 
 
About the team 
The team is comprise of both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with the common goal of delivering the best Accelerated Server fleet possible to our customers. 
 
*Why AWS* 
Amazon Web Services (AWS) is the world&rsquo;s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating &mdash; that&rsquo;s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. 
 
*Diverse Experiences* 
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn&rsquo;t followed a traditional path, or includes alternative experiences, don&rsquo;t let it stop you from applying. 
 
*Work/Life Balance* 
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there&rsquo;s nothing we can&rsquo;t achieve in the cloud. 
 
*Inclusive Team Culture* 
Here at AWS, it&rsquo;s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (diversity) conferences, inspire us to never stop embracing our uniqueness. 
 
*Mentorship and Career Growth* 
We&rsquo;re continuously raising our performance bar as we strive to become Earth&rsquo;s Best Employer. That&rsquo;s why you&rsquo;ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.<h2 class="jobSectionHeader">
BASIC QUALIFICATIONS</h2><ul><li>Bachelor's degree in Electrical Engineering, Computer Engineering, or equivalent</li><li>2+ years of hardware design, development and validation experience for server or compute platforms</li><li>Experience in one or more server technologies: thermal/mechanical design, power delivery, high-speed signal integrity, or accelerator subsystems</li><li>Experience developing functional specifications, design verification plans, and validation test procedures</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>Master's degree in Electrical Engineering, Computer Engineering, or a related field</li><li>2+ years of experience working with ODMs through product development and manufacturing lifecycle</li><li>Experience in high-speed bus design, signal integrity, or power delivery for server/compute platforms</li><li>2+ years experience working with hardware bring-up, debug, or validation of GPU/accelerator platforms</li><li>Familiarity with PCIe topology, NVMe, and accelerator interconnects</li><li>Experience developing and executing test procedures for electrical or mechanical systems</li><li>Experience working in large-scale datacenter or cloud environments</li></ul> 
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. 
 
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company&rsquo;s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 
 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner. 
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. 
USA, CA, Cupertino - 157,300.00 - 212,800.00 USD annually 
USA, TX, Austin - 136,000.00 - 184,000.00 USD annually 
USA, WA, Seattle - 136,000.00 - 184,000.00 USD annually</div>

Cloud Hardware Dev Engineer (AWS Generative AI & ML Servers), AWS Generative AI & ML Servers

Amazon Web Services

Job OverviewWe are seeking a dynamic and innovative Machine Learning Engineer to join our forward-thinking team. In this role, you will be at the forefront of developing, implementing, and optimizing advanced machine learning models and AI solutions. Your expertise will drive data-driven decision-making, enhance predictive analytics, and support scalable AI applications across diverse platforms. This position offers an exciting opportunity to work with cutting-edge technologies in big data systems, cloud services, and natural language processing to shape the future of intelligent solutions.Duties<ul><li>Design, develop, and deploy machine learning models utilizing frameworks such as TensorFlow and other AI tools to solve complex business problems.</li><li>Implement scalable data pipelines using ETL processes and big data systems like Hadoop and Spark to prepare data for analysis and model training.</li><li>Conduct statistical modeling and analysis to extract insights from large datasets, supporting research and strategic initiatives.</li><li>Collaborate with cross-functional teams to integrate AI models into production environments using cloud services such as AWS and machine learning cloud platforms.</li><li>Optimize model performance through rigorous evaluation, tuning, and validation techniques including model evaluation metrics and predictive modeling analysis.</li><li>Develop natural language processing applications to enhance text analysis capabilities within products or research projects.</li><li>Maintain comprehensive documentation of algorithms, processes, and system architecture while ensuring scalability and robustness of deployed models.</li></ul>Skills<ul><li>Proficiency in programming languages such as Python, Java, C, R, and Bash (Unix shell) for data analysis, model development, and automation tasks.</li><li>Extensive experience with machine learning frameworks including TensorFlow, Spark implementation, and generative AI techniques.</li><li>Strong knowledge of big data technologies like Hadoop, Spark, Talend, and SQL databases for efficient data mining and analytics.</li><li>Expertise in statistical analysis tools such as SAS or R for research-driven insights and statistical modeling.</li><li>Hands-on experience with AI implementation in cloud environments like AWS or other machine learning cloud services for scalable deployment.</li><li>Familiarity with database design principles, SQL query optimization, and data analytics to support complex data workflows.</li><li>Understanding of natural language processing (NLP), AI models development, model training strategies, evaluation methods, and deployment best practices.</li><li>Knowledge of data integration tools such as Talend for efficient ETL workflows; experience with Looker for data visualization is a plus.</li><li>Ability to work on large-scale big data systems involving scalability challenges in real-time analytics environments.</li></ul>Join us to leverage your expertise in machine learning/AI-based analysis to revolutionize how data transforms into actionable insights!Pay: $192,000.00 - $229,000.00 per yearBenefits:<ul><li>401(k)</li><li>Flexible spending account</li><li>Parental leave</li><li>Relocation assistance</li></ul>Work Location: In person

Machine Learning Engineer

<div><h2 class="jobSectionHeader">DESCRIPTION</h2><div>
Come shape the future with us! As a major cloud provider, our technology powers many of the world's largest organizations. We are building an exciting Generative AI application that will transform how enterprises operate. 
 
You will have the exciting opportunity to be on the ground floor of developing this exciting product. We are seeking creative problem-solvers who are energized by tackling complex technical challenges to push the boundaries of what's possible with AI. Our team collaborates closely across roles to rapidly build, test and iterate as we create an AI solution that delivers real business value. Join our innovative team to leave your mark on the next generation of AI. This is an exciting role, with high visibility and high impact, leading several customer facing initiatives under the Amazon Quick organization. The ideal candidate will have a strong technical background in front-end development, excellent leadership skills, and a passion for delivering high-quality user experiences.
 
 
Key job responsibilities 
As a lead software development engineer on the Amazon Quick team, you will design and develop features for the Amazon Quick product. You will work with senior scientists and engineers within Amazon AI and develop high quality software that is robust and reliable. 
 
You will be responsible for 
<ul><li>Deciding what features and performance improvements to build</li><li>Driving software engineering best practices</li><li>Designing distributed and scalable systems</li><li>Providing technical leadership and contribute to the definition, development, integration, test, documentation, and support new AI Services</li><li>Instill best practices for software development and documentation, making sure designs meet requirements, and delivering high quality software on tight schedules</li></ul> 
About the team 
Diverse Experiences 
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn&rsquo;t followed a traditional path, or includes alternative experiences, don&rsquo;t let it stop you from applying.
 
 
Why AWS? 
Amazon Web Services (AWS) is the world&rsquo;s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating &mdash; that&rsquo;s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. 
 
Inclusive Team Culture 
Here at AWS, it&rsquo;s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness. 
 
Mentorship &amp; Career Growth 
We&rsquo;re continuously raising our performance bar as we strive to become Earth&rsquo;s Best Employer. That&rsquo;s why you&rsquo;ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
 
 
Work/Life Balance 
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there&rsquo;s nothing we can&rsquo;t achieve in the cloud.
</div><h2 class="jobSectionHeader">BASIC QUALIFICATIONS</h2><ul><li>5+ years of non-internship professional software development experience</li><li>5+ years of programming with at least one software programming language experience</li><li>5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience</li><li>Experience as a mentor, tech lead or leading an engineering team</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience</li><li>Bachelor's degree in computer science or equivalent</li></ul> 
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. 
 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner. 
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. 
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually</div>

Senior Software Development Engineer, Amazon Quick

Expedia Group

<div>At Expedia Group, we help travelers explore the world, one journey at a time. As a global travel company powered by passionate people, trusted partnerships, and leading technology, we connect travelers, partners, and advertisers through our consumer brands, B2B network, and travel advertising business. 
 
Here, you'll do meaningful work that helps millions of people discover, book, and experience travel with more ease, confidence, and joy. Our five Behaviors-Traveler First, Think Big, Operate with Excellence, Ownership Mindset, and Succeed Together-help foster a supportive environment where people can grow their careers and have the flexibility, benefits, and support to do their best work. Join us and build for travelers everywhere.
Introduction to the Product Team
 
The Product Team creates high-quality end-to-end experiences for travelers, partners, and Expedia Group. Our customer-first mindset focuses on developing products that encourage loyalty and repeat business from our travelers and partners. We partner closely with teams across Expedia Group to achieve growth and results for our customers and company.
We connect Travelers to new experiences, through trusted relationships. We use the power of Expedia Group brands to empower strategic partners to nurture and grow the existing relationship with their audience. Strategic Partnerships and Affiliates breadth of solutions which include cashback, travel offers, loyalty exchange, co-branded sites, Affiliate APIs and EG&rsquo;s Affiliate Program, bring a partners&rsquo; audience onto EG sites, thereby increasing EG&rsquo;s traffic and exposure.
Introduction to the Layla Team
Layla is an AI-native travel-planning and booking company, now part of Expedia Group&rsquo;s Product organization. Through a conversational travel assistant, Layla helps travelers move from inspiration to a complete, bookable itinerary &mdash; flights, hotels, activities, and the day-by-day detail &mdash; in minutes. As part of Expedia Group, the team combines Layla&rsquo;s planning and personalization capabilities with Expedia Group&rsquo;s global supply, first-party traveler insights, marketplace scale, and booking technology.
The team is small and senior by design and operates with startup pace: you own a surface, ship it, and see the impact on real travelers within weeks &mdash; with decisions driven by data and AI tooling used in practice every day.
As a Senior AI / ML Data Engineer, you will build the data foundations that power Layla&rsquo;s AI-native travel experiences &mdash; the reliable pipelines, high-quality datasets, and experimentation and evaluation support that let the team ship and improve AI/ML systems in production with confidence.
In this role, you will:
<ul><li>Design, build, and operate reliable, scalable data pipelines that power Layla&rsquo;s AI-native trip-planning and booking experiences across Layla and Bellboy.
</li><li>Own data quality, reliability, and observability across critical datasets, establishing well-documented, trustworthy data models that other teams can confidently extend.
</li><li>Build and support the data foundations for experimentation and model evaluation, enabling honest, timely readouts that inform product and AI/ML decisions.
</li><li>Enable the production use of AI/ML systems &mdash; supporting feature and data availability, evaluation datasets, and monitoring &mdash; while applying AI/ML concepts responsibly.
</li><li>Partner closely with Product, Analytics, and ML/engineering teams to turn ambiguous questions into dependable data and self-serve answers.
</li><li>Advocate for engineering excellence in data &mdash; testing, documentation, and reusable patterns &mdash; and mentor other engineers on best practices.
</li></ul>Minimum Qualifications:
<ul><li>Bachelor&rsquo;s degree in Computer Science, Data Engineering, or a related technical field; or equivalent related professional experience.
</li><li>8+ years of relevant professional experience.
</li><li>Strong data engineering expertise, including advanced SQL and data modeling, and experience designing and operating production data pipelines.
</li><li>Proficiency with Python for data engineering work.
</li><li>Demonstrated ability to own data quality, reliability, and observability for critical datasets in production.
</li><li>Familiarity with supporting AI/ML systems in production &mdash; such as data/feature pipelines, evaluation datasets, or experimentation &mdash; and applying AI/ML concepts to real-world products responsibly.
</li></ul>Preferred Qualifications:
<ul><li>Experience with a modern data stack (for example, a transformation framework such as dbt, a cloud warehouse such as BigQuery or Snowflake, and BI tools such as Looker or Metabase).
</li><li>Experience building and maintaining experimentation frameworks and product analytics for a consumer product with real paid acquisition.
</li><li>Experience with attribution modeling, including an understanding of its limitations.
</li><li>Experience supporting production AI/ML or generative-AI systems (feature pipelines, evaluation, or monitoring), with attention to safety and responsible use.
</li><li>Experience using AI-assisted development tools (for example, Claude or similar) to improve productivity, quality, and delivery speed.
</li><li>Experience in travel, marketplace, or e-commerce domains, or building a data/analytics function from scratch.
</li></ul>Expedia Group is proud to offer a wide range of benefits to support employees and their families, including medical/dental/vision, paid time off, and an Employee Assistance Program. To fuel each employee&rsquo;s passion for travel, we offer a wellness &amp; travel reimbursement, travel discounts, and an International Airlines Travel Agent (IATAN) membership. View our full list of benefits .
The total cash range for this position in Seattle is $184,500.00 to $258,000.00. Employees in this role have the potential to increase their pay up to $295,000.00, which is the top of the range, based on ongoing, demonstrated, and sustained performance in the role.&amp;#xa;The total cash range for this position in Austin is $184,500.00 to $258,000.00. Employees in this role have the potential to increase their pay up to $295,000.00, which is the top of the range, based on ongoing, demonstrated, and sustained performance in the role. 
 
Starting pay for this role will vary based on multiple factors, including location, available budget, and an individual&rsquo;s knowledge, skills, and experience. Pay ranges may be modified in the future. 
 
Benefits and perks
Expedia Group offers benefits and perks designed to support employees and their families, including medical, dental, and vision coverage, paid time off, an Employee Assistance Program, wellness and travel reimbursement, travel discounts, and International Airlines Travel Agent Network (IATAN) membership. Learn more about life at Expedia Group at https://careers.expediagroup.com/life . 
 
Accommodation requests
Expedia Group is committed to providing an inclusive and accessible recruiting experience. If you need an accommodation or adjustment due to a disability during the application or recruiting process, please submit a request at https://expedia.service-now.com/askeg?id=job_accommodation . 
 
About Expedia Group
Expedia Group includes three flagship consumer brands - Expedia, Hotels.com, and Vrbo - along with a leading B2B travel business and travel advertising offerings. Across our brands and business, we help travelers explore the world with confidence and ease. 
 
Important notice
Employment opportunities and job offers at Expedia Group will always come from Expedia Group's Talent Acquisition and hiring teams. Never share sensitive personal information unless you are confident of the recipient. Expedia Group does not extend job offers via email or messaging tools to individuals with whom we have not made prior contact. Our email domain is @expediagroup.com. The official place to find and apply for roles is https://careers.expediagroup.com/jobs/ . 
 
Equal Opportunity
Expedia is committed to creating an inclusive work environment with a diverse workforce. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or any other characteristic protected by law. This employer participates in E-Verify. The employer will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee's I-9 to confirm work authorization.</div>

Senior AI / ML Data Engineer - Layla AI

Apple

Apple Services Engineering (ASE) powers the AI and LLM features behind experiences that hundreds of millions of users love every day. As these systems increasingly rely on human-in-the-loop evaluation, the quality of our products is directly constrained by the quality of our evaluation systems. We believe that to build exceptional AI, you need exceptional mechanisms to validate the signals used to train and evaluate them. 
 
Description 
 
The Human-centered AI, ML Data Quality Operations team is looking for a Senior Applied Scientist to join our growing team. We are building the systems and methodologies that make AI evaluation trustworthy, and scalable - directly shaping how Apple develops and validates AI across products and services. In this role, you will develop novel, scalable quality control solutions, working closely with cross-functional teams to ensure the data powering our AI/ML systems meets the highest standards of accuracy, consistency, and relevance. Your work will span the full lifecycle of quality assurance for AI and human judgments - from real-time validation and human-verified ground truth generation, to root-cause analysis that turns disagreements into corrective action. This role demands fluency across research thinking and engineering execution - you will prototype, validate, and ship. A strong point of view on when not to use a model or agent is as valued here as the ability to build one. 
 
&quot;,&quot;responsibilities&quot;:&quot;Design and implement scalable ground truth generation pipelines across varied task types, annotation modalities, and cold start conditions 
 
Build and maintain real-time monitoring systems that detect drift, distribution shifts, and quality degradation as they emerge across live evaluation and annotation pipelines. 
 
Design calibration frameworks that periodically re-anchor LLM evaluators against human-verified gold sets, correcting drift before it compounds. 
 
Build root-cause analysis tooling that surfaces disagreement patterns between automated and human judgments, and feeds findings directly into annotator training and guideline refinement. 
 
Partner closely with downstream users of these systems -ML teams, LLM-as-a-Judge (evaluator) developers, annotators - to ground design decisions in real feedback and usage patterns, not just architecture. 
 
Communicate findings and recommendations clearly to both technical and non-technical stakeholders 
 
Preferred Qualifications 
 
PhD in Computer Science, Machine Learning, Statistics, or a related field 
 
Experience in designing systems or tooling that are configurable and extensible by practitioners who did not build them 
 
Strong communication skills with the ability to influence technical direction across cross-functional teams 
 
Demonstrated passion for leveraging AI to improve work efficiency and scale 
 
Minimum Qualifications 
 
5+ years of industry experience in applied science or machine learning, with demonstrated experience building or operating production-grade evaluation, annotation, or quality-assurance pipelines. 
 
Hands-on experience designing ground truth generation pipelines across varied task types and annotation modalities, including cold-start scenarios with limited existing data. 
 
Experience building real-time monitoring or anomaly/drift detection systems for live data or ML pipelines. 
 
Working knowledge of evaluation methodology for generative AI - including LLM-as-a-judge design, meta-evaluation, failure mode analysis, and calibration/reference-guided grading techniques 
 
Strong software engineering fundamentals and proficiency in Python and relevant ML frameworks, with production experience building, deploying, and monitoring LLM-based pipelines and agents. 
 
Demonstrated ability to work directly with downstream users/stakeholders to incorporate feedback into system design, and to communicate findings clearly to both technical and non-technical audiences. 
 
MS or PhD in Computer Science, Machine Learning, Statistics, or a related quantitative field, or equivalent practical experience. 
 
Pay &amp; Benefits 
 
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $142,300 and $263,300, and your base pay will depend on your skills, qualifications, experience, and location. 
 
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits 
 
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Sr. Applied Scientist, AI Evaluation & Quality Systems

<div><h2 class="jobSectionHeader">DESCRIPTION</h2>
As part of the AWS Applied AI Solutions organization, we have a vision to provide business applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions. Where customers prefer to buy over build, we become their trusted partner with solutions that are no-brainers to buy and easy to use. 
 
The Amazon Agentic WorkSpaces organization is building the future of secure, high-performance agentic WorkSpaces Applications environments &mdash; environments that span desktops and 
applications, serving knowledge workers, task workers, and automation agents at millions-of-user scale. 
 
## The role 
 
The Amazon Agentic WorkSpaces organization is seeking a Software Development Manager to lead the engineering team behind Amazon WorkSpaces Advisor, our AI-powered troubleshooting and 
optimization experience for administrators. We are building agentic solutions that analyze fleet telemetry, diagnose root causes, and recommend or apply fixes &mdash; turning problems that once 
took days of manual investigation into answers delivered in minutes. Our aim is to make virtual desktop and application environments effectively self-diagnosing, so administrators spend 
their time on strategic work instead of chasing symptoms across consoles and logs. 
 
You will lead a team of software engineers building at the intersection of applied AI and large-scale distributed systems. You will own Advisor end to end &mdash; expanding the range of problems it can solve, raising the accuracy and trustworthiness of its recommendations, and advancing it from reactive troubleshooting toward proactive detection and self-healing. In 
addition, your team owns a set of Control Plane Services through which customers provision, configure, and manage their environments, where you will be accountable for availability, latency, security posture, and operational health. This role offers the opportunity to build new agentic products from the ground up while operating production services that customers 
depend on every day. 
You will influence the technical direction of the team and work across many different technologies and disciplines. You will raise the engineering bar &mdash; design rigor, code quality, test coverage, and safe deployment practices &mdash; and champion an AI-native, automation-first approach to how software gets built and operated, using agentic tooling to increase velocity without 
trading away quality. You will identify technology gaps and opportunities and write effective communications including design documents, tenets, and PR/FAQs. Above all, you will hire, grow, and retain engineers who scale with the business. 
 
About the team 
ABOUT AWS: 
 
Diverse Experiences
 
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn&rsquo;t followed a traditional path, or includes alternative experiences, don&rsquo;t let it stop you from applying.
 
 
Why AWS
 
Amazon Web Services (AWS) is the world&rsquo;s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating &mdash; that&rsquo;s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. 
 
Work/Life Balance
 
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there&rsquo;s nothing we can&rsquo;t achieve in the cloud.
 
 
Inclusive Team Culture
 
Here at AWS, it&rsquo;s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity and AmazeCon conferences, inspire us to never stop embracing our uniqueness. 
 
Mentorship and Career Growth 
We&rsquo;re continuously raising our performance bar as we strive to become Earth&rsquo;s Best Employer. That&rsquo;s why you&rsquo;ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. 
 
<h2 class="jobSectionHeader">BASIC QUALIFICATIONS</h2><ul><li>Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field</li><li>3+ years of engineering team management experience</li><li>7+ years of working directly within engineering teams experience</li><li>3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience</li><li>8+ years of leading the definition and development of multi tier web services experience</li><li>Knowledge of engineering practices and patterns for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations</li><li>Experience partnering with product or program management teams</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy</li><li>Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers</li><li>Experience delivering customer-facing features built on generative AI or agentic capabilities, including evaluating and improving output quality in production</li></ul> 
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. 
 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner. 
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. 
USA, WA, Seattle - 184,900.00 - 250,200.00 USD annually</div>

Software Development Manager, Agentic WorkSpaces Applications, Amazon Agentic WorkSpaces

Explore 17+ Cloud hardware dev engineer aws generative ai ml servers aws generative ai ml servers in Seattle this September. Find roles across top companies and apply now to boost your career.

17 cloud hardware dev engineer aws generative ai ml servers aws generative ai ml servers jobs In Seattle

Cloud Hardware Dev Engineer (AWS Generative AI & ML Servers), AWS Generative AI & ML Servers

Machine Learning Engineer

Senior Software Development Engineer, Amazon Quick

Senior AI / ML Data Engineer - Layla AI

Sr. Applied Scientist, AI Evaluation & Quality Systems

Sr. Applied Scientist, AI Evaluation & Quality Systems

Software Development Manager, Agentic WorkSpaces Applications, Amazon Agentic WorkSpaces