applied ml engineer - ai/ml evaluation & simulation

merchandising/sales representative, seattle

account-based marketing manager, retail and cpg, industry marketing

machine learning engineer Jobs in Seattle

machine learning engineer

software development engineer Jobs in Seattle

software development engineer

ai engineer (intern)

aiml - sr data engineer, evaluation Jobs in Seattle

aiml - sr data engineer, evaluation

applied ml engineer - ai/ml evaluation & simulation Jobs in Seattle

evaluation insights engineer

Apple

<div>Imagine what you could do here. At Apple, great new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish! Are you passionate about music, movies, and the world of Artificial Intelligence and Machine Learning? So are we! Join our Human-Centered AI team for Apple Products. In this role, you'll represent the user perspective on new features, review and analyze data, and evaluate AI models powering everything from search and recommendations to other innovative features. Collaborate with Data Scientists, Researchers, and Engineers to drive improvements across our platforms.<br>
<br>
<b>Description</b><br>
<br>
We are looking for an Evaluation &amp; Insights Engineer for the Human-Centered AI team to help evaluate and improve AI systems by combining data science, model behavior analysis, and qualitative insights. In this role, you will analyze AI outputs, develop evaluation frameworks, design qualitative, and translate findings into actionable improvements for product and engineering teams. This role blends deep technical expertise with strong analytical judgment to assess, interpret, and improve the behavior of advanced AI models. You will work cross-functionally with the Engineering and Project Managers, Product, and Research teams to ensure that AI experience is reliable, safe, and aligned with human expectations.&quot;,&quot;responsibilities&quot;:&quot;AI Evaluation &amp; Data Analysis - Lead complex evaluations of model behavior, identifying issues in reasoning, factuality, interaction quality, safety, fairness, and user alignment.<br>
<br>
Build evaluation datasets, annotation schemas, and guidelines for qualitative assessments.<br>
<br>
Develop qualitative + semi-quantitative scoring rubrics for measuring human-perceived quality (e.g., helpfulness, factuality, clarity, trustworthiness).<br>
<br>
Run structured evaluations of model iterations and summarize strengths/weaknesses based on qualitative evidence.<br>
<br>
Translate qualitative findings into clear loss patterns and actionable insights.<br>
<br>
Data Science &amp; Modeling - Collaborate with model developers to refine model behavior using findings from qualitative outputs.<br>
<br>
Use statistical and computational methods to identify patterns in qualitative data (e.g., assigning loss patterns, error taxonomies, thematic categorization).<br>
<br>
Integrate qualitative evaluations with quantitative metrics (e.g., Precision@k, MRR, perplexity, accuracy, performance KPIs).<br>
<br>
Build dashboards, scripts, or workflows that codify evaluation metrics and automate portions of qualitative assessments.<br>
<br>
Framework &amp; Pipeline Development - Create scalable pipelines for reviewing, annotating, and analyzing model outputs.<br>
<br>
Define evaluation frameworks that capture nuanced human factors (e.g., uncertainty, trust calibration, conversational quality, interpretability).<br>
<br>
Develop automated evaluation pipelines that collect, automatically judge, and analyze model outputs with respect to evaluation guidelines, at scale<br>
<br>
Develop processes to track feature quality and model performance over time and flag regressions.<br>
<br>
Work with product teams to ensure AI behaviors align with real-world user expectations.<br>
<br>
Cross-Functional Collaboration with ML and data scientists, software developers, project managers, and other teams at Apple to understand requirements and translate them into scalable, reliable, and efficient evaluation frameworks.<br>
<br>
<b>Preferred Qualifications</b><br>
<br>
<ul><li>Experience working directly with LLMs, generative AI systems, or NLP models.</li></ul><br>
Familiarity with evaluations specific to AI quality, hallucination detection, or model alignment.<br>
<br>
Experience building internal tools, scripts, or dashboards for evaluation workflows.<br>
<br>
Familiarity with prompt engineering, RAG systems, or model fine-tuning.<br>
<br>
Experience evaluating LLMs, multimodal models, or other generative AI systems at scale.<br>
<br>
Expertise in designing annotation guidelines and managing large scale annotation projects.<br>
<br>
Background in human factors, social science, or qualitative assessment methodologies.<br>
<br>
Proficiency in a language besides English.<br>
<br>
<b>Minimum Qualifications</b><br>
<br>
Bachelor&rsquo;s or Master&rsquo;s degree in Data Science, Computer Science, Linguistics, Cognitive Science, HCI, Psychology, or a related field.<br>
<br>
At least 5+ years of relevant job experience.<br>
<br>
Proficiency in Python for data analysis (pandas, NumPy, Jupyter, etc.).<br>
<br>
Experience working with large datasets and designing model-evaluation pipelines, taxonomies, categorization schemes, or structured rating frameworks.<br>
<br>
Analytical Strength: Ability to interpret unstructured data (text, transcripts, user sessions) and stitch together qualitative and quantitative findings into actionable guidance.<br>
<br>
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .<br>
<br>
<b>Pay &amp; Benefits</b><br>
<br>
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $139,500 and $258,100, and your base pay will depend on your skills, qualifications, experience, and location.<br>
<br>
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.<br>
<br>
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</div>

Evaluation & Insights Engineer

<p>We&rsquo;re building the next generation of AI evaluation systems - and we&rsquo;re looking for a<br>
<br>
motivated early-career engineer who&rsquo;s excited to work at the intersection of ML,<br>
<br>
software, and product. You&rsquo;ll join a team focused on making AI systems - including<br>
<br>
LLMs and agentic AI - more measurable, testable, and trustworthy in real-world<br>
<br>
scenarios.<br>
<br>
This is a hands-on, collaborative role ideal for someone with a strong foundation in<br>
<br>
software engineering and machine learning, and an eagerness to grow by building tools<br>
<br>
and systems that help evaluate advanced AI behavior at scale.<br>
<br>
<b>Description</b><br>
<br>
As an Applied ML Engineer on our team, you&rsquo;ll help develop simulation systems,<br>
<br>
support data tooling, and contribute to evaluation workflows that improve the reliability<br>
<br>
of modern AI. You&rsquo;ll collaborate closely with experienced engineers and researchers,<br>
<br>
learning how to instrument, monitor, and analyze model behavior - especially for<br>
<br>
language models and agent-style systems.<br>
<br>
This is a great opportunity for someone early in their career to work with cutting-edge AI<br>
<br>
technologies in a high-impact, supportive environment. You&rsquo;ll gain experience working<br>
<br>
with large-scale ML systems, learn best practices in applied AI, and grow your skills<br>
<br>
across engineering, product, and research.&quot;,&quot;responsibilities&quot;:&quot;Contribute to systems that simulate interactive behaviors (including LLM-driven<br>
<br>
agents)<br>
<br>
Help build tools to support dataset generation and evaluation workflows<br>
<br>
Assist in developing pipelines for structured insights from model behavior<br>
<br>
Collaborate with teammates to debug and improve evaluation systems<br>
<br>
Write clean, testable code to support scalable and reliable infrastructure<br>
<br>
Learn how to define metrics that connect model behavior to real-world outcomes<br>
<br>
<b>Preferred Qualifications</b><br>
<br>
Coursework or internship experience in ML, AI systems, or applied data science<br>
<br>
Familiarity with training or evaluating models (even via coursework or personal<br>
<br>
projects)<br>
<br>
Exposure to tools like PyTorch, TensorFlow, or Hugging Face<br>
<br>
Interest in AI observability, behavior simulation, or synthetic data<br>
<br>
Passion for working cross-functionally in fast-moving, exploratory teams<br>
<br>
<b>Minimum Qualifications</b><br>
<br>
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Machine Learning, or related field<br>
<br>
Strong programming skills in Python or another modern language (e.g., Java, Swift,<br>
<br>
Go)<br>
<br>
Basic understanding of machine learning principles<br>
<br>
Interest in LLMs, generative AI, or agent-based systems<br>
<br>
Curiosity about how to evaluate and improve real-world AI performance<br>
<br>
Strong collaboration and communication skills<br>
<br>
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .<br>
<br>
<b>Pay &amp; Benefits</b><br>
<br>
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $120,300 and $210,100, and your base pay will depend on your skills, qualifications, experience, and location.<br>
<br>
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.<br>
<br>
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</p>

Applied ML Engineer - AI/ML Evaluation & Simulation

<p>The Applied Machine Learning team builds production multimodal systems that understand and transform large-scale image, audio, and video content. Our work spans diffusion-based image generation, transcription and diarization, face and object detection, OCR and image description for search, and automated quality control of media pipelines.<br>
<br>
We are looking for a Staff Machine Learning Engineer to strengthen our diffusion and video models, adapt small and mid-sized LLMs, and turn our uniquely large corpus of weakly labeled media into a durable product advantage. This is an opportunity to shape the next generation of multimodal experiences end-to-end, from data and models to evaluation and user impact.<br>
<br>
<b>Description</b><br>
<br>
The Staff Machine Learning Engineer - Multimodal Generation &amp; Post-Training will be a senior individual contributor on a small, applied ML team focused on production multimodal systems. The role will lead fine-tuning and adaptation of diffusion and emerging video models, as well as post-training of small and medium LLMs for captioning, moderation, and retrieval-friendly descriptions.<br>
<br>
The engineer will design data and evaluation workflows that use our large archive of weakly labeled music, podcast, film, TV, and short-form content to drive measurable quality and efficiency improvements. The role includes close collaboration with partner infra teams for model serving and with adjacent product and research groups to bring new capabilities into production.<br>
<br>
<b>Preferred Qualifications</b><br>
<br>
PhD in Computer Science, Machine Learning, or a related technical field.<br>
<br>
8+ years of industry experience with production multimodal systems spanning image, audio, and/or video.<br>
<br>
Deep expertise with diffusion and video generation techniques (e.g., ControlNet/IP-Adapter, temporal consistency methods, sampling and latency optimization).<br>
<br>
Experience with PEFT/QLoRA and post-training approaches such as DPO or related preference-based methods for small and mid-sized LLMs.<br>
<br>
Background in ASR/VAD/diarization, OCR, multimodal retrieval, or face recognition with fine-grained temporal alignment.<br>
<br>
Familiarity collaborating with infra/platform teams on model serving (e.g., batching strategies, quantization, observability) and translating requirements into reliable production deployments.<br>
<br>
Demonstrated ability to define metrics, build evaluation harnesses, and communicate results clearly to cross-functional partners.<br>
<br>
Track record of publications, patents, or open-source contributions in relevant areas of machine learning or multimodal modeling.<br>
<br>
<b>Minimum Qualifications</b><br>
<br>
Master&rsquo;s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience.<br>
<br>
5+ years of hands-on industry experience building and shipping machine learning systems to production.<br>
<br>
Proven experience training and fine-tuning diffusion or other image/video generative models, including adapter-based methods such as LoRA.<br>
<br>
Proficiency in Python and at least one major deep learning framework such as PyTorch.<br>
<br>
Experience designing and operating ML pipelines for noisy or weakly labeled data, including offline evaluation and monitoring in production.<br>
<br>
Strong software engineering skills, including code quality, experimentation discipline, and debugging/profiling of model performance.<br>
<br>
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .<br>
<br>
<b>Pay &amp; Benefits</b><br>
<br>
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $201,300 and $302,200, and your base pay will depend on your skills, qualifications, experience, and location.<br>
<br>
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.<br>
<br>
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</p>

Staff Machine Learning Engineer, Apple Services Engineering

<p>From our origins in iPhone keyboard input, the Input Experience NLP team has expanded to a broad charter: improve the user experience with robust language understanding and personalized text composition, across languages and Apple platforms. We build the ML models that underlie Summarization, Smart Reply, Writing Tools, and other features deeply integrated into Apple products. Generative AI is a transformative technology that we have only just begun to incorporate into our digital lives, to help everyday people digest the deluge of information they receive and express themselves more clearly. On our team, you will help build the future and have a voice in the shape it takes.<br>
<br>
We are looking for a Machine Learning Engineer to develop the next generation of our ML models, so that they better serve the full range of our customers, across languages, writing styles, and other personal context, in a privacy-preserving way. You will build, run, and refine the training and evaluation pipelines that define our slice of Apple Intelligence, driving the focused experimentation and iteration that makes the user experience magical. You will join an ambitious, organized, and collaborative team. We&rsquo;re in a unique position to integrate the latest innovations from the ML community and work on features that reach everyday users, including your family and friends. You&rsquo;ll work closely with teams across Apple, collaborating on human interfaces, user studies, internationalization, ML technologies, system integration, and more.<br>
<br>
Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other&rsquo;s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It&rsquo;s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you&rsquo;ll do more than join something-you&rsquo;ll add something.<br>
<br>
<b>Description</b><br>
<br>
As a Machine Learning Engineer on our team, you will enable next-generation AI applications by building toolkits and workflows that scale to increasingly sophisticated modeling tasks. You will design the abstractions and implement the algorithms that facilitate efficient data synthesis, data curation, prompt engineering, and model evaluation. You will contribute to a company-wide effort to build robust modeling pipelines that optimize our ability to iterate rapidly and continuously deliver improvements to our customers. Finally, you will help define and refine new features that expand both the depth of Apple Intelligence&rsquo;s capabilities and the breadth of its support for the full spectrum of Apple customers&quot;,&quot;responsibilities&quot;:&quot;Development and maintenance of data and model pipelines that scale to deployment in production<br>
<br>
Building toolkits for iterating on model quality via data synthesis and prompt engineering<br>
<br>
Definition of robust automated evaluation mechanisms to facilitate hillclimbing on model quality<br>
<br>
Failure analysis from user feedback to understand shortcomings of our models and evaluation data<br>
<br>
Research into state-of-the-art techniques for improving model quality and robustness<br>
<br>
Implementation of experiments and simulations to assess the value of model changes<br>
<br>
<b>Preferred Qualifications</b><br>
<br>
Familiarity with LLMs, such as SFT, RHLF, prompt engineering, data synthesis, automatic evaluation, and RAG<br>
<br>
Expertise in MLOps and a passion for software quality, based on CI/CD principles<br>
<br>
Excellent written and verbal communication skills<br>
<br>
Background in linguistics, fluency in multiple languages, or a passion for scaling NLP features for global audiences<br>
<br>
History of developing Python packages and supporting users and other teams<br>
<br>
<b>Minimum Qualifications</b><br>
<br>
MS or PhD in Computer Science or related field with at least 2 years of industry experience<br>
<br>
Strong Python programming skills, with experience developing production-quality Python modules<br>
<br>
Experience building and maintaining model pipelines end-to-end, from data curation to evaluation<br>
<br>
Solid background in machine learning, data science, natural language processing, or statistics<br>
<br>
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .<br>
<br>
<b>Pay &amp; Benefits</b><br>
<br>
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $139,500 and $258,100, and your base pay will depend on your skills, qualifications, experience, and location.<br>
<br>
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.<br>
<br>
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</p>

Machine Learning Engineer, Natural Language Generation

Microsoft

<div><b>Overview</b><p><br>
Our sellers are key to how customers and partners understand Microsoft&rsquo;s products and strategies, but how do we align the conversations of thousands of sellers with each other and with the company&rsquo;s strategy? Making sure that the sellers are having the right conversations at the right time is key to the company&rsquo;s success, and the Worldwide Incentive Compensation team connects strategy to seller behavior in one of the most important ways: by aligning company aspirations with seller incentives.</p><p></p><p><br>
Worldwide Incentive Compensation (WWIC) is the team at Microsoft that is responsible for the design, implementation and operations related to the sales and incentive plans across all of Microsoft, impacting 40K+ employees. Our vision is to embody best-in-class, design-to-deployment incentive compensation that inspires sellers to maximize their success and rewards and enables sustainable growth, share, and customer success.</p><p></p><p><br>
The <b>Sr. Data Analyst - Quota Delivery</b> is key in enabling the benefits of AI agents in Quota Setting process. It blends technical expertise in data analytics with business acumen in sales compensation. You will partner with cross-functional teams to deliver quotas to sellers, build, and deploy AI agents, and deliver insights that influence processes and seller behavior. In addition, you will engage with diverse stakeholders, manage complex relationships, and drive innovation across the organization.</p><b><br>
Responsibilities</b><p><b><br>
Business and Data Landscape</b></p><ul><li>
Applies deep knowledge of the business, data landscape, tools, technologies, and data lineage across multiple domains.</li><li>
Connects business topics to relevant data sources and external trends, anticipating data and business requirements.</li><li>
Proactively frames business questions into analytical solutions and identifies opportunities to enhance or automate data infrastructure and insights.</li><li>
Builds strong cross‑functional connections to enable effective data sourcing, integration, and evaluation of business questions.</li><li>
Stays current on analytics tools, best practices, and regulatory changes, while coaching others to broaden business and data understanding.</li></ul><p></p><p><b><br>
Quota Delivery Excellence</b></p><ul><li><ul><li>
Lead continuous improvement and innovation across quota delivery processes to enable speed, quality, and strategic alignment. Initially focus on Microsoft Federal Organization and then expand to other business groups.</li><li>
Own end-to-end product lifecycle including requirement gathering, prioritization, roadmap creation, delivery execution, and post-launch measurement.</li><li>
Drive quality and scale across quota management processes and tools, including future-year business rules, in-year governance, standardized workflows, and tool functionality.</li></ul></li></ul><p></p><p><b><br>
AI Excellence and Data Analysis</b></p><ul><li><ul><li>
Apply large language models (LLMs), prompt engineering, evaluations, and agentic workflows to quota delivery and governance challenges.</li><li>
Assess existing quota and WWIC systems, data flows, and processes to identify AI-led automation and productivity opportunities.</li><li>
Build and iterate rapid prototypes of AI-enabled solutions improving decision support, data quality, and user experience.</li><li>
Drive continuous learning and AI capability building across the Quota Delivery team</li><li>
Establish feedback loops to measure AI impact on productivity, quality, and operational efficiency.</li><li>
Understands relationship between analytical model(s) and business objectives. Ability to create a clear connection between generated data models and business goals to evaluate how well these models achieve those objectives, while also identifying any gaps or missed areas.</li><li>
Ensures alignment on definitions and standards across stakeholders and defines, designs, and promotes the use of appropriate feedback and evaluation methods. Coaches and mentors are less experienced analysts than needed. Presents results and findings to senior stakeholders.</li></ul></li></ul><p></p><p><b><br>
Strategic Insights and Leadership</b></p><ul><li>
Own delivery of data-backed insights on quota strategy execution, effectiveness, risks, and opportunities.</li><li>
Leverage seller performance and quota data to inform current-year execution and future-year quota strategy and governance.</li><li>
Act as a trusted advisor to senior stakeholders, translating complex data and AI-driven insights into clear business narratives.</li></ul><br>
<b>
Qualifications</b><p><b><br>
Required/minimum qualifications</b></p><div>
Master's Degree in Mathematics, Analytics, Data Science, Engineering, Computer Science, Business, Economics or related field AND 2+ years experience in data analysis and reporting, data science, business intelligence, or business and financial analysis OR Bachelor's Degree in Statistics, Mathematics, Analytics, Data Science, Engineering, Computer Science, Business, Economics or related field AND 4+ years experience in data analysis and reporting, data science, business intelligence, or business and financial analysis <b>OR equivalent experience</b>.</div><div>
</div><div><b>
Other Requirements</b></div><div><p>
Citizenship &amp; Citizenship Verification: This position requires verification of U.S citizenship due to citizenship-based legal restrictions. Specifically, this position supports United States federal, state, and/or local United States government agency customers and is subject to certain citizenship-based restrictions where required or permitted by applicable law. To meet this legal requirement, citizenship will be verified via a valid passport.</p></div><div><b><br>
Preferred Qualifications</b><div><div><div><ul><li>
Experience with Artificial Intelligence (AI) Ethics issues around fairness, transparency, accountability, and ethics in relation to the use of artificial intelligence (AI).</li><li>
Experience detecting and correct corrupt or inaccurate records from a record set, table, or database and refers to identifying incomplete, incorrect, inaccurate, or irrelevant parts of the data and then replacing, modifying, or deleting as needed to maintain the integrity of the data.</li><li>
Experience with technical and business processes used to combine data from disparate sources into meaningful and valuable information to deliver a complete data integration solution.</li><li>
Experience maintaining and assuring the accuracy and consistency of data over its entire lifecycle in design, implementation, and usage of systems. This includes knowledge of data governance practices to ensure data quality and defined risk management surrounding the handling of data.</li><li>
Experience examing large databases to discover patterns and generate new information. This includes the use of machine learning, statistics, and database systems and aims toward extracting information from a data set and transforming the information into a comprehensive structure for further use.</li><li>
Experience with data modeling procedures and the ability to identify and clearly define the business data entities (for example, persons, places, things, concepts, events), attributes, and relationships between them. This includes the ability to read, understand, and develop test data models.</li></ul></div></div></div></div><br>
<div></div>
<br>
<br>
<p>Data Analytics IC4 - The typical base pay range for this role across the U.S. is USD $106,400 - $203,600 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $137,600 - $222,600 per year.
</p><p></p><p>Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:<br>
https://careers.microsoft.com/us/en/us-corporate-pay</p><p><br>
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.</p><p></p><p><br>
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process<b>.</b></p></div>

Sr Data Analyst - Quota Delivery

City of Seattle

<div><div><div><h2 class="jobSectionHeader"><b>Position Description</b></h2></div>
<p></p><div><p>The Human Services Department (HSD)works to ensure Seattle communities thrive by meeting basic needs through innovative, collaborative approaches. Our mission is to connect people with resources and solutions so everyone can live, learn, work, and participate in strong, healthy communities. We center racial equity and social justice in all we do.</p><p>
HSD&rsquo;s Data Performance and Evaluation (DPE) Team seeks a Data Analyst to support the Unified Care Team (UCT)&mdash;a cross-departmental effort that uses coordinated, data-driven strategies to keep public spaces open and accessible as part of the City&rsquo;s homelessness response.</p><p>
We&rsquo;re looking for someone who can apply race and social justice principles to support the departments:</p><p><b>
Data</b>: Develop and maintain data systems, dashboards, and automated workflows to improve accuracy, efficiency, and usability.</p><p><b>
Performance</b>: Support staff in using data systems effectively through training, communication, and collaboration.</p><p><b>
Evaluation</b>: Analyze and interpret data to generate insights, respond to ad hoc requests, and ensure transparency through documented methods.</p><p>
This position will report to the Data and Performance Manager and will work alongside Senior Data Analysts as well as the UCT Evaluator and HSD UCT Team.</p><p>
This is an exciting opportunity for someone with versatile data analysis skills and who is passionate about supporting the City&rsquo;s coordinated homelessness response to join our team!</p></div><p></p>
<div><h2 class="jobSectionHeader"><b>Job Responsibilities</b></h2></div>
<p></p><div><div>The work of the Data Analyst is varied and requires:</div><div></div><div><b><br>
Data Quality, Validation, and Assurance</b></div><ul><li>
Validate data across multiple systems (HMIS, GIS, Navigation App, ChatBox) and City departments to ensure accuracy and usability.</li><li>
Support collaboration among cross-functional project teams by using creative approaches&mdash;such as holding regular office hours with UCT data leads&mdash;to ensure accurate and consistent data entry.</li><li>
Perform detailed and accurate data entry as needed and identify opportunities to streamline labor-intensive processes.</li></ul><div></div><div><b><br>
Data Visualization, Reporting, and Automation</b></div><ul><li>
Maintain multiple dashboards&mdash;with the ability to build new dashboards when required&mdash;and use no-code or low-code tools such as Power Automate to streamline routine processes, integrate data sources, and improve accuracy and efficiency.</li><li>
Regularly review all dashboards for accuracy and troubleshoot issues promptly.</li><li>
Provide accurate, well-documented reporting using reliable tools and dashboards tailored to diverse audiences and communicate insights clearly.</li></ul><div></div><div><b><br>
Data Management and System Support</b></div><ul><li>
Develop a clear understanding of interconnected data systems to identify improvement opportunities and coordinate implementation with senior staff.</li><li>
Maintain user guides and provide training on a range of data systems.</li><li>
Troubleshoot system issues, recommend solutions, and enhance data processes and documentation for efficiency, clarity, and reproducibility.</li></ul><div></div><div><b><br>
Applied Analysis and Interpretation</b></div><ul><li>
Analyze large and complex datasets to support actionable insights.</li><li>
Identify process improvements and offer practical solutions that strengthen data quality and analytical reproducibility.</li><li>
Respond promptly and accurately to ad hoc data requests&mdash;including media inquiries and Mayor&rsquo;s Office requests&mdash;using documented methodologies to ensure transparency and easy review by senior staff.</li></ul><div></div><div><b><br>
Project Scoping, Planning, and Governance</b></div><ul><li>
Assist with developing project plans, tracking dependencies and risks.</li><li>
Support projects with multiple deliverables and deadlines under direction of senior level staff.</li><li>
Create and maintain SOPs, data dictionaries, and documenting of standard to ensure consistent data practices.</li></ul></div><p></p>
<div><h2 class="jobSectionHeader"><b>Qualifications</b></h2></div>
<p></p><div><div><b>Minimum Qualifications:</b></div><div></div><div><b><br>
Experience</b>: Two years in systems, operational, procedures, research or analysis related work.<br>
<br>
<b>Education</b>: Bachelor's degree in business or public administration, finance, computer science or a related field.</div><div></div><div><b><br>
OR</b>: An equivalent combination of education and experience that demonstrates the ability to perform the position duties</div><b><br>
Desired Qualifications:</b><div><b><br>
You will be most successful in this role if you have:</b></div><div>
Experience in:</div><ul><li>
Using a range of data tools and technology (Power Automate, Power BI/Tableau, and Excel).</li><li>
Applying Results-Based Accountability (RBA) frameworks.</li><li>
Human services systems, especially homelessness response processes and systems such as HMIS.</li><li>
Working with large datasets and ensuring data quality.</li><li>
Connecting and maintaining data in business intelligence tools (e.g., Tableau, Power BI) in a production environment.</li><li>
Creating clear documentation and supporting user training on data systems.</li><li>
Troubleshooting simple python or R scripts.</li></ul><div>
The ability to:</div><ul><li>
Deliver accurate, high-quality work with strong attention to detail.</li><li>
Exercise critical thinking and creative problem-solving.</li><li>
Center equity and ethical practice in all stages of work.</li><li>
Communicate clearly with varied audiences and provide excellent customer service.</li><li>
Build collaborative relationships and work effectively across teams.</li><li>
Be flexible and willing to take on varied work.</li><li>
Take ownership for keeping work moving forward, even when shifting between multiple projects.</li><li>
Work with a sense of urgency to meet deadlines and respond promptly to changing priorities.</li></ul></div><p></p>
<div><h2 class="jobSectionHeader"><b>Additional Information</b></h2></div>
<p></p><div><div><b>Your application will not be reviewed if these items are missing or incomplete.</b></div><div></div><div><br>
This opportunity has a hybrid work schedule, you are required after training to be in the office a minimum of three days a week.</div><div><br>
The full salary range for this position is $47.39 - $55.19 an hour.</div><div><b><br>
Hiring Process</b><br>
 Applications are reviewed after the posting closes. Qualified candidates must submit the following to be considered:</div><ul><li>
Completed NEOGOV online application.</li><li>
Current r&eacute;sum&eacute; indicating relevant experience and education.</li><li>
Cover letter describing how your skills and experience align with the stated job responsibilities and qualifications.</li><li>
Supplemental questionnaire responses.</li></ul><div></div><div><b><br>
Offers of employment are contingent on verification of information provided by the applicant as part of the application process, which may include a detailed background check, pre-placement physical exam, and/or full driver's abstract, dependent upon position.</b></div><div><br>
The City of Seattle offers a comprehensive benefits package including vacation, holiday, and sick leave as well as medical, dental, vision, life, and long-term disability insurance for employees and their dependents. More information about employee benefits is available on the City's website at: https://www.seattle.gov/human-resources/benefits/employees-and covered family-members/most employees-plans</div><div></div><div><b><br>
First time applying at the City of Seattle? </b>View our tips and tricks for making your application stand out. (Download PDF reader)(Download PDF reader)</div><p>
Please note this job advertisement is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.</p><b><br>
Who may apply: </b>This role is open to all candidates that meet the minimum qualifications. We value different viewpoints and life experiences. Your application will be considered regardless of race, color, creed, national origin, ancestry, sex, marital status, disability, religious or political affiliation, age, sexual orientation, or gender identity. The City of Seattle encourages people of all backgrounds to apply, including people of color, immigrants, refugees, women, LGBTQ+, people with disabilities, veterans, and those with diverse life experiences.</div></div></div><p></p>
<br><div></div><div><div><div><p>The City of Seattle offers a comprehensive benefits package including vacation, holiday and sick leave as well as medical, dental, vision, life and long-term disability insurance for employees and their dependents.</p></div></div></div>

UCT Data Analyst

<p>We&rsquo;re starting to see the incredible potential of multimodal foundation and large language models, and many applications in the computer vision and machine learning domain that previously appeared infeasible are now within reach. We are looking for a highly motivated and skilled Machine Learning Integration Engineer to join our team in the Video Computer Vision group and help us enable that potential for realtime human understanding on Apple devices. The Video Computer Vision org has pioneered human-centric real-time features such as FaceID, FaceKit, and Gaze and Hand gesture control which have changed the way millions of users interact with their devices. We balance research and product requirements to deliver Apple quality, pioneering experiences, innovating through the full stack, and partnering with HW, SW and AI teams to shape Apple's products and bring our vision to life.<br>
<br>
<b>Description</b><br>
<br>
As part of the Video Computer Vision (VCV) team, you will support our ML development and continuously improve our features. Working closely with ML algorithms engineers, data scientists and quality assurance teams, you&rsquo;ll help deploy state-of-the-art computer vision technologies on Apple devices, balancing performance with the compute and power constraints of on-device inference.&quot;,&quot;responsibilities&quot;:&quot;Develop applications and tools for algorithm evaluation, prototyping, and technology demonstrations.<br>
<br>
Support teams across Apple by integrating ML and CV components into production systems.<br>
<br>
On-device integration of CV/ML algorithms.<br>
<br>
<b>Preferred Qualifications</b><br>
<br>
Experience with CoreFoundation, RealityKit and CoreML.<br>
<br>
Hands-on experience with CI/CD pipelines and practices.<br>
<br>
Experience with live camera streaming applications: Understanding of real-time video pipelines, image transformations, and rendering loops.<br>
<br>
Familiarity with common computer vision techniques (e.g., object detection, segmentation, tracking, pose estimation), sequence models for real-time inference and LLMs optimized for on-device performance.<br>
<br>
<b>Minimum Qualifications</b><br>
<br>
Bachelor's degree in Computer Science or related discipline, and 2 years relevant industry experience.<br>
<br>
Strong foundational knowledge in Computer Science.<br>
<br>
Extensive programming experience in Python, Swift, C++.<br>
<br>
Experience working with PyTorch.<br>
<br>
Experience with machine learning model development lifecycle, including data preprocessing, model training, evaluation, and deployment.<br>
<br>
Foundational understanding of machine learning: ML algorithms and development pipelines, with the ability to work effectively with ML practitioners and integrate ML components into production systems.<br>
<br>
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .<br>
<br>
<b>Pay &amp; Benefits</b><br>
<br>
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $139,500 and $258,100, and your base pay will depend on your skills, qualifications, experience, and location.<br>
<br>
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.<br>
<br>
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</p>

On-Device Machine Learning Integration Engineer

Explore 115+ Evaluation insights engineer in Seattle this March. Find roles across top companies and apply now to boost your career.