ai quality analyst

YO IT CONSULTING

<div>Job Title: Visual Evaluation Specialist
Job Type: Contractor
Location: Remote
Job Summary: As a Visual Evaluation Specialist, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required, your domain knowledge is what matters.
Key Responsibilities:
<div><ul><li>Evaluate and annotate visual content for quality, aesthetics, and usefulness using project guidelines.</li></ul>
<ul><li>Provide detailed, objective feedback on image content to support AI training improvements.</li></ul>
<ul><li>Identify and flag inconsistencies, errors, or suboptimal visuals across diverse datasets.</li></ul>
<ul><li>Utilize advanced analytical skills to assess image composition, clarity, and adherence to standards.</li></ul>
<ul><li>Communicate findings clearly in written English with well-reasoned justifications and suggestions.</li></ul>
<ul><li>Collaborate with cross-functional teams to refine criteria and processes for visual content review.</li></ul>
<ul><li>Support continuous enhancement of AI model accuracy by delivering precise, timely evaluations.</li></ul>
</div>Required Skills and Qualifications:
<div><ul><li>Proven experience in visual content evaluation, digital media, or a related field.</li></ul>
<ul><li>Commit to dedicating at least 15 hours a week.</li></ul>
<ul><li>Exceptional written English communication abilities, with a very high language proficiency.</li></ul>
<ul><li>Strong analytical skills and keen attention to detail in reviewing visual materials.</li></ul>
<ul><li>Effective problem-solving skills and the ability to make objective, data-driven decisions.</li></ul>
<ul><li>Familiarity with digital image formats, quality standards, and basic visual design principles.</li></ul>
<ul><li>Ability to work independently and manage high-volume evaluation tasks remotely.</li></ul>
<ul><li>Comfort with providing constructive, actionable feedback for continuous improvement.</li></ul>
<ul><li>Background in any of the following fields is highly desired: design, architecture, UX/UI, product design, photography, videography, visual arts, motion graphics, animation, illustration, branding, cinematography, creative direction, visual communication, industrial design, game design, digital arts, and human-computer interaction (HCI)</li></ul></div></div>

Ai Visual Quality Analyst - Remote

Flexton Inc.

<div>
 
 
 Job Title:
 
 AI Linguist
 
 
 
 Location
 
 : Hybrid in Mountain View (up to 2days/week, Tu-Th options)
 
 
 
 Duration: 8
 
 Months Contract
 
 
 
 
 
 
 About the Role:
 
 
 
 
 We are seeking an AI Linguist to join a diverse and interdisciplinary team focused on AI quality, evaluation, and annotation. In this role, you will contribute to the development of scalable human judgment and annotation pipelines that support the training, evaluation, and continuous improvement of advanced AI models.
 
 
 
 
 
 
 
 This position offers the opportunity to collaborate closely with AI Engineers, Linguists, and cross-functional stakeholders to improve content understanding, recommendation systems, relevance models, and overall user experience through high-quality linguistic analysis and annotation workflows. The ideal candidate combines strong linguistic expertise with analytical thinking, process improvement capabilities, and an interest in emerging AI technologies and Generative AI workflows.
 
 
 
 
 
 
 
 Key Responsibilities:
 
 
 <ul>
 <li>
 Design and execute solutions for AI quality, evaluation, and annotation initiatives
 </li>
 <li>
 Develop scalable and high-quality human judgment workflows using Generative AI prompting, human input, and hybrid approaches
 </li>
 <li>
 Conduct data-driven analysis and provide linguistic insights to support project development
 </li>
 <li>
 Collaborate in working groups focused on building high-quality annotation and evaluation pipelines
 </li>
 <li>
 Create and maintain documentation, guidelines, and standard operating procedures
 </li>
 <li>
 Research and recommend new methodologies for process and product improvements
 </li>
 <li>
 Improve productivity, quality, and operational efficiency through workflow optimization and process standardization.
 </li>
 </ul>
 
 
 
 
 
 Must Have:
 
 
 <ul>
 <li>
 2+ years of relevant industry experience.
 </li>
 <li>
 2+ years of experience working with large-scale, end-to-end human judgment workflows and tools for AI model training/evaluation.
 </li>
 <li>
 2+ years of experience translating linguistic data requirements into clear instructions, guidelines, and workflow designs.
 </li>
 <li>
 1+ year of experience programming in Python or another scripting language.
 </li>
 <li>
 Strong written and verbal communication skills in English.
 </li>
 </ul>
 
 
 
 
 
 Nice to have:
 
 
 <ul>
 <li>
 Master&rsquo;s or PhD in Computational Linguistics, Language Technologies, Linguistics, or a related field.
 </li>
 <li>
 Experience with complex and scalable data annotation and evaluation systems.
 </li>
 <li>
 Experience supporting human judgment and annotation projects.
 </li>
 <li>
 Familiarity with programming languages/tools used in the data annotation space.
 </li>
 <li>
 Interest in learning new technologies and technical concepts, particularly in AI and Generative AI.
 </li>
 </ul>
 
 
 
 
 
 Soft Skills:
 
 
 <ul>
 <li>
 Strong problem-solving abilities
 </li>
 <li>
 Conceptual and analytical thinking
 </li>
 <li>
 Excellent communication and collaboration skills
 </li>
 <li>
 Detail-oriented mindset with a focus on quality and process improvement
 </li>
 <li>
 Ability to work effectively in cross-functional and interdisciplinary teams
 </li>
 </ul>
 
 
 
 
 
 Education:
 
 
 <ul>
 <li>
 Bachelor&rsquo;s degree in computational Linguistics, Language Technologies, Linguistics, or a related field.
 </li>
 </ul>
 
 
</div>

AI Linguist

DataAnnotation

<div>
 We are looking for an Independent Contractor to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model.
 
 
 In this role you will need to hold an expert level of expertise in writing, editing, and language use. Other related fields include, but are not limited to: applied skills in research and fact-checking.
 
 
 
 Benefits
 
 
 
 <ul>
 <li>
 This is a full-time or part-time REMOTE position
 </li>
 <li>
 You&rsquo;ll be able to choose which projects you want to work on
 </li>
 <li>
 You can work on your own schedule
 </li>
 <li>
 Projects are paid hourly starting at $25-$30+/hr, with bonuses on high-quality and high-volume work
 
 
 </li>
 </ul>
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Give AI chatbots tasks and evaluate their outputs
 </li>
 <li>
 Evaluate the quality produced by AI models for correctness and performance
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 Fluency in English (native or bilingual level)
 </li>
 <li>
 Detail-oriented
 </li>
 <li>
 Excellent command of grammar, style, and brand voice
 </li>
 <li>
 A current, in progress, or completed Bachelor&rsquo;s degree is preferred but not required
 
 
 </li>
 </ul>
 
 Notes
 
 
 
 Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in the United States will be considered for this role. This is an independent contract position.
 
 
 #generalist
</div>

Independent Contractor

YO IT Consulting

<div>
 
 Job Title:
 
 AI Evaluation Specialist
 
 
 
 Job Type:
 
 Contractor
 
 
 
 Location:
 
 Remote
 
 
 
 Job Summary
 
 
 
 As a AI Evaluation Specialist, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required &mdash; your domain knowledge is what matters.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.
 </li>
 <li>
 Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
 </li>
 <li>
 Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.
 </li>
 <li>
 Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.
 </li>
 <li>
 Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
 </li>
 <li>
 Contribute to the continuous enhancement of evaluation workflows and best practices.
 </li>
 <li>
 Support the development of training data that enhances AI system performance and reliability.
 
 
 </li>
 </ul>
 
 Required Skills And Qualifications
 
 
 
 <ul>
 <li>
 Exceptional reading comprehension and acute attention to detail.
 </li>
 <li>
 Strong observational skills with excellent aesthetic or editorial judgment.
 </li>
 <li>
 Ability to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
 </li>
 <li>
 Excellent written and verbal communication skills.
 </li>
 <li>
 Comfort working across various content types and evaluation guidelines.
 </li>
 <li>
 Strong sense of ownership, reliability, and commitment to delivering high-quality work for the customer's team.
 </li>
 <li>
 Open-minded approach to learning and quickly adapting to new workflows.
 
 
 </li>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Background in design, UX/UI, creative direction, editing, or content strategy.
 </li>
 <li>
 Experience reviewing creative, visual, or AI-generated content.
 </li>
 <li>
 Familiarity with annotation, QA, moderation, or evaluation workflows, as well as working with AI tools or LLMs.
 
 
 </li>
 </ul>
 We&rsquo;re seeking highly perceptive and detail-oriented trainers passionate about shaping the future of AI. Bring your refined judgment, critical thinking skills, and commitment to excellence to our customer's team and make a meaningful impact on emerging AI technologies.
</div>

Ai Evaluation Expert - Remote

Ai Trainer/Data Annotator - Remote

<div>Job Title: AI Evaluation Specialist
Job Type: Contractor
Location: Remote
Job Summary:
As a AI Evaluation Specialist, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required , your domain knowledge is what matters.
Key Responsibilities:
<div><ul><li>Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.</li></ul>
<ul><li>Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.</li></ul>
<ul><li>Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.</li></ul>
<ul><li>Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.</li></ul>
<ul><li>Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.</li></ul>
<ul><li>Contribute to the continuous enhancement of evaluation workflows and best practices.</li></ul>
<ul><li>Support the development of training data that enhances AI system performance and reliability.</li></ul></div> 
Required Skills and Qualifications:
<div><ul><li>Exceptional reading comprehension and acute attention to detail.</li></ul>
<ul><li>Strong observational skills with excellent aesthetic or editorial judgment.</li></ul>
<ul><li>Ability to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.</li></ul>
<ul><li>Excellent written and verbal communication skills.</li></ul>
<ul><li>Comfort working across various content types and evaluation guidelines.</li></ul>
<ul><li>Strong sense of ownership, reliability, and commitment to delivering high-quality work for the customer's team.</li></ul>
<ul><li>Open-minded approach to learning and quickly adapting to new workflows.</li></ul>
</div>Preferred Qualifications:
<div><ul><li>Background in design, UX/UI, creative direction, editing, or content strategy.</li></ul>
<ul><li>Experience reviewing creative, visual, or AI-generated content.</li></ul>
<ul><li>Familiarity with annotation, QA, moderation, or evaluation workflows, as well as working with AI tools or LLMs.</li></ul>
</div>We&rsquo;re seeking highly perceptive and detail-oriented trainers passionate about shaping the future of AI. Bring your refined judgment, critical thinking skills, and commitment to excellence to our customer's team and make a meaningful impact on emerging AI technologies.</div>

Search 10000+ Ai quality analyst jobs near you this May. New roles added regularly across leading industries. Apply today.

10000 ai quality analyst jobs Near Me

Ai Visual Quality Analyst - Remote

AI Linguist

Independent Contractor

Ai Evaluation Expert - Remote

Ai Trainer/Data Annotator - Remote

Ai Trainer/Data Annotator - Remote

Ai Evaluation Expert - Remote