ai data annotator

MERCOR

<div>About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Language Model Evaluator 
Type: Full-time or Part-time Contract Work 
Compensation: $23/hour 
Location: Geography restricted to Egypt, Saudi Arabia, UAE, USA
Role Responsibilities<ul><li>
Evaluate LLM-generated responses on their ability to effectively answer user queries.</li><li>
Conduct fact-checking using trusted public sources and external tools.</li><li>
Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.</li><li>
Assess reasoning quality, clarity, tone, and completeness of responses.</li><li>
Ensure model responses align with expected conversational behavior and system guidelines.</li><li>
Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.</li></ul>
Qualifications
Must-Have<ul><li>
Bachelor&rsquo;s degree</li><li>
Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Arabic</li><li>
Significant experience using large language models (LLMs)</li><li>
Excellent writing skills</li><li>
Strong attention to detail</li><li>
Adaptable and comfortable moving across topics, domains, and customer requirements</li><li>
Background or experience in domains requiring structured analytical thinking</li><li>
Excellent college-level mathematics skills</li></ul>
Preferred<ul><li>
Prior experience with RLHF, model evaluation, or data annotation work</li><li>
Experience writing or editing high-quality written content</li><li>
Experience comparing multiple outputs and making fine-grained qualitative judgments</li><li>
Familiarity with evaluation rubrics, benchmarks, or quality scoring systems</li></ul>
Application Process (Takes 20&ndash;30 mins to complete)<ul><li>
Upload resume</li><li>
AI interview based on your resume</li><li>
Submit form</li></ul>
Resources &amp; Support<ul><li>
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome</li><li>
For any help or support, reach out to: support@mercor.com</li></ul>
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.</div>

Content Reviewer

YO IT CONSULTING

<div>Work Mode: Remote 
Engagement Type: Independent Contractor 
Schedule: Full-Time or Part-Time Contract
Role:
Partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
This project focuses on evaluating and improving general chat behavior in large language models (LLMs). You will assess model-generated responses across diverse topics, provide high-quality human feedback, and help ensure AI systems communicate in ways that are accurate, well-reasoned, and aligned with human expectations.
What You&rsquo;ll Do
<ul><li>Evaluate LLM-generated responses on their ability to effectively answer user queries
</li><li>Conduct fact-checking using trusted public sources and external tools
</li><li>Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies
</li><li>Assess reasoning quality, clarity, tone, and completeness of responses
</li><li>Ensure model responses align with expected conversational behavior and system guidelines
</li><li>Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines
</li></ul>Who You Are
<ul><li>You hold a Bachelor&rsquo;s degree
</li><li>You are a native speaker or have ILR 5/primary fluency (C2 on the CEFR scale) in Italian
</li><li>You have significant experience using large language models (LLMs) and understand how and why people use them
</li><li>You have excellent writing skills and can clearly articulate nuanced feedback
</li><li>You have strong attention to detail and consistently notice subtle issues others may overlook
</li><li>You are adaptable and comfortable moving across topics, domains, and customer requirements
</li><li>You have a background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
</li><li>You have excellent college-level mathematics skills
</li></ul>Nice-to-Have Specialties
<ul><li>Prior experience with RLHF, model evaluation, or data annotation work
</li><li>Experience writing or editing high-quality written content
</li><li>Experience comparing multiple outputs and making fine-grained qualitative judgments
</li><li>Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
</li></ul>What Success Looks Like
<ul><li>You identify factual inaccuracies, reasoning errors, and communication gaps in model responses
</li><li>You produce clear, consistent, and reproducible evaluation artifacts
</li><li>Your feedback leads to measurable improvements in response quality and user experience</li></ul></div>

English & Italian Expert - Remote

Toloka Annotators

<div>At Toloka, we connect smart, curious people from around the world with freelance online tasks that train and improve artificial intelligence.
What we do
The Toloka Annotators connects individuals with Generative AI projects from leading tech innovators. Our mission is to unlock the full potential of AI by involving real people from around the world in the development process.
About the Role
We are seeking diligent and detail-oriented individuals to collect high-quality egocentric video and audio data of real-world tasks in residential environments. The raw data collected will be used to support a large-scale data collection project.
Responsibilities<ul><li>
Data Collection: Record hands-on, manipulation-intensive tasks across a diverse set of residential environments.</li><li>
Residential Tasks: Accurately record common household activities such as room tidy-up, end-to-end dishes cleanup, end-to-end laundry, and home mapping.</li><li>
Adherence to Specifications: Follow strict guidelines for data capture, including dedicating full attention to the task and ensuring geographic and task diversity in recordings.</li></ul> 

Requirements 
<ul><li>
Equipment: Own or use a smartphone or alternative camera device capable of 30 FPS or greater and 1080p resolution or greater.</li><li>
Capture Method: Mount the device at forehead or eye-level for an egocentric perspective, maintaining a downward angle to maximize hand visibility.</li><li>
Software: Utilize the designated &quot;D&amp;A&quot; application for all data capture and upload.</li><li>
Quality Control: Ensure all video footage is clear, stable, well-lit, at least 15 seconds long, and accurately depicts useful, intentional tasks without unnecessary pauses or contrived movements.</li></ul> 

Benefits 
Why this freelance opportunity might be a great fit for you?
<ul><li>Opportunity to contribute to innovative AI projects for leading tech companies</li><li>
Work on advanced AI projects and gain valuable experience that enhances your portfolio.</li><li>
Influence how future AI models understand and communicate in your field of expertise.</li></ul></div>

Vision Data Collection Specialist

Search 10000+ Ai data annotator jobs near you this March. New roles added regularly across leading industries. Apply today.

10000 ai data annotator jobs Near Me

Content Reviewer

English & Italian Expert - Remote

Vision Data Collection Specialist

Vision Data Collection Specialist

Vision Data Collection Specialist

Vision Data Collection Specialist

Vision Data Collection Specialist