ai evaluator

Talent Ledger

<div>
 
 
 Company Description
 
 
 
 Talent Ledger provides technical delivery services and access to top-tier, vetted engineering talent to help businesses achieve their goals with speed and precision. Specializing in areas such as AI, automation, fintech, blockchain, protocol security, data engineering, and cloud infrastructure, Talent Ledger supports a wide range of projects. From assembling small and efficient strike teams to rapidly deploying specialists for critical tasks, the company ensures high-priority work gets done efficiently without the need for extensive hiring cycles. Built on trust and reliability, Talent Ledger is the ideal partner for organizations that value agility and top-tier execution.
 
 
 
 
 
 
 Role Description
 
 
 
 The Multilingual AI Evaluator will assess and refine AI model outputs to ensure accuracy, relevance, and alignment with intended outcomes. Daily responsibilities include evaluating multilingual content, providing data-driven feedback, running quality assurance checks, and collaborating with teams to enhance performance. This is a full-time, on-site role based in Multan, requiring excellent language skills and familiarity with AI technologies and evaluation protocols.
 
 
 
 
 
 
 Qualifications
 
 
 <ul>
 <li>
 Proficiency in multiple languages, with strong written and verbal communication skills in at least two or more languages.
 </li>
 <li>
 Analytical and problem-solving skills, perception in evaluating AI-generated content, and attention to detail.
 </li>
 <li>
 Experience or familiarity with AI tools, machine learning concepts, and data evaluation workflows.
 </li>
 <li>
 Ability to work collaboratively in an on-site environment, meeting deadlines and producing high-quality evaluations.
 </li>
 <li>
 Understanding of cultural nuances and context in different languages to ensure relevancy and accuracy.
 </li>
 <li>
 Self-motivated with excellent time management and organizational abilities.
 </li>
 <li>
 Bachelor&rsquo;s degree in linguistics, computer science, or related field is preferred, though relevant experience will also be considered.
 </li>
 </ul>
 
 
 
 
 
 How to apply:
 
 
 
 Click the link below to get forwarded to our partner screening website:
 
 
 
 
 
 https://refer.micro1.ai/referral/jobs?referralCode=e4967b43-e0bc-457d-bea5-f38735a3f512&amp;linkId=f6ec34a0-c27b-49e1-9f81-a8f255471b89&amp;utm_source=referral&amp;utm_medium=share&amp;utm_campaign=job_referral
 
</div>

Multilingual AI Evaluator

YO IT CONSULTING

<div>Work Mode: Remote 
Engagement Type: Independent Contractor 
Schedule: Full-Time or Part-Time Contract
Role:
Partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
This project focuses on evaluating and improving general chat behavior in large language models (LLMs). You will assess model-generated responses across diverse topics, provide high-quality human feedback, and help ensure AI systems communicate in ways that are accurate, well-reasoned, and aligned with human expectations.
What You&rsquo;ll Do
<ul><li>Evaluate LLM-generated responses on their ability to effectively answer user queries
</li><li>Conduct fact-checking using trusted public sources and external tools
</li><li>Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies
</li><li>Assess reasoning quality, clarity, tone, and completeness of responses
</li><li>Ensure model responses align with expected conversational behavior and system guidelines
</li><li>Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines
</li></ul>Who You Are
<ul><li>You hold a Bachelor&rsquo;s degree
</li><li>You are a native speaker or have ILR 5/primary fluency (C2 on the CEFR scale) in Italian
</li><li>You have significant experience using large language models (LLMs) and understand how and why people use them
</li><li>You have excellent writing skills and can clearly articulate nuanced feedback
</li><li>You have strong attention to detail and consistently notice subtle issues others may overlook
</li><li>You are adaptable and comfortable moving across topics, domains, and customer requirements
</li><li>You have a background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
</li><li>You have excellent college-level mathematics skills
</li></ul>Nice-to-Have Specialties
<ul><li>Prior experience with RLHF, model evaluation, or data annotation work
</li><li>Experience writing or editing high-quality written content
</li><li>Experience comparing multiple outputs and making fine-grained qualitative judgments
</li><li>Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
</li></ul>What Success Looks Like
<ul><li>You identify factual inaccuracies, reasoning errors, and communication gaps in model responses
</li><li>You produce clear, consistent, and reproducible evaluation artifacts
</li><li>Your feedback leads to measurable improvements in response quality and user experience</li></ul></div>

English & Italian Trainer - Remote

<div>Work Mode: Remote 
Engagement Type: Independent Contractor 
Schedule: Full-Time or Part-Time Contract
Language Requirement: Fluent English
Role Overview
We partner with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems.
This project focuses specifically on evaluating and improving how AI systems reason about code, generate programming solutions, and explain technical concepts across various complexity levels.
The role involves rigorous technical evaluation of AI-generated responses in coding and software engineering contexts.
<div>What You&rsquo;ll Do 
Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness 
Conduct fact-checking using trusted public sources and authoritative references 
Conduct accuracy testing by executing code and validating outputs using appropriate tools 
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies 
Assess code quality, readability, algorithmic soundness, and explanation quality 
Ensure model responses align with expected conversational behavior and system guidelines 
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines</div>
<div>
</div><div>Who You Are 
You hold a BS, MS, or PhD in Computer Science or a closely related field 
You have significant real-world experience in software engineering or related technical roles 
You are an expert in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go/Golang, Rust) 
You are able to solve HackerRank or LeetCode Medium and Hard&ndash;level problems independently 
You have experience contributing to well-known open-source projects, including merged pull requests 
You have significant experience using LLMs while coding and understand their strengths and failure modes 
You have strong attention to detail and are comfortable evaluating complex technical reasoning, identifying subtle bugs or logical flaws</div>
<div>
</div><div>Nice-to-Have Specialties 
Prior experience with RLHF, model evaluation, or data annotation work 
Track record in competitive programming 
Experience reviewing code in production environments 
Familiarity with multiple programming paradigms or ecosystems 
Experience explaining complex technical concepts to non-expert audiences</div>
<div>
</div><div>What Success Looks Like 
You identify incorrect logic, inefficiencies, edge cases, or misleading explanations in model-generated code, technical concepts, and system design discussions 
Your feedback improves the correctness, robustness, and clarity of AI coding outputs 
You deliver reproducible evaluation artifacts that strengthen model performance</div></div>

Go/Golang Developer LLM - Remote

<div>Engagement Type: Independent Contractor
Work Mode: Remote 
Schedule: (15&ndash;25 hrs/week, flexible up to 40 hrs) 
 Duration: 1&ndash;3 Months | Immediate
<div><div>Location: Geography restricted to the USA, UK, Canada, EU
Type: Full-time or Part-time Contract Work
Fluent Language Skills Required: English
Role
Partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
In mathematics-related contexts, conversational AI systems must demonstrate precise formal reasoning, mathematical rigor, and conceptual clarity. This project focuses on evaluating and improving how models reason about mathematical problems, explanations, and proofs across both foundational and advanced areas of mathematics.
What You&rsquo;ll Do
<ul><li>Write and refine prompts to guide model behavior in mathematical contexts
</li><li>Evaluate LLM-generated responses to mathematics-related queries for correctness, rigor, and logical coherence
</li><li>Verify mathematical claims, derivations, and proofs using domain expertise
</li><li>Conduct fact-checking using authoritative public sources and domain knowledge
</li><li>Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
</li><li>Assess clarity, structure, and appropriateness of explanations for different audiences
</li><li>Ensure model responses align with expected conversational behavior and system guidelines
</li><li>Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
</li></ul>Who You Are
<ul><li>You hold a PhD in Mathematics or a closely related field
</li><li>You have demonstrated experience in Probability &amp; Statistics, and may also have experience in one or more of the following areas:
<ul><li>Algebra &amp; Number Theory
</li><li>Calculus &amp; Analysis
</li><li>Geometry &amp; Topology
</li><li>Discrete Mathematics, Logic &amp; Computation
</li></ul></li><li>You have significant experience using large language models (LLMs) and understand how and why people use them
</li><li>You have excellent writing skills and can clearly explain complex mathematical concepts
</li><li>You have strong attention to detail and consistently notice subtle issues others may overlook
</li><li>Experience reviewing or editing technical or academic writing
</li></ul>Nice-to-Have Specialties
<ul><li>Prior experience with RLHF, model evaluation, or data annotation work
</li><li>Experience teaching, mentoring, or explaining mathematical concepts to non-expert audiences
</li><li>Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
</li></ul>What Success Looks Like
<ul><li>You identify inaccuracies or weak reasoning in mathematical-related model outputs
</li><li>Your feedback improves the rigor, clarity, and correctness of AI explanations
</li><li>You deliver consistent, reproducible evaluation artifacts that strengthen model performance
</li><li>Customers trust their AI systems in mathematical contexts because you&rsquo;ve rigorously evaluated them
</li></ul></div></div><div><div><h2 class="jobSectionHeader">Contract and Payment Terms</h2>
<ul><li>You will be engaged as an independent contractor.</li>
<li>This is a fully remote role that can be completed on your own schedule.</li>
<li>Projects can be extended, shortened, or concluded early depending on needs and performance.</li>
<li>Payments are weekly on Stripe or Wise based on services rendered.</li></ul></div></div></div>

Math Teacher for Ai Research - Remote

Search 7053+ Ai evaluator jobs near you this March. New roles added regularly across leading industries. Apply today.

7053 ai evaluator jobs Near Me

Multilingual AI Evaluator

English & Italian Trainer - Remote

Go/Golang Developer LLM - Remote

English & Italian Trainer - Remote

Math Teacher for Ai Research - Remote

Math Teacher for Ai Research - Remote

Go/Golang Developer LLM - Remote