content evaluator

MERCOR

<div>About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Multilingual Prompt Designer 
Type: Freelance 
Compensation: $25&ndash;$30/hour 
Commitment: 20+ hours/week
Role Responsibilities<ul><li>
Create detailed prompts in Simplified Chinese and/or English with constraints and instructions. Ensure natural phrasing and real-world relevance for Simplified Chinese users.</li><li>
Establish high-level expectations for correct responses in Simplified Chinese contexts. Develop comprehensive rubrics accounting for linguistic nuance, tone, and cultural conventions.</li><li>
Run prompts through models and assess outputs for accuracy, fluency, and cultural fit in Simplified Chinese. Compare results against English where needed.</li><li>
Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor. Maintain consistency and reliability across Simplified Chinese benchmarks before integration into evaluations.</li><li>
Work independently and asynchronously to meet deadlines while improving AI model performance.</li></ul>
Qualifications
Must-Have<ul><li>
Native-level fluency in Simplified Chinese (written) with strong reading/writing ability in English.</li><li>
BS or BA from a reputable institution (completed or in progress).</li><li>
Strong writing and critical thinking skills.</li><li>
Ability to work independently and meet deadlines.</li><li>
Familiarity with ChatGPT or similar tools for personal decision-making, hobbies, or general interests.</li><li>
Able to reliably produce China&ndash;specific, culturally accurate Simplified Chinese.</li></ul>
Preferred<ul><li>
Experience in teaching, research, editing, or academic writing.</li><li>
Experience creating evaluation criteria, rubrics, or grading guidelines.</li><li>
Familiarity with LLMs, prompting, or model evaluation.</li></ul>
Application Process (Takes 20&ndash;30 mins to complete)<ul><li>
Complete an AI-led interview (about 15 minutes).</li><li>
Complete a 45-minute written assessment focused on writing and rubric creation.</li><li>
If selected, you will be invited to work on the project.</li></ul>
Resources &amp; Support<ul><li>
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome</li><li>
For any help or support, reach out to: support@mercor.com</li></ul>
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.</div>

Simplified Chinese Content Evaluator Remote

Talent Ledger

<div>
 
 
 Company Description
 
 
 
 Talent Ledger provides technical delivery services and access to top-tier, vetted engineering talent to help businesses achieve their goals with speed and precision. Specializing in areas such as AI, automation, fintech, blockchain, protocol security, data engineering, and cloud infrastructure, Talent Ledger supports a wide range of projects. From assembling small and efficient strike teams to rapidly deploying specialists for critical tasks, the company ensures high-priority work gets done efficiently without the need for extensive hiring cycles. Built on trust and reliability, Talent Ledger is the ideal partner for organizations that value agility and top-tier execution.
 
 
 
 
 
 
 Role Description
 
 
 
 The Multilingual AI Evaluator will assess and refine AI model outputs to ensure accuracy, relevance, and alignment with intended outcomes. Daily responsibilities include evaluating multilingual content, providing data-driven feedback, running quality assurance checks, and collaborating with teams to enhance performance. This is a full-time, on-site role based in Multan, requiring excellent language skills and familiarity with AI technologies and evaluation protocols.
 
 
 
 
 
 
 Qualifications
 
 
 <ul>
 <li>
 Proficiency in multiple languages, with strong written and verbal communication skills in at least two or more languages.
 </li>
 <li>
 Analytical and problem-solving skills, perception in evaluating AI-generated content, and attention to detail.
 </li>
 <li>
 Experience or familiarity with AI tools, machine learning concepts, and data evaluation workflows.
 </li>
 <li>
 Ability to work collaboratively in an on-site environment, meeting deadlines and producing high-quality evaluations.
 </li>
 <li>
 Understanding of cultural nuances and context in different languages to ensure relevancy and accuracy.
 </li>
 <li>
 Self-motivated with excellent time management and organizational abilities.
 </li>
 <li>
 Bachelor&rsquo;s degree in linguistics, computer science, or related field is preferred, though relevant experience will also be considered.
 </li>
 </ul>
 
 
 
 
 
 How to apply:
 
 
 
 Click the link below to get forwarded to our partner screening website:
 
 
 
 
 
 https://refer.micro1.ai/referral/jobs?referralCode=e4967b43-e0bc-457d-bea5-f38735a3f512&amp;linkId=f6ec34a0-c27b-49e1-9f81-a8f255471b89&amp;utm_source=referral&amp;utm_medium=share&amp;utm_campaign=job_referral
 
</div>

Multilingual AI Evaluator

TELUS Digital

<div>
 
 Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment that puts you in control? This position offers you the flexibility to set your own schedule and complete exciting tasks using an innovative web-based evaluation tool.
 
 
 
 
 
 
 A Day in the Life of a Media Search Analyst:
 
 
 <ul>
 <li>
 In this role, you will be doing a comprehensive assessment of diverse task categories, encompassing music, video, books, podcast and home pod evaluations spanning various media domains
 </li>
 <li>
 Analyzing and evaluating search outcomes for App Store Content and conducting research using online tools to assess and validate query accuracy and intent by applying market expertise in conjunction with provided directives to evaluate the relevance and purpose of task-related information for your specific market.
 </li>
 </ul>
 
 
 
 
 Join us today and be a key player in our community revolutionizing digital media content!
 
 
 
 
 
 
 TELUS International AI Community
 
 
 
 Our global AI Community is a vibrant network of 1 million+ contributors from diverse backgrounds who help our customers collect, enhance, train, translate, and localize content to build better AI models. Become part of our growing community and make an impact supporting the machine learning models of some of the world&rsquo;s largest brands.
 
 
 
 
 
 Qualification path
 
 
 
 
 
 No previous professional experience is required to apply to this role, however, working on this project will require you to pass the basic requirements and go through a standard assessment process. This is a part-time long-term project and your work will be subject to our standard quality assurance checks during the term of this agreement.
 
 
 
 
 
 
 Basic Requirements
 
 
 <ul>
 <li>
 
 Full Professional Proficiency in Arabic and English language
 
 </li>
 <li>
 Being a
 
 resident in Saudi Arabia for the las Year consecutively
 
 and having familiarity with current and historical business, media, sport, news, social media, and cultural affairs in Saudi Arabia
 </li>
 <li>
 Having an email address associated with an Apple ID and experience and know-how of Apple products
 </li>
 <li>
 Up-to-date familiarity with prevailing trends in applications, music &amp; video with a keen interest in internet research
 </li>
 <li>
 Flexibility to work across a diverse set of task types, including news, audio tasks, and relevance
 </li>
 <li>
 Daily access to a secure broadband internet connection, computer, and relevant software
 </li>
 <li>
 Independent working and the ability to adapt to innovative methodologies and processes with great attention to detail and exceptional communication skills
 </li>
 <li>
 While a High School degree or higher certification is preferred, we are open to candidates with exceptional skills and talent.
 </li>
 <li>
 Additional Incentives provided throughout the assessment process
 </li>
 </ul>
 
 
 
 
 
 Assessment
 
 
 
 In order to be hired into the program, you&rsquo;ll take an open book qualification exam that will determine your suitability for the position and complete ID verification. Our team will provide you with guidelines and learning materials before your qualification exam. You will be required to complete the exam in a specific timeframe but at your convenience.
 
 
 
 
 
 
 Equal Opportunity
 
 
 
 All qualified applicants will receive consideration for a contractual relationship without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. At TELUS International AI, we are proud to offer equal opportunities and are committed to creating a diverse and inclusive community. All aspects of selection are based on applicants&rsquo; qualifications, merits, competence, and performance without regard to any characteristic related to diversity.
 
 
 
 
 
 Apply here
 
</div>

Media Search Analyst - Arabic (SA)

DataAnnotation

<div>
 We are looking for a Copy Editor to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model.
 
 
 In this role you will need to hold an expert level of writing, editing, and content development. Other related fields include, but are not limited to: Communications and/or Journalism.
 
 
 
 Benefits
 
 
 
 <ul>
 <li>
 This is a full-time or part-time REMOTE position
 </li>
 <li>
 You&rsquo;ll be able to choose which projects you want to work on
 </li>
 <li>
 You can work on your own schedule
 </li>
 <li>
 Projects are paid hourly starting at $20+ USD per hour, with bonuses on high-quality and high-volume work
 
 
 </li>
 </ul>
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Give AI chatbots writing and editing tasks and evaluate their outputs
 </li>
 <li>
 Evaluate the quality produced by AI models for correctness and performance
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 Fluency in English (native or bilingual level)
 </li>
 <li>
 Detail-oriented
 </li>
 <li>
 Excellent command of grammar, style, and brand voice
 </li>
 <li>
 A current, in progress, or completed Bachelor's degree is preferred but not required
 
 
 </li>
 </ul>
 
 Notes
 
 
 
 Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in the United States will be considered for this role. This is an independent contract position.
 
 
 #generalist
</div>

Copy Editor

Alignerr

<div>
 
 Marketing Instructor (AI Training)
 
 
 
 
 About The Role
 
 
 
 We&rsquo;re looking for marketing instructors to help assess AI-generated content related to branding, consumer behavior, and marketing strategy.
 
 
 <ul>
 <li>
 Organization: Alignerr (Powered by Labelbox)
 </li>
 <li>
 Location: Remote
 </li>
 <li>
 Type: Hourly / Task-based Contract
 </li>
 <li>
 Compensation: $35-70 /hour
 </li>
 <li>
 Commitment: 10-40 hours/week
 
 
 </li>
 </ul>
 
 What You&rsquo;ll Do
 
 
 
 <ul>
 <li>
 Review marketing questions, scenarios, and explanations used in AI training.
 </li>
 <li>
 Evaluate reasoning around positioning, messaging, and go-to-market strategy.
 </li>
 <li>
 Provide structured feedback to improve clarity and real-world relevance.
 </li>
 <li>
 Apply teaching experience to identify common misconceptions.
 </li>
 <li>
 Work independently and asynchronously to meet project deadlines.
 
 
 </li>
 </ul>
 
 Who You Are
 
 
 
 <ul>
 <li>
 3+ years of experience teaching marketing at the postsecondary level.
 </li>
 <li>
 Strong understanding of marketing strategy and consumer behavior.
 </li>
 <li>
 Able to assess written business reasoning and strategic recommendations.
 </li>
 <li>
 Comfortable providing clear, structured feedback.
 
 
 </li>
 </ul>
 
 Nice to Have
 
 
 
 <ul>
 <li>
 Master&rsquo;s degree in Marketing or Business.
 </li>
 <li>
 Industry experience in marketing or growth roles.
 </li>
 <li>
 Familiarity with AI or content evaluation workflows.
 
 
 </li>
 </ul>
 
 Why Join Us
 
 
 
 <ul>
 <li>
 Competitive pay and flexible remote work.
 </li>
 <li>
 Lead a team working on cutting-edge AI projects.
 </li>
 <li>
 Exposure to advanced LLMs and how they&rsquo;re trained.
 </li>
 <li>
 Freelance perks: autonomy, flexibility, and global collaboration.
 </li>
 <li>
 Potential for contract extension.
 
 
 </li>
 </ul>
 
 Application Process (Takes 10-15 min)
 
 
 
 <ul>
 <li>
 Submit your resume
 </li>
 <li>
 Complete a short screening
 </li>
 <li>
 Project matching and onboarding
 
 
 </li>
 </ul>
 
 PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
 
</div>

Marketing Instructor

<div>About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Language Model Evaluator 
Type: Full-time or Part-time Contract Work 
Compensation: $23/hour 
Location: Geography restricted to Egypt, Saudi Arabia, UAE, USA
Role Responsibilities<ul><li>
Evaluate LLM-generated responses on their ability to effectively answer user queries.</li><li>
Conduct fact-checking using trusted public sources and external tools.</li><li>
Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.</li><li>
Assess reasoning quality, clarity, tone, and completeness of responses.</li><li>
Ensure model responses align with expected conversational behavior and system guidelines.</li><li>
Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.</li></ul>
Qualifications
Must-Have<ul><li>
Bachelor&rsquo;s degree</li><li>
Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Arabic</li><li>
Significant experience using large language models (LLMs)</li><li>
Excellent writing skills</li><li>
Strong attention to detail</li><li>
Adaptable and comfortable moving across topics, domains, and customer requirements</li><li>
Background or experience in domains requiring structured analytical thinking</li><li>
Excellent college-level mathematics skills</li></ul>
Preferred<ul><li>
Prior experience with RLHF, model evaluation, or data annotation work</li><li>
Experience writing or editing high-quality written content</li><li>
Experience comparing multiple outputs and making fine-grained qualitative judgments</li><li>
Familiarity with evaluation rubrics, benchmarks, or quality scoring systems</li></ul>
Application Process (Takes 20&ndash;30 mins to complete)<ul><li>
Upload resume</li><li>
AI interview based on your resume</li><li>
Submit form</li></ul>
Resources &amp; Support<ul><li>
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome</li><li>
For any help or support, reach out to: support@mercor.com</li></ul>
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.</div>

Senior Content Reviewer

Search 9205+ Content evaluator jobs near you this March. New roles added regularly across leading industries. Apply today.

9205 content evaluator jobs Near Me

Simplified Chinese Content Evaluator Remote

Multilingual AI Evaluator

Media Search Analyst - Arabic (SA)

Copy Editor

Marketing Instructor

Copy Editor

Senior Content Reviewer