ai evaluator

Prolific

<div>
 Biology - Graduates - AI Training
 <br/>
 <br/>
 <strong>
  About Prolific
  <br/>
  <br/>
 </strong>
 Prolific is not just another player in the AI space &ndash; we are building the biggest pool of quality human data in the world.
 <br/>
 <br/>
 Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.
 <br/>
 <br/>
 <em>
  The role
  <br/>
  <br/>
 </em>
 We're looking for
 <strong>
  Biology Experts and Life Science Professionals
 </strong>
 to join our Expert Network to help train and evaluate cutting-edge AI models using real scientific expertise. If you have the necessary experience, we'll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks. If successful, you'll be invited to join Prolific as a participant, where you'll get paid to train and evaluate powerful AI models.
 <br/>
 <br/>
 Researchers looking for your skills tend to pay up to
 <strong>
  $60 per hour
 </strong>
 . You must be prepared to complete paid tasks that
 <strong>
  require one hour of uninterrupted work
 </strong>
 , though many are shorter.
 <br/>
 <br/>
 <em>
  What you'll bring
  <br/>
  <br/>
 </em>
 <ul>
  <li>
   <strong>
    Education:
   </strong>
   a BS, MS, or PhD in Biology, Molecular Biology, Genetics, Bioinformatics, Pharmacology, or a related Life Sciences field.
  </li>
  <li>
   <strong>
    Professional Experience:
   </strong>
   years of experience in laboratory research, clinical trials, biotech, or academic instruction.
  </li>
  <li>
   <strong>
    Scientific Literacy:
   </strong>
   the ability to interpret complex biological data, peer-reviewed journals, and technical protocols with high precision.
  </li>
  <li>
   <strong>
    Critical Thinking:
   </strong>
   a sharp eye for identifying scientific "hallucinations," such as incorrect protein folding logic, misapplied genetic sequences, or flawed experimental designs.
  </li>
  <li>
   <strong>
    Methodological Knowledge:
   </strong>
   deep understanding of the scientific method, statistical significance in biological contexts, and regulatory standards.
  </li>
  <li>
   <strong>
    Communication:
   </strong>
   ability to explain intricate biological pathways or cellular mechanisms in clear, accurate technical prose.
  </li>
  <li>
   A PayPal account to receive payment from our clients
   <br/>
   <br/>
  </li>
 </ul>
 <em>
  What you'll be doing in the role
  <br/>
  <br/>
 </em>
 <ul>
  <li>
   <strong>
    Evaluate AI-Generated Science:
   </strong>
   review model responses to complex biological queries for factual accuracy, reasoning, and adherence to current scientific consensus.
  </li>
  <li>
   <strong>
    Fact-Check Technical Claims:
   </strong>
   validate citations from public databases (e.g., PubMed, NCBI) and ensure AI-generated summaries of research papers are accurate.
  </li>
  <li>
   <strong>
    Assess Experimental Logic:
   </strong>
   critique AI-proposed experimental designs, including controls, variables, and troubleshooting steps for lab procedures.
  </li>
  <li>
   <strong>
    Annotate Scientific Data:
   </strong>
   identify and correct errors in model-generated biological sequences, chemical structures, or taxonomy classifications.
  </li>
  <li>
   <strong>
    Ensure Ethical Alignment:
   </strong>
   verify that AI responses regarding bioethics and sensitive biological data comply with professional and safety standards.
   <br/>
   <br/>
  </li>
 </ul>
 <em>
  Why Prolific is a great platform to join as a Participant
  <br/>
  <br/>
 </em>
 Joining our platform as a Prolific participant will give you the chance to influence the AI models of the future using professional expertise. Once you pass our assessment, you can join Prolific in just 15 minutes, and start enjoying competitive pay rates, flexible hours, and the ability to work from home.
 <br/>
 <br/>
 We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioural data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.
 <br/>
 <br/>
 We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviours into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation &ndash; one that reflects the breadth and the best of humanity.
 <br/>
 <br/>
 <em>
  Links to more information on Prolific
  <br/>
  <br/>
 </em>
 Website
 <br/>
 <br/>
 Youtube
 <br/>
 <br/>
 <em>
  Privacy Statement
  <br/>
  <br/>
 </em>
 By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal personal information.
</div>


Biology - Graduates - AI Training - Austin, US

Prolific Academic Ltd

<div><div><div><div><div><h2 class="jobSectionHeader"><b>AI Trainer - Neuroscience Specialist (Remote Advisory)</b></h2>
<h4 class="jobSectionHeader"><b><i>About Prolific</i></b></h4>
<p>
Prolific is not just another player in the AI space &ndash; we are building the biggest pool of quality human data in the world.</p>
<p>
Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.</p>
<h4 class="jobSectionHeader"><b><i>
The role</i></b></h4>
<p>
We are seeking <b>Neuroscience Experts</b> to act as evaluators for a high-level AI verification project. AI models are now generating complex technical summaries, and we need specialists to ensure these outputs maintain scientific integrity and factual accuracy.</p>
<p>
We need experts who can navigate dense scientific literature to judge the accuracy and structural integrity of AI-generated graphical abstracts. This is a flexible, ad hoc project paying <b>$40+/h</b> where your technical expertise directly influences how AI understands and summarizes complex research.</p>
<h4 class="jobSectionHeader"><b><i>
What you'll bring</i></b></h4>
<ul>
<li><p><b>Specialized knowledge</b>: Deep expertise in Neuroscience</p>
</li>
<li><p><b>Advanced Academic Credentials:</b> you must hold a Master's or PhD in Neuroscience or a related field.</p>
</li>
<li><p><b>Analytical Skills:</b> history with fact-checking tasks and strong attention to detail</p>
</li>
<li><p>Nice to have: Previous experience with AI-related training or evaluation tasks and a background in scientific publishing or peer review.</p>
</li>
</ul><h4 class="jobSectionHeader"><b><i>What you'll be doing in the role</i></b></h4>
<ul><li><b>Scientific Review:</b> review scientific papers alongside LLM-generated graphical abstracts.</li>
<li><b>Fact-Checking:</b> identify issues and inaccuracies where the graphical abstract does not faithfully represent the source scientific paper.</li>
<li><b>Expert Verification:</b> use your domain knowledge to ensure that technical concepts are visually and textually summarized correctly.</li>
</ul><i>Please note that to qualify for this study you will be required to pass a paid skills assessment with a sample paper and graphical abstract</i>
<h4 class="jobSectionHeader"><b><i>Why Prolific is a great platform to join as a Participant</i></b></h4>
<p>
Joining our platform as a Prolific participant will give you the chance to influence the AI models of the future using professional legal expertise. Once you pass our assessment, you can join Prolific in just 15 minutes, and start enjoying competitive pay rates, flexible hours, and the ability to work from home.</p>
<p>
We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioural data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.</p>
<p>
We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviours into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation &ndash; one that reflects the breadth and the best of humanity.</p>
<h4 class="jobSectionHeader"><b><i>
Links to more information on Prolific</i></b></h4>
<p>
Website</p>
<p>
Youtube</p>
<h4 class="jobSectionHeader"><b><i>
Privacy Statement</i></b></h4>
<p>
By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal personal information.</p></div></div></div></div></div><p></p>

AI Trainer - Neuroscience (Fully Remote- St Louis)

<div><div><div><div><div><h2 class="jobSectionHeader"><b>AI Trainer - Advanced Korean Fluency</b></h2>
<h4 class="jobSectionHeader"><b><i>About Prolific</i></b></h4>
<p>
Prolific is not just another player in the AI space &ndash; we are building the biggest pool of quality human data in the world.</p>
<p>
Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.</p>
<h4 class="jobSectionHeader"><b><i>
The role</i></b></h4>
<p>
We're looking for Advanced Korean Speakers to help train and evaluate cutting-edge AI models. If you have the necessary experience, we'll send you a quick test to assess your skills and suitability for AI tasks. If successful, you'll be invited to join Prolific as a Domain Expert participant, where you'll get paid to train and evaluate powerful AI models.</p>
<p>
Researchers are looking for your skills and you will be fairly compensated for tasks that you complete. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.</p><h4 class="jobSectionHeader"><b><br>
</b></h4>
<h4 class="jobSectionHeader"><b><i>What you'll bring</i></b></h4>
<ul><li>Advanced language skills and verifiable experience as being fluent in Korean.</li>
<li>A willingness to take our skills verification test to assess your suitability for our Domain Expert participant pool</li>
<li>Strong attention to detail and the ability to concentrate on complex tasks for up to one hour at a time</li>
<li>A reliable and fast internet connection and access to a computer</li>
<li>A willingness to self-declare your earnings, as our participants are self-employed</li>
<li>A Paypal account to receive payment from our clients</li>
</ul>
<h4 class="jobSectionHeader"><b><i>What you'll be doing in the role</i></b></h4>
<ul><li>Completing AI training tasks such as analyzing, editing, and writing in Korean.</li>
<li>Judging the performance of AI in performing German prompts</li>
<li>Improving cutting-edge AI models</li>
</ul>
<h4 class="jobSectionHeader"><b><i>Why Prolific is a great platform to join as a Participant</i></b></h4>
<p>
Joining our platform as a Prolific participant will give you the chance to influence the AI models of the future using professional legal expertise. Once you pass our assessment, you can join Prolific in just 15 minutes, and start enjoying competitive pay rates, flexible hours, and the ability to work from home.</p>
<p>
We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioural data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.</p>
<p>
We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviours into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation &ndash; one that reflects the breadth and the best of humanity.</p>
<h4 class="jobSectionHeader"><b><i>
Links to more information on Prolific</i></b></h4>
<p>
Website</p>
<p>
Youtube</p>
<h4 class="jobSectionHeader"><b><i>
Privacy Statement</i></b></h4>
<p>
By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal personal information.</p></div></div></div></div></div><p></p>

AI Trainer - Advanced Korean Fluency (Austin - Remote)

<div>
 AI Trainer - Neuroscience Specialist (Remote Advisory)
 <br/>
 <br/>
 <strong>
  About Prolific
  <br/>
  <br/>
 </strong>
 Prolific is not just another player in the AI space &ndash; we are building the biggest pool of quality human data in the world.
 <br/>
 <br/>
 Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.
 <br/>
 <br/>
 <em>
  The role
  <br/>
  <br/>
 </em>
 We are seeking
 <strong>
  Neuroscience Experts
 </strong>
 to act as evaluators for a high-level AI verification project. AI models are now generating complex technical summaries, and we need specialists to ensure these outputs maintain scientific integrity and factual accuracy.
 <br/>
 <br/>
 We need experts who can navigate dense scientific literature to judge the accuracy and structural integrity of AI-generated graphical abstracts. This is a flexible, ad hoc project paying
 <strong>
  $40+/h
 </strong>
 where your technical expertise directly influences how AI understands and summarizes complex research.
 <br/>
 <br/>
 <em>
  What you'll bring
  <br/>
  <br/>
 </em>
 <ul>
  <li>
   Specialized knowledge: Deep expertise in Neuroscience
  </li>
  <li>
   Advanced Academic Credentials: you must hold a Master's or PhD in Neuroscience or a related field.
  </li>
  <li>
   Analytical Skills: history with fact-checking tasks and strong attention to detail
  </li>
  <li>
   Nice to have: Previous experience with AI-related training or evaluation tasks and a background in scientific publishing or peer review.
   <br/>
   <br/>
  </li>
 </ul>
 <em>
  What you'll be doing in the role
  <br/>
  <br/>
 </em>
 <ul>
  <li>
   <strong>
    Scientific Review:
   </strong>
   review scientific papers alongside LLM-generated graphical abstracts.
  </li>
  <li>
   <strong>
    Fact-Checking:
   </strong>
   identify issues and inaccuracies where the graphical abstract does not faithfully represent the source scientific paper.
  </li>
  <li>
   <strong>
    Expert Verification:
   </strong>
   use your domain knowledge to ensure that technical concepts are visually and textually summarized correctly.
   <br/>
   <br/>
  </li>
 </ul>
 <em>
  Please note that to qualify for this study you will be required to pass a paid skills assessment with a sample paper and graphical abstract
  <br/>
  <br/>
 </em>
 <em>
  Why Prolific is a great platform to join as a Participant
  <br/>
  <br/>
 </em>
 Joining our platform as a Prolific participant will give you the chance to influence the AI models of the future using professional legal expertise. Once you pass our assessment, you can join Prolific in just 15 minutes, and start enjoying competitive pay rates, flexible hours, and the ability to work from home.
 <br/>
 <br/>
 We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioural data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.
 <br/>
 <br/>
 We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviours into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation &ndash; one that reflects the breadth and the best of humanity.
 <br/>
 <br/>
 <em>
  Links to more information on Prolific
  <br/>
  <br/>
 </em>
 Website
 <br/>
 <br/>
 Youtube
 <br/>
 <br/>
 <em>
  Privacy Statement
  <br/>
  <br/>
 </em>
 By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal personal information.
</div>


AI Trainer - Neuroscience (Fully Remote- USA)

AI Trainer - Advanced Korean Fluency (Boston - Remote)

AI Trainer - Advanced Korean Fluency (San Fran - Remote)

YO IT CONSULTING

<div><p><b>Job Title: Generalist Expert</b></p>
<p><b>Job Type:</b> Contractor</p>
<p><b>Location:</b> Remote</p>
<div><div><p><b>Overview</b></p>
<p>In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects.</p>
<p><b>Basic Qualifications</b></p>
<ul><li><p>Bachelor's degree from a top-100 globally ranked university preferred</p>
</li><li><p>Strong analytical and written communication skills</p>
</li><li><p>Ability to work independently and follow detailed task guidelines</p>
</li></ul><p><b>Required Skills</b></p>
<ul><li><p>Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning</p>
</li><li><p>Ability to write clear, precise, and well-evidenced written rationales that go beyond surface-level observations</p>
</li><li><p>Consistent and honest judgment, including the ability to give critical assessments when warranted</p>
</li><li><p>Strict attention to detail and accurate application of structured evaluation guidelines</p>
</li><li><p>Ability to work entirely without AI writing tools</p>
</li></ul><p><b>Eligibility</b></p>
<ul><li><p>Native English fluency required</p></li></ul></div></div></div><div></div>

Generalist Expert - Remote

Search 4842+ Ai evaluator jobs near you this May. New roles added regularly across leading industries. Apply today.