ai evaluator

Prolific

<div>
 AI Trainer - Neuroscience Specialist (Remote Advisory)
 
 
 
 About Prolific
 
 
 
 Prolific is not just another player in the AI space &ndash; we are building the biggest pool of quality human data in the world.
 
 
 Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.
 
 
 
 The role
 
 
 
 We are seeking
 
 Neuroscience Experts
 
 to act as evaluators for a high-level AI verification project. AI models are now generating complex technical summaries, and we need specialists to ensure these outputs maintain scientific integrity and factual accuracy.
 
 
 We need experts who can navigate dense scientific literature to judge the accuracy and structural integrity of AI-generated graphical abstracts. This is a flexible, ad hoc project paying
 
 $40+/h
 
 where your technical expertise directly influences how AI understands and summarizes complex research.
 
 
 
 What you'll bring
 
 
 
 <ul>
 <li>
 Specialized knowledge: Deep expertise in Neuroscience
 </li>
 <li>
 Advanced Academic Credentials: you must hold a Master's or PhD in Neuroscience or a related field.
 </li>
 <li>
 Analytical Skills: history with fact-checking tasks and strong attention to detail
 </li>
 <li>
 Nice to have: Previous experience with AI-related training or evaluation tasks and a background in scientific publishing or peer review.
 
 
 </li>
 </ul>
 
 What you'll be doing in the role
 
 
 
 <ul>
 <li>
 
 Scientific Review:
 
 review scientific papers alongside LLM-generated graphical abstracts.
 </li>
 <li>
 
 Fact-Checking:
 
 identify issues and inaccuracies where the graphical abstract does not faithfully represent the source scientific paper.
 </li>
 <li>
 
 Expert Verification:
 
 use your domain knowledge to ensure that technical concepts are visually and textually summarized correctly.
 
 
 </li>
 </ul>
 
 Please note that to qualify for this study you will be required to pass a paid skills assessment with a sample paper and graphical abstract
 
 
 
 
 Why Prolific is a great platform to join as a Participant
 
 
 
 Joining our platform as a Prolific participant will give you the chance to influence the AI models of the future using professional legal expertise. Once you pass our assessment, you can join Prolific in just 15 minutes, and start enjoying competitive pay rates, flexible hours, and the ability to work from home.
 
 
 We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioural data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.
 
 
 We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviours into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation &ndash; one that reflects the breadth and the best of humanity.
 
 
 
 Links to more information on Prolific
 
 
 
 Website
 
 
 Youtube
 
 
 
 Privacy Statement
 
 
 
 By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal personal information.
</div>

AI Trainer - Neuroscience (Fully Remote- San Diego)

AI Trainer - Neuroscience (Fully Remote- New York)

AI Trainer - Neuroscience (Fully Remote- San Francisco)

AI Trainer - Neuroscience (Fully Remote- Boston)

Mindrift

<div>
 
 
 Please submit your CV in English and indicate your level of English proficiency.
 
 
 
 
 Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.
 
 Participation is project-based, not permanent employment.
 
 
 
 
 What This Opportunity Involves
 
 
 
 While each project involves unique tasks, contributors may:
 
 
 <ul>
 <li>
 Design rigorous Computer Science problems reflecting professional practice;
 </li>
 <li>
 Evaluate AI solutions for correctness, assumptions, and constraints;
 </li>
 <li>
 Validate calculations or simulations using Python (NumPy, Pandas, SciPy);
 </li>
 <li>
 Improve AI reasoning to align with industry-standard logic;
 </li>
 <li>
 Apply structured scoring criteria to multi-step problems;
 </li>
 <li>
 Collaborate with a global community of PhDs to ensure the highest scientific integrity
 
 
 </li>
 </ul>
 
 What We Look For
 
 
 
 This opportunity is a good fit for Computer Science experts with an experience in python open to part-time, non-permanent projects. Ideally, contributors will have:
 
 
 <ul>
 <li>
 Degree in Computer Science or related fields.
 </li>
 <li>
 Python proficiency for numerical validation. MATLAB, R, C, SQL, Numpy, Pandas, SciPy, domain-specific libraries, Stata or knowledge of any programming language can be equivalent.
 </li>
 <li>
 2+ years of professional experience: applied, research, or teaching experience is applicable.
 </li>
 <li>
 Strong written English (C1+)
 </li>
 <li>
 Professional certifications (e.g., CMME, SAS Certifications, CAP) and experience in international or applied projects are an advantage
 
 
 </li>
 </ul>
 
 How It Works
 
 
 
 Apply &rarr; Pass qualification(s) &rarr; Join a project &rarr; Complete tasks &rarr; Get paid
 
 
 
 Project time expectations
 
 
 
 For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
 
 
 
 Compensation
 
 
 
 On this project, contributors can earn up to
 
 $80 per hour equivalent
 
 , depending on their level and pace of contribution.
 
 
 Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
</div>

Computer Science Expert with Python Experience - AI Projects on Mindrift

DataAnnotation

<div>
 We are looking for a Medical Assistant (MA) to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model.
 
 
 In this role, you will need to be an expert in healthcare. We are interested in a wide range of expertise, so relevant backgrounds include Revenue Cycle Management &amp; Patient Finance, Pharmacy Operations (Pharm Tech), Laboratory Services and Operations (Lab Tech), and Clinical Support &amp; Ambulatory Operations.
 
 
 
 Benefits
 
 
 
 <ul>
 <li>
 Full-time or part-time remote position
 </li>
 <li>
 Choose which projects you want to work on
 </li>
 <li>
 Flexible schedule
 </li>
 <li>
 Projects are paid hourly starting at $25-$30+/hr, with bonuses on high-quality and high-volume work
 
 
 </li>
 </ul>
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Provide AI chatbots with diverse and complex healthcare-related problems
 </li>
 <li>
 Evaluate AI outputs for logic, accuracy, and performance
 </li>
 <li>
 Ensure the medical accuracy and overall quality of model responses
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 Fluency in English (native or bilingual level)
 </li>
 <li>
 A current or in-progress medical or healthcare-related degree
 
 
 </li>
 </ul>
 Notes: Payment is made via PayPal. We will never ask you for any money. PayPal will handle any currency conversions from USD. Only applicants in the United States will be considered for this role. This is an independent contractor position.
 
 
 #generalist
</div>

Medical Assistant (MA)

<div>
 AI Training Experts
 
 
 
 About Prolific
 
 
 
 Prolific is not just another player in the AI space &ndash; we are building the biggest pool of quality human data in the world.
 
 
 Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.
 
 
 
 The role
 
 
 
 We're looking for AI Training Experts to help train and evaluate cutting-edge AI models. If you have the necessary experience, we'll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks. If successful, you'll be invited to join Prolific as a participant, where you'll get paid to train and evaluate powerful AI models.
 
 
 Researchers looking for your skills tend to pay upto of $25/hr per AI task completed. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.
 
 
 
 What you'll bring
 
 
 
 <ul>
 <li>
 AI Training task skills and verifiable professional experience as an AI Trainer
 </li>
 <li>
 A willingness to take our skills verification test to assess your suitability for our participant pool
 </li>
 <li>
 Strong attention to detail and the ability to concentrate on complex tasks for up to one hour at a time
 </li>
 <li>
 A reliable and fast internet connection and access to a computer
 </li>
 <li>
 A willingness to self-declare your earnings, as our participants are self-employed
 </li>
 <li>
 A Paypal account to receive payment from our clients
 
 
 </li>
 </ul>
 
 What you'll be doing in the role
 
 
 
 <ul>
 <li>
 Completing AI training tasks such as analyzing, editing, and writing annotations
 </li>
 <li>
 Judging the performance of AI in performing
 </li>
 <li>
 Improving cutting-edge AI models
 
 
 </li>
 </ul>
 
 Why Prolific is a great platform to join as a Participant
 
 
 
 Joining our platform as a Prolific participant will give you the chance to influence the AI models of the future using professional legal expertise. Once you pass our assessment, you can join Prolific in just 15 minutes, and start enjoying competitive pay rates, flexible hours, and the ability to work from home.
 
 
 We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioural data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.
 
 
 We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviours into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation &ndash; one that reflects the breadth and the best of humanity.
 
 
 
 Links to more information on Prolific
 
 
 
 Website
 
 
 Youtube
 
 
 
 Privacy Statement
 
 
 
 By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal personal information.
</div>

AI Training Experts - New York

Search 5965+ Ai evaluator jobs near you this April. New roles added regularly across leading industries. Apply today.