machine learning evaluator

Talent Ledger

<div>
 
 
 Company Description
 
 
 
 Talent Ledger provides technical delivery services and access to top-tier, vetted engineering talent to help businesses achieve their goals with speed and precision. Specializing in areas such as AI, automation, fintech, blockchain, protocol security, data engineering, and cloud infrastructure, Talent Ledger supports a wide range of projects. From assembling small and efficient strike teams to rapidly deploying specialists for critical tasks, the company ensures high-priority work gets done efficiently without the need for extensive hiring cycles. Built on trust and reliability, Talent Ledger is the ideal partner for organizations that value agility and top-tier execution.
 
 
 
 
 
 
 Role Description
 
 
 
 The Multilingual AI Evaluator will assess and refine AI model outputs to ensure accuracy, relevance, and alignment with intended outcomes. Daily responsibilities include evaluating multilingual content, providing data-driven feedback, running quality assurance checks, and collaborating with teams to enhance performance. This is a full-time, on-site role based in Multan, requiring excellent language skills and familiarity with AI technologies and evaluation protocols.
 
 
 
 
 
 
 Qualifications
 
 
 <ul>
 <li>
 Proficiency in multiple languages, with strong written and verbal communication skills in at least two or more languages.
 </li>
 <li>
 Analytical and problem-solving skills, perception in evaluating AI-generated content, and attention to detail.
 </li>
 <li>
 Experience or familiarity with AI tools, machine learning concepts, and data evaluation workflows.
 </li>
 <li>
 Ability to work collaboratively in an on-site environment, meeting deadlines and producing high-quality evaluations.
 </li>
 <li>
 Understanding of cultural nuances and context in different languages to ensure relevancy and accuracy.
 </li>
 <li>
 Self-motivated with excellent time management and organizational abilities.
 </li>
 <li>
 Bachelor&rsquo;s degree in linguistics, computer science, or related field is preferred, though relevant experience will also be considered.
 </li>
 </ul>
 
 
 
 
 
 How to apply:
 
 
 
 Click the link below to get forwarded to our partner screening website:
 
 
 
 
 
 https://refer.micro1.ai/referral/jobs?referralCode=e4967b43-e0bc-457d-bea5-f38735a3f512&amp;linkId=f6ec34a0-c27b-49e1-9f81-a8f255471b89&amp;utm_source=referral&amp;utm_medium=share&amp;utm_campaign=job_referral
 
</div>

Multilingual AI Evaluator

YO IT CONSULTING

<div>Work Mode: Remote 
Engagement Type: Independent Contractor 
Schedule: Full-Time or Part-Time Contract
Role:
Partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
This project focuses on evaluating and improving general chat behavior in large language models (LLMs). You will assess model-generated responses across diverse topics, provide high-quality human feedback, and help ensure AI systems communicate in ways that are accurate, well-reasoned, and aligned with human expectations.
What You&rsquo;ll Do
<ul><li>Evaluate LLM-generated responses on their ability to effectively answer user queries
</li><li>Conduct fact-checking using trusted public sources and external tools
</li><li>Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies
</li><li>Assess reasoning quality, clarity, tone, and completeness of responses
</li><li>Ensure model responses align with expected conversational behavior and system guidelines
</li><li>Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines
</li></ul>Who You Are
<ul><li>You hold a Bachelor&rsquo;s degree
</li><li>You are a native speaker or have ILR 5/primary fluency (C2 on the CEFR scale) in Italian
</li><li>You have significant experience using large language models (LLMs) and understand how and why people use them
</li><li>You have excellent writing skills and can clearly articulate nuanced feedback
</li><li>You have strong attention to detail and consistently notice subtle issues others may overlook
</li><li>You are adaptable and comfortable moving across topics, domains, and customer requirements
</li><li>You have a background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
</li><li>You have excellent college-level mathematics skills
</li></ul>Nice-to-Have Specialties
<ul><li>Prior experience with RLHF, model evaluation, or data annotation work
</li><li>Experience writing or editing high-quality written content
</li><li>Experience comparing multiple outputs and making fine-grained qualitative judgments
</li><li>Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
</li></ul>What Success Looks Like
<ul><li>You identify factual inaccuracies, reasoning errors, and communication gaps in model responses
</li><li>You produce clear, consistent, and reproducible evaluation artifacts
</li><li>Your feedback leads to measurable improvements in response quality and user experience</li></ul></div>

English & Italian Trainer - Remote

<div>Work Mode: Remote 
Engagement Type: Independent Contractor 
Schedule: Full-Time or Part-Time Contract
Language Requirement: Fluent English
Role Overview
We partner with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems.
This project focuses specifically on evaluating and improving how AI systems reason about code, generate programming solutions, and explain technical concepts across various complexity levels.
The role involves rigorous technical evaluation of AI-generated responses in coding and software engineering contexts.
<div>What You&rsquo;ll Do 
Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness 
Conduct fact-checking using trusted public sources and authoritative references 
Conduct accuracy testing by executing code and validating outputs using appropriate tools 
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies 
Assess code quality, readability, algorithmic soundness, and explanation quality 
Ensure model responses align with expected conversational behavior and system guidelines 
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines</div>
<div>
</div><div>Who You Are 
You hold a BS, MS, or PhD in Computer Science or a closely related field 
You have significant real-world experience in software engineering or related technical roles 
You are an expert in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go/Golang, Rust) 
You are able to solve HackerRank or LeetCode Medium and Hard&ndash;level problems independently 
You have experience contributing to well-known open-source projects, including merged pull requests 
You have significant experience using LLMs while coding and understand their strengths and failure modes 
You have strong attention to detail and are comfortable evaluating complex technical reasoning, identifying subtle bugs or logical flaws</div>
<div>
</div><div>Nice-to-Have Specialties 
Prior experience with RLHF, model evaluation, or data annotation work 
Track record in competitive programming 
Experience reviewing code in production environments 
Familiarity with multiple programming paradigms or ecosystems 
Experience explaining complex technical concepts to non-expert audiences</div>
<div>
</div><div>What Success Looks Like 
You identify incorrect logic, inefficiencies, edge cases, or misleading explanations in model-generated code, technical concepts, and system design discussions 
Your feedback improves the correctness, robustness, and clarity of AI coding outputs 
You deliver reproducible evaluation artifacts that strengthen model performance</div></div>

Go/Golang Developer LLM - Remote

<div>Work Mode: Remote 
Engagement Type: Independent Contractor 
Schedule: Full-Time or Part-Time Contract
Language Requirement: Fluent English
Role :
Partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
In engineering-related contexts, conversational AI systems must demonstrate accurate applied reasoning, quantitative precision, and practical problem-solving aligned with real-world systems. This project focuses on evaluating and improving how models reason about and explain engineering concepts across multiple disciplines.
What You&rsquo;ll Do
<ul><li>Write and refine prompts to guide model behavior in engineering scenarios
</li><li>Evaluate LLM-generated responses to engineering-related queries for technical accuracy, applied reasoning, and completeness
</li><li>Conduct fact-checking and verify any technical claims using authoritative public sources and domain knowledge
</li><li>Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
</li><li>Assess clarity, structure, and appropriateness of explanations for different audiences
</li><li>Ensure model responses align with expected conversational behavior and system guidelines
</li><li>Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
</li></ul>Who You Are
<ul><li>You hold a PhD in Engineering or a closely related field
</li><li>You have deep expertise in one or more of the following sub-domains:
<ul><li>Mechanical &amp; Physical Systems Engineering
</li><li>Electrical, Electronic &amp; Computer Engineering
</li><li>Chemical, Materials &amp; Process Engineering
</li><li>Civil, Environmental &amp; Infrastructure Engineering
</li></ul></li><li>You have significant experience using large language models (LLMs) and understand how and why people use them
</li><li>You have excellent writing skills and can clearly explain complex engineering concepts
</li><li>You have strong attention to detail and consistently notice subtle issues others may overlook
</li><li>Experience reviewing or editing technical or academic writing
</li></ul>Nice-to-Have Specialties
<ul><li>Experience with applied research, industry engineering workflows, or systems design
</li><li>Prior experience with RLHF, model evaluation, or data annotation work
</li><li>Experience teaching, mentoring, or explaining engineering concepts to non-expert audiences
</li><li>Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
</li></ul>What Success Looks Like
<ul><li>You identify technical inaccuracies, flawed assumptions, or incomplete reasoning in engineering-related model outputs
</li><li>Your feedback improves the rigor, clarity, and correctness of AI explanations
</li><li>You deliver consistent, reproducible evaluation artifacts that strengthen model performance</li></ul></div>

Civil Infrastructure Engineer (PhD) - Remote

Adult & Child Health

<div>Job Description:
Job Title: Evaluator 
Location: Indianapolis, IN 
Department: Adult &amp; Child Health 
Employment Type: Full-time 
Shift: Monday &ndash; Friday 
Job Summary: 
Are you a compassionate and detail-oriented mental health professional looking to make a meaningful difference in your community? Do you want to work in a supportive and dynamic environment where your expertise can directly improve access to care? Join our team at Adult &amp; Child Health as an Evaluator! 
As an Evaluator, you will conduct comprehensive initial assessments and evaluations for individuals of all ages seeking services. You will establish treatment plans, provide provisional diagnoses, and make referral recommendations within our programs. The Evaluator may also engage in safety planning, provide brief therapy sessions, and, pending approval, offer clinical supervision to trainees. Our ideal candidate is passionate about client-centered care, has strong assessment and documentation skills, and thrives in collaborative environments. 
Indianapolis offers a high quality of life with a vibrant community, cultural attractions, and a variety of recreational opportunities. Join us in making a difference in the lives of individuals and families while advancing your career in behavioral health! 
Key Responsibilities:<ul><li>
Conduct screenings and assessments for individuals interested in services to determine appropriateness and eligibility.</li><li>
Develop treatment plans and provisional diagnoses.</li><li>
Provide or coordinate comprehensive follow-up plans and referrals.</li><li>
Maintain accurate and timely documentation in compliance with agency and regulatory standards.</li><li>
Participate in crisis intervention and emergency services as needed.</li><li>
Engage in departmental meetings, staff development activities, and peer review staffing.</li><li>
Cooperate with Quality Assurance/Compliance/Revenue Cycle procedures.</li><li>
Deliver educational material in public forums to promote mental health awareness.</li><li>
Support management needs, including data collection, program evaluation, and grant applications.</li><li>
Complete required trainings and evaluations.</li><li>
Report critical incidents promptly to supervising leadership.</li><li>
Other duties as assigned.</li></ul> 
Education and/or Experience Qualifications:<ul><li>
Master&rsquo;s degree in Social Work, Psychology, Counseling, or a related field required.</li><li>
Minimum of one year of relevant professional experience preferred.</li></ul> 
Required License/Certification (one of the following):<ul><li>
State licensure required for practice in Indiana, including LP, PLP, LPC, PLPC, LCSW, LMSW, LMFT, or PLMFT.</li></ul> 
Additional Qualifications:<ul><li>
Proficient in reading, writing, and communicating effectively with diverse clients.</li><li>
Ability to perform basic mathematical operations.</li><li>
Strong problem-solving and critical-thinking skills.</li><li>
Comfortable working both independently and collaboratively.</li></ul> 
Supervisory Requirements: 
None
Position Perks &amp; Benefits:<ul><li>
29 Days of PTO</li><li>
Eligibility for HRSA Loan Repayment (eligibility requirements apply)</li><li>
Employee benefits package &ndash; health, dental, vision, retirement, life, &amp; more</li><li>
Competitive 401(k) Retirement Savings Plan &ndash; up to 5% match for Part-Time and Full-Time employees</li><li>
Company-paid basic life insurance</li><li>
Emergency Medical Leave Program</li><li>
Flexible Spending Accounts &ndash; healthcare and dependent child-care</li><li>
Health &amp; Wellness Program</li><li>
Employee Assistance Program (EAP)</li><li>
Employee Discount Program</li><li>
Mileage Reimbursement</li></ul>
Brightli is on a Mission:
A mission to improve client care, reduce the financial burden of community mental health centers by sharing resources, a mission to have a larger voice in advocacy to increase access to mental health and substance user care in our communities, and a mission to evolve the behavioral health industry to better meet the needs of our clients.
As a behavioral and community mental health provider, we prioritize fostering a culture of belonging and connection within our workforce. We encourage applications from individuals with varied backgrounds and experiences, as we believe that a rich tapestry of perspectives strengthens our mission. If you are passionate about empowering local communities and creating an environment where everyone feels valued and supported, we invite you to join our mission-driven organization dedicated to cultivating an authentic workplace.
We are an Equal Employment Opportunity Employer.
Adult &amp; Child Health is a Smoke and Tobacco Free Workplace.
Position Perks &amp; Benefits:
Paid time off: full-time employees receive an attractive time off package to balance your work and personal life
Employee benefits package: full-time employees receive health, dental, vision, retirement, life, &amp; more
Top-notch training: initial, ongoing, comprehensive, and supportive
Career mobility: advancement opportunities/promoting from within
Welcoming, warm, supportive: a work culture &amp; environment that promotes your well-being, values you as human being, and encourages your health and happiness
Brightli is on a Mission:
A mission to improve client care, reduce the financial burden of community mental health centers by sharing resources, a mission to have a larger voice in advocacy to increase access to mental health and substance user care in our communities, and a mission to evolve the behavioral health industry to better meet the needs of our clients.
As a behavioral and community mental health provider, we prioritize fostering a culture of belonging and connection within our workforce. We encourage applications from individuals with varied backgrounds and experiences, as we believe that a rich tapestry of perspectives strengthens our mission. If you are passionate about empowering local communities and creating an environment where everyone feels valued and supported, we invite you to join our mission-driven organization dedicated to cultivating an authentic workplace.
We are an Equal Employment Opportunity Employer.
Adult &amp; Child Health is a Smoke and Tobacco Free Workplace.</div>

Evaluator

Greater Philadelphia Health Action

<div>Founded in 1970 as South Philadelphia Health Action and subsequently incorporated as Greater Philadelphia Health Action, GPHA is a non-profit healthcare organization with a commitment to provide compassionate and affordable healthcare services regardless of an individual&rsquo;s ability to pay. Since 1970, GPHA has expanded to become one of the premier providers of primary and behavioral healthcare in the Greater Philadelphia area. 
We are presently seeking full-time Clinical Coordinators, Counselor III&rsquo;s, Behavioral Health Consultants and Evaluator/Urgent Care Specialists in our Behavioral Healthcare Division.
The positions will perform a wide variety of tasks designed to effect the lasting rehabilitation of patients engaging in our mental health, substance abuse, and co-occurring programs. These tasks include, but are not limited to, individual counseling, group work and support of ancillary activities, assisting in the development of mental health services and for providing direct services to all patients admitted by the GPHA/AL-ASSIST Behavioral Health Care Program.
Must have a Master&rsquo;s degree in Human Services field or related field and two (2) years&rsquo; experience in substance abuse or related field. Psychology and one year counseling experience preferred. PREFER LPC, LMFT OR LCSW.
Benefits Include:<ul><li>
Health and Financial Benefits including Medical, Dental, Life, Vision, Long Term Disability, Employee Assistance Program, 401(k) with lucrative company contribution and match</li><li>
Paid Time Off including Vacation, Sick, Personal, Education, and Holidays</li><li>
Professional Growth and Rewards including Generous bonuses, employee referral bonus, leadership and advancement opportunities, continuing education</li></ul>
Local candidates only please.
Join a network that values dedication, balance, and purpose. Visit us at www.gphainc.org.
At Greater Philadelphia Health Action, Inc. (GPHA), we respect diversity and promote equity through action, advocacy, and policy through a dedicated team of representatives committed to listening, learning, and enacting systemic change. We create different channels, outlets, and programs to enhance safe spaces within GPHA, creating a shared understanding and language around justice, diversity, equity, and inclusion. GPHA is an Equal Opportunity Employer. GPHA does not and will not discriminate in employment and personnel practices to include hiring, transferring and promotion practices on the basis of race, color, sex, age, handicap, disability, religion, religious creed, ancestry, national origin, or any other basis prohibited by applicable law.</div>

Clinical Coordinator Opportunity

Search 10000+ Machine learning evaluator jobs near you this March. New roles added regularly across leading industries. Apply today.

10000 machine learning evaluator jobs Near Me

Multilingual AI Evaluator

English & Italian Trainer - Remote

Go/Golang Developer LLM - Remote

Go/Golang Developer LLM - Remote

Civil Infrastructure Engineer (PhD) - Remote

Evaluator

Clinical Coordinator Opportunity