ai chatbot evaluator

DataAnnotation

<p>Get AI-powered advice on this job and more exclusive features.</p> <p>We are looking for a Bilingual Community Manager to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model.</p> <p>In this role you will need to hold an expert level of linguistics. You will have conversations in both Arabic and English with chatbots in order to measure their progress, as well as write novel conversations in order to teach them what to say.</p> Benefits <ul> <li>This is a full-time or part-time REMOTE position</li> <li>You'll be able to choose which projects you want to work on</li> <li>You can work on your own schedule</li> <li>Projects are paid hourly starting at $25+ USD per hour, with bonuses on high-quality and high-volume work</li> </ul> Responsibilities <ul> <li>Give AI chatbots writing and editing tasks and evaluate their outputs</li> <li>Evaluate the quality produced by AI models for correctness and performance</li> </ul> Qualifications <ul> <li>Fluency in English and Arabic</li> <li>Detail-oriented</li> <li>Excellent command of grammar, style, and brand voice</li> <li>A current, in progress, or completed Bachelor's degree is preferred but not required</li> </ul> Notes <p>Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in UAE will be considered for this role. This is an independent contract position.</p> <p></p><img src="https://www.jobg8.com/Tracking.aspx?XYhBVONonz7YPX6eQQGeeMzVmBNJKVd8h" width="0" height="0" />

Bilingual Community Manager

&nbsp;You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model.In this role you will need to hold an expert level of linguistics. You will have conversations in both Arabic and English with chatbots in order to measure their progress, as well as write novel conversations in order to teach them what to say.BenefitsThis is a full-time or part-time REMOTE positionYou ll be able to choose which projects you want to work onYou can work on your own scheduleProjects are paid hourly starting at $25+ USD per hour, with bonuses on high-quality and high-volume workResponsibilitiesGive AI chatbots writing and editing tasks and evaluate their outputsEvaluate the quality produced by AI models for correctness and performanceQualificationsFluency in English and ArabicDetail-orientedExcellent command of grammar, style, and brand voiceA current, in progress, or completed Bachelor's degree is preferred but not required

Bilingual Marketing Specialist

<p>Give AI chatbots writing and editing tasks and evaluate their outputs</p><p>Evaluate the quality produced by AI models for correctness and performance</p><p><strong>Qualifications</strong></p><ul><li>Fluency in English and Italian</li><li>Detail-oriented</li><li>Excellent command of grammar, style, and brand voice</li><li>A current, in progress, or completed Bachelor's degree is preferred but not required</li></ul>

Bilingual Customer Support Specialist

ACEM Pakistan

<p><b>Job Summary:</b></p><p>We are seeking a passionate and knowledgeable <b>AI Chatbot Development Instructor</b> to train learners in designing, building, and deploying intelligent chatbots using generative AI tools. The ideal candidate will have hands-on experience with AI platforms such as <b>ChatGPT, Dialogflow, Microsoft Bot Framework, or similar</b> tools, and the ability to simplify complex concepts for students with varying technical backgrounds.</p><p><b>Key Responsibilities:</b></p><ul><li>Deliver engaging, hands-on training sessions on <b>AI chatbot creation, prompt engineering, and conversational design</b>.</li><li>Develop comprehensive <b>course materials</b>, including presentations, assignments, and project guidelines.</li><li>Teach students to use popular chatbot development platforms and <b>no-code/low-code AI tools</b>.</li><li>Demonstrate real-world chatbot applications in <b>customer service, education, and business automation</b>.</li><li>Mentor students through practical projects and evaluate their chatbot prototypes.</li><li>Stay updated with the latest <b>AI advancements</b> and incorporate new tools or techniques into training.</li><li>Collaborate with the academic team to continuously improve course content and delivery methods.</li></ul><p><b>Qualifications:</b></p><ul><li>Bachelor&rsquo;s degree in <b>Computer Science, AI, Data Science, or a related field</b> (Master&rsquo;s preferred).</li><li>Proven experience in <b>chatbot development</b>, <b>AI tool training</b>, or <b>conversational AI</b>.</li><li>Familiarity with <b>Generative AI (e.g., GPT models, LLaMA, Claude, etc.)</b>.</li><li>Strong knowledge of <b>prompt engineering and AI ethics</b>.</li><li>Excellent communication, presentation, and mentoring skills.</li><li>Experience using platforms like <b>ChatGPT, Dialogflow, Botpress, or Rasa</b> is highly desirable.</li></ul><p><b>Preferred Skills:</b></p><ul><li>Knowledge of <b>Python</b>, <b>APIs</b>, or <b>Natural Language Processing (NLP)</b>.</li><li>Understanding of <b>AI automation tools</b> and <b>integration with messaging apps</b> (e.g., WhatsApp, Slack).</li><li>Creativity in designing interactive and learner-focused sessions.</li></ul><p>Job Type: Contract<br/>Contract length: 2 months</p><p>Pay: Rs500.00 - Rs1,500.00 per hour</p><p>Expected hours: 4 per week</p><p>Work Location: In person</p>

AI Chatbot Development Instructor

Impetus Technologies

<p></p><div><div><div><div><div><div><div><p>Hyderabad, Telangana, India;Bangalore, Karnataka, India;Indore, Madhya Pradesh, India;Noida, Uttar Pradesh, India</p></div></div></div><div><div><div><br>
</div></div></div></div></div></div><div><div><div><div><div><div><div><div><p>
Qualification</p><div>
:</div></div><div><div><p><br>
About the Role</p>
<p>We are looking for an engineer with strong experience in building, deploying, and scaling chatbot solutions on AWS. The role involves working closely with product and engineering teams to design conversational AI systems that are secure, scalable, and integrated with enterprise applications.</p>
<p>Key Responsibilities</p>
<p>Design, develop, and deploy chatbot solutions leveraging AWS services (Lambda, API Gateway, DynamoDB, S3, etc.).<br>
Integrate chatbots with enterprise applications (CRM, HRMS, custom apps, etc.).<br>
Build NLP workflows, conversation flows, and handle fall/error strategies.<br>
Implement monitoring, logging, and analytics to track chatbot performance.<br>
Ensure security, scalability, and high availability of deployed solutions.<br>
Collaborate with product managers, UX designers, and data scientists to improve conversational experiences.<br>
Optimize costs and performance of chatbot workloads on AWS.<br>
Required Skills</p>
<p>Strong hands-on experience with AWS services (Lambda, S3, DynamoDB, CloudWatch, API Gateway, IAM).<br>
Machine Learning and Artificial Intelligence<br>
Proficiency in at least one programming language (Python, Node.js, or Java).<br>
Experience with NLP / conversational AI frameworks (Rasa, Dialogflow, or similar).<br>
Knowledge of API integrations (REST, GraphQL, Webhooks).<br>
Understanding of CI/CD pipelines (CodePipeline, GitHub Actions, Jenkins).<br>
Familiarity with cloud security best practices and IAM policies.<br>
Knowledge of FastAPI, Flask or other API development frameworks<br>
AI Agents knowledge<br>
Nice to Have</p>
<p>Experience with Generative AI (Amazon Bedrock, OpenAI APIs, Anthropic Claude, etc.).<br>
Familiarity with front-end integration (React, Angular, mobile apps, WhatsApp/Slack/Teams bots).<br>
Exposure to MLOps or deploying custom NLP models.<br>
Knowledge of analytics platforms for chatbot performance (Amazon Kendra, QuickSight, or third-party).</p>
</div></div></div></div></div><div><div><div><div><p>
Experience</p><div>
:</div></div><div><p>
7 to 12 years</p></div></div></div></div><div><div><div><div><p>
Job Reference Number</p><div>
:</div></div><div><p>
13295</p></div></div></div></div><div><div><div><div><p>
Skills Required</p><div>
:</div></div><div><p>
Sagemaker</p></div></div></div></div><div><div><div><div><p>
Role</p><div>
:</div></div><div><div><p><br>
About the Role</p>
<p>We are looking for an engineer with strong experience in building, deploying, and scaling chatbot solutions on AWS. The role involves working closely with product and engineering teams to design conversational AI systems that are secure, scalable, and integrated with enterprise applications.</p>
<p>Key Responsibilities</p>
<p>Design, develop, and deploy chatbot solutions leveraging AWS services (Lambda, API Gateway, DynamoDB, S3, etc.).<br>
Integrate chatbots with enterprise applications (CRM, HRMS, custom apps, etc.).<br>
Build NLP workflows, conversation flows, and handle fall/error strategies.<br>
Implement monitoring, logging, and analytics to track chatbot performance.<br>
Ensure security, scalability, and high availability of deployed solutions.<br>
Collaborate with product managers, UX designers, and data scientists to improve conversational experiences.<br>
Optimize costs and performance of chatbot workloads on AWS.<br>
Required Skills</p>
<p>Strong hands-on experience with AWS services (Lambda, S3, DynamoDB, CloudWatch, API Gateway, IAM).<br>
Machine Learning and Artificial Intelligence<br>
Proficiency in at least one programming language (Python, Node.js, or Java).<br>
Experience with NLP / conversational AI frameworks (Rasa, Dialogflow, or similar).<br>
Knowledge of API integrations (REST, GraphQL, Webhooks).<br>
Understanding of CI/CD pipelines (CodePipeline, GitHub Actions, Jenkins).<br>
Familiarity with cloud security best practices and IAM policies.<br>
Knowledge of FastAPI, Flask or other API development frameworks<br>
AI Agents knowledge<br>
Nice to Have</p>
<p>Experience with Generative AI (Amazon Bedrock, OpenAI APIs, Anthropic Claude, etc.).<br>
Familiarity with front-end integration (React, Angular, mobile apps, WhatsApp/Slack/Teams bots).<br>
Exposure to MLOps or deploying custom NLP models.<br>
Knowledge of analytics platforms for chatbot performance (Amazon Kendra, QuickSight, or third-party).</p></div></div></div></div></div></div></div></div></div></div><p></p>

Generative AI Engineer (Module Lead/Lead)

3Pillar Global

<div><div>This is a senior-level, applied AI role for a resourceful and creative engineer who will build, deploy, and refine our consumer-facing AI applications. The successful candidate will lead the development of conversational AI agents and other generative systems that will help redefine how users interact with solutions with AI features. This is a chance to move beyond prototyping to building reliable, production-grade solutions.</div>
<h3 class="jobSectionHeader"><b>Responsibilities:</b></h3><ul><li>
Lead the development and improvement of the agentic chatbot, including merging different chatbot architectures.</li><li>
Develop intuitive and efficient applications where AI interactions provide value and enhance the user experience.</li><li>
Lead the evaluation of the AI chatbot by creating and running test suites, capturing performance metrics, and comparing results against baseline tools and grounded truths.</li><li>
Enhance chatbot accuracy by implementing new logic (e.g., converting natural language into Cypher queries) and refining prompts.</li><li>
Optimize prompts and manage context for AI interactions by agents and humans.</li><li>
 Research and implement solutions to overcome platform limitations and integrate a mix of data sources including vector and graph databases.</li><li>
Intergrade and utilize observability tools like MLflow to monitor, debug, and optimize LLM token usage and Lang Graph calls.</li></ul><h3 class="jobSectionHeader"><b>
Qualifications:</b></h3><ul><li>
Bachelor&rsquo;s degree in computer science or software engineering with a thorough understanding of CS fundamentals and theory relevant to application development.</li><li>
Proficient in building agentic systems and multi-tool chatbots using frameworks like LangGraph.</li><li>
Practical experience with AI/LLM development, particularly with chatbots, RAG and agentic systems.</li><li>
Should have worked on Agentic AI frameworks</li><li>
Should have experience in Vector D, Neo4J or similar Graph database
</li><li>Solid Python programming skills and experience with data-intensive applications.</li><li>
Strong background in designing and executing evaluation frameworks for AI and LLM-based systems.</li><li>
Resourceful and proactive approach to technical research and problem-solving.</li><li>
Experience with vector databases and their integration.</li><li>
Proficiency in the English language.</li></ul></div>

Sr. AI Innovation Engineer (AgenticAI)

Hawksford

<div>
<div>
<div>
<div>
<div>
<div> <div>
<strong>Key Responsibilities</strong> <br>
<ul>
<li> <strong>Strategy Development: </strong>Recommend and implement AEO and GEO strategies to improve visibility and market presence of the brand.</li>
<li> <strong>Audit &amp; Optimization: </strong>Review existing SEO and chatbot implementations. Identify gaps and suggest improvements for better performance.</li>
<li> <strong>Performance Analysis: </strong>Conduct comparative analysis of historical and current data to demonstrate the impact of implemented strategies.</li>
<li> <strong>Trend Monitoring: </strong>Identify and leverage emerging trends in AEO and GEO and conversational AI to maintain competitive advantage.</li>
</ul>
<br> <strong>Required Technical Skills</strong> <br>
<ul>
<li>Proficiency in <strong>Google Analytics, Google Search Console, SEMrush, Ahrens,</strong> or similar SEO tools.</li>
<li>Experience and track record of successful implementation of AEO and GEO strategies. </li>
<li>Experience with <strong>AI chatbot</strong> platforms (e.g., Dialog flow, Microsoft Bot Framework, Rasa, or similar).</li>
<li>Familiarity with <strong>HTML/CSS, JavaScript</strong>, and <strong>CMS platforms</strong> (e.g., WordPress, Drupal).</li>
<li>Understanding of <strong>natural language processing (NLP)</strong> and chatbot evaluation metrics.</li>
<li>Ability to use <strong>data visualization</strong> tools (e.g., Tableau, Power BI) for reporting and analysis.</li>
<li>Knowledge of <strong>A/B testing, conversion rate optimization (CRO)</strong>, and<strong> UX principles.</strong> </li>
</ul>
<br> <strong>Qualifications &amp; Experience</strong> <br>
<ul>
<li>Proven track record of success in implementing SEO and AI chatbot strategies with measurable results.</li>
<li>Minimum <strong>5 years </strong>of experience in SEO and/or AEO / GEO.</li>
<li>Bachelor s or Master s degree in, Computer Science, Data Analytics, Marketing or related field.</li>
<li>Strong analytical, communication, and presentation skills.</li>
</ul>
</div>
</div>
</div>
</div>
</div>
</div></div>

AEO (Answer Engine Optimization) Manager

Search 6290+ Ai chatbot evaluator jobs near you this October. New roles added regularly across leading industries. Apply today.