Music Domain Expert – AI Evaluation – Kolkata, India
- India
Posted 6 days ago
About the role
Can AI really understand music? Put your expertise to the test. Fusion CX is hiring a Music Domain Expert in Kolkata, India for a contractual opportunity focused on evaluating and improving Large Language Models (LLMs). If your expertise spans music theory, genres, composers, artists, music production, or instruments, this opportunity allows you to apply your subject-matter knowledge to challenging AI evaluation tasks where factual accuracy, reasoning, completeness, and nuance matter.
You will create advanced music-related prompts, evaluate AI-generated responses, identify hallucinations and logical inconsistencies, and provide evidence-based feedback that supports improvements in AI model performance.
Job Description:
Role Overview
As a Music Domain Expert, you will evaluate and improve Large Language Models by applying your expertise across music theory, genres, composers, artists, production, and instruments. You will design challenging prompts, assess AI-generated responses, identify knowledge gaps and reasoning issues, and contribute to benchmark datasets and adversarial test cases.
Key Responsibilities
- Create advanced prompts covering music theory, genres, composers, artists, production, and instruments.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Provide evidence-based feedback with reliable references.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and documentation.
Job Requirements:
Minimum Qualifications
- Master’s degree or higher in a discipline related to Music.
- 3+ years of professional, research, or teaching experience.
- Excellent written English and analytical skills.
- Strong attention to detail.
Preferred Qualifications
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Ability to work independently and provide objective, evidence-backed reviews.
Work Details
Location: Kolkata, India
Employment Type: Contractual
Work Mode: WFH
Leave Benefits: This contractual engagement does not include paid medical leave or other paid leave benefits.
Work Schedule: Full-time, 40 hours per week, with at least 4 hours of PST overlap.
Start Date: Immediate
Why Join Fusion CX?
Music combines technical knowledge, creative expression, cultural context, and specialized terminology. Evaluating AI-generated music content therefore requires more than recognizing whether an answer sounds plausible—it requires someone who can assess facts, reasoning, context, and nuance from an informed perspective.
As a Music Domain Expert, you’ll apply your knowledge of music to challenging AI evaluation tasks, helping identify inaccuracies, knowledge gaps, inconsistent reasoning, and other weaknesses in AI-generated responses.
What You Will Gain
- Apply your music expertise to Large Language Model evaluation.
- Gain practical exposure to Generative AI, prompt evaluation, and AI research workflows.
- Work with challenging prompts covering music theory, genres, composers, artists, production, and instruments.
- Develop experience comparing and evaluating AI-generated responses.
- Strengthen your ability to assess factual accuracy, reasoning quality, completeness, and nuance.
- Build experience creating benchmark datasets and adversarial test cases.
- Develop experience providing objective, evidence-based feedback using reliable references.
- Expand your experience at the intersection of music, AI evaluation, LLMs, and Generative AI.
Apply Today
If you’re searching for Music Domain Expert jobs in Kolkata, music jobs, music theory jobs, music research jobs, AI evaluation jobs, LLM evaluation jobs, Generative AI jobs, AI research jobs, or contract AI opportunities, apply today and bring your music expertise to the evaluation and improvement of advanced AI systems.