LLM Data Scientist

We’re looking for a data-driven professional to design, optimize, and evaluate large language model (LLM) workflows. The ideal candidate will combine expertise in data science, NLP, and AI engineering to enhance system performance, develop effective prompts, and integrate advanced AI solutions across applications.

Responsibilities

• Design, develop, and fine-tune high-quality prompts to enhance NLP and generative AI applications.
• Continuously analyze model performance, identify areas for improvement, and implement data-driven optimizations.
• Enhance the AI prompt creation workflow to maximize system accuracy, efficiency, and responsiveness.
• Conduct data collection, cleaning, and preprocessing to ensure optimal model training and evaluation.
• Generate detailed reports and insights on model and prompt performance, experiment outcomes, and development progress.
• Stay up to date with the latest research and technologies in machine learning, NLP, and AI model development.

Qualifications

• Bachelor's degree (or higher) in Computer Science, Artificial Intelligence, Data Science, or a related field.
• Proven experience as a Data Scientist, Prompt Engineer, or a related AI/ML role for 3-4 years.
• Proficiency in programming languages such as Python or JavaScript, and familiarity with AI tools like ChatGPT, Anthropic, and other LLM frameworks.
• Strong background in machine learning, data analysis, and natural language processing.
• Experience in data integration, web scraping, preprocessing, and setting up knowledge bases (KB).
• Hands-on experience with Amazon Bedrock, including components such as Guardrails and Knowledge Bases.
• Experience working with LangChain or LlamaIndex for LLM orchestration.
• Ability to integrate LLMs with AWS Lambda, Lex, or backend APIs.
• Experience creating prompt test cases, edge scenarios, and evaluating model responses.
• Familiarity with tools such as PromptLayer, Weights & Biases, or custom evaluation frameworks.
• Exceptional analytical, problem-solving, and collaboration skills.

Job Type: Full-time