DATA ANALYST - LLM Specialized

Data Analyst (LLM Specialization)Overview

Seeking a Data Analyst with hands-on experience in Large Language Models (LLMs) to support analytics, model evaluation, and AI-driven product development.

Key Responsibilities

• Analyze and interpret data to support business decisions.
• Develop and optimize prompts, evaluations, and workflows for LLM systems.
• Monitor LLM performance, track key metrics, and run A/B tests.
• Work with structured/unstructured data, embeddings, and retrieval systems.
• Build dashboards and reports to communicate insights.
• Collaborate with product, engineering, and AI teams to enhance LLM features.

Required Skills

• Strong SQL and Python skills.
• Experience with LLMs (OpenAI, Anthropic, or open-source models).
• Familiarity with prompt engineering, evaluation methods, and text analytics.
• Proficiency with data visualization tools (e.g., Tableau, Power BI).

Job Type: Full-time

Work Location: In person