Job Description
Job Title
Part-time Consulting Opportunity for STEM Professors
Location
San Francisco, CA
Job Summary
Specialized part-time consulting for current or retired professors in STEM fields (machine learning, coding, data science) to design and evaluate challenging real-world tasks for frontier AI systems. This role supports collaborations with a leading AI lab focused on improving AI models through benchmark task design, golden solution development, and model evaluation.
Key Responsibilities
-
Task Design & Development: Designing domain-specific problems for agentic tasks, targeting AI model capabilities and reasoning failures.
-
Specification & Golden Solution Generation: Integrating problems into an agentic development environment (Python) and preparing detailed specifications and golden solutions.
-
Evaluation & Model Analysis: Evaluating model performance, identifying reasoning gaps, and analyzing agent trajectories to support model improvement.
Ideal Profile
-
Current or retired professor experience in STEM domains (ML, coding, data science).
-
Degree in computer science, data science, or a relevant STEM field.
-
Ability to commit at least 30 hours per week, primarily during weekdays.
-
Strong analytical, problem-solving, verbal, and written communication skills.
Preferred Qualifications
-
Past experience in AI training, model evaluation, or data annotation.
-
Comfort working with Python in an agentic development environment.
Contract Details
-
Employment Type: W2 contract
-
Location: Remote (United States candidates)
-
Compensation: $70–$95 per hour
-
Commitment: At least 30 hours per week, with at least 6 hours per day on weekdays.
-
Administered by: Cincinnatus LLC
-
Start Date: Immediate
About The Platform
Opportunity available through a leading AI-driven work platform connecting domain experts with AI research projects. Information may be processed by 24-MAG LLC for recruitment.