This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

This role involves supporting a frontier-model evaluation initiative focused on advanced STEM reasoning and agentic workflows.

• Design challenging real-world STEM problems for model evaluation
• Implement benchmark tasks inside agentic development environments using Python
• Create reproducible tasks with executable tests and clearly defined specifications
• Analyse model and agent outputs to identify reasoning gaps and failure modes
• Evaluate how AI systems perform on complex data science, machine learning, finance, and coding tasks
• Document benchmark tasks, environments, and evaluation outcomes

Qualifications

• Active or recently completed PhD from a top-tier U.S.-based university
• Deep expertise in data science, machine learning, finance, and/or Python-based programming
• Strong research background in advanced STEM domains
• Experience designing complex technical problems or research benchmarks
• Ability to analyse model reasoning traces and diagnose deeper system behaviour issues
• Strong analytical and research documentation skills

Requirements

• PhD in Computer Science, Data Science, Machine Learning, Finance, or related STEM fields

Nice to Have

• Experience working with agentic frameworks or LLM tooling ecosystems
• Familiarity with frameworks such as LangChain, AutoGen, MetaGPT, CrewAI, LlamaIndex, BabyAGI, or related systems
• Contributions to open-source software or research projects
• Experience analysing complex model behaviour or agent workflows

Benefits

• Independent contractor role
• Fully remote with flexible scheduling
• Part-time research engagement with expected availability of 30+ hours per week
• Competitive rates between $50–$100/hour depending on expertise
• Weekly payments via Stripe or Wise
• Projects may extend or adjust depending on scope and performance
• No access to confidential or proprietary information from employers or institutions

Company Description

This opportunity is available through a leading AI-driven work platform.