24-MAG

This opportunity is available through a leading AI-driven work platform.

Software Engineer (AI Model Trajectory Annotation)

Software EngineerSoftware EngineerContractRemote

Location

United States + 18 moreAll locations: United States, United Kingdom, Canada, Germany, France, Belgium, Hungary, Poland, Switzerland, Netherlands, Romania, Bulgaria, Czech Republic, Austria, Luxembourg, Slovakia, Moldova, Republic Of, Monaco

Posted

8 days ago

Salary

Not specified

No structured requirement data.

Job Description

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

This role involves contributing to frontier AI research as a part-time consulting opportunity for experienced front-end software engineers. It supports high-impact collaborations with leading AI labs focused on improving how advanced AI systems perform real-world client-side web development tasks.

  • Design realistic prompts for client-side web applications, games, tools, or simulations
  • Create structured evaluation rubrics that measure frontend implementation quality
  • Ensure rubric items are binary (pass/fail) and verifiable through code and screenshots
  • Develop evaluation criteria covering UI correctness

Additionally, experts will contribute to building high-quality training datasets by reviewing and annotating software engineering problem-solving trajectories derived from real open-source repositories.

  • Review model-generated code trajectories based on real software engineering tasks
  • Reconstruct step-by-step reasoning explaining how a solution evolves
  • Annotate debugging logic, decision points, and technical problem-solving strategies
  • Use full task context (codebase, issues, test cases) to infer plausible reasoning steps
  • Ensure annotations reflect realistic developer thinking and technical accuracy
  • Maintain consistency and clarity across structured reasoning annotations

Qualifications

  • 2+ years of professional software engineering experience
  • Hands-on experience debugging and solving issues in real codebases
  • Strong proficiency in programming languages such as Python, JavaScript / TypeScript, or other common open-source languages
  • Familiarity with version control workflows (Git, pull requests, issue tracking)
  • Ability to explain technical reasoning clearly in written form
  • Strong analytical thinking and structured problem-solving skills

Requirements

  • Part-time commitment (15–25 hours per week)
  • Optional scaling up to ~40 hours/week depending on availability
  • Location: Candidates should be based in specified regions including the United States, Canada, United Kingdom, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia

Benefits

  • Contribute directly to cutting-edge AI research
  • Help improve AI models reasoning on real-world coding tasks
  • Work with datasets derived from real open-source repositories
  • Flexible remote work with competitive compensation

Contract Details

  • Independent contractor role
  • Fully remote with flexible scheduling
  • Compensation ranges up to $70–$130/hr depending on expertise and project scope
  • Weekly payments via Stripe or Wise
  • Projects may extend depending on performance and project needs

About the Platform

This opportunity is available through a leading AI-driven work platform.

Job Requirements

  • 2+ years of professional software engineering experience
  • Hands-on experience debugging and solving issues in real codebases
  • Strong proficiency in programming languages such as Python, JavaScript / TypeScript, or other common open-source languages
  • Familiarity with version control workflows (Git, pull requests, issue tracking)
  • Ability to explain technical reasoning clearly in written form
  • Strong analytical thinking and structured problem-solving skills
  • Part-time commitment (15–25 hours per week)
  • Optional scaling up to ~40 hours/week depending on availability
  • Location: Candidates should be based in specified regions including the United States, Canada, United Kingdom, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia

Benefits

  • Contribute directly to cutting-edge AI research
  • Help improve AI models reasoning on real-world coding tasks
  • Work with datasets derived from real open-source repositories
  • Flexible remote work with competitive compensation
  • Contract Details
  • Independent contractor role
  • Fully remote with flexible scheduling
  • Compensation ranges up to $70–$130/hr depending on expertise and project scope
  • Weekly payments via Stripe or Wise
  • Projects may extend depending on performance and project needs
  • About the Platform
  • This opportunity is available through a leading AI-driven work platform.

Related Job Pages

More Software Engineer Jobs

Software Engineer8 days ago
Full TimeRemoteTeam 10,001+Since 1954H1B Sponsor

Junior Mule Developer at GDIT developing and supporting MuleSoft-based APIs

LinuxMavenUnix
United States
$64.2K - $84.9K / year

Sr. Security Software Engineer, Internal Identity & Access Management

Pinterest

We are the first CTV advertising platform purpose-built for performance marketers. Our platform combines media buying, optimization, and MMP attribution to help gaming brands automate CTV campaigns, drive app installs, and maximize Return on Ad Spend (ROAS).

Software Engineer8 days ago
Full TimeRemoteTeam 1,001-5,000

The Internal Identity & Access Management (I2AM) team is responsible for critical production infrastructure that provides a foundational notion of Identity and strong authentication and authorization controls across Pinterest. We’re looking for an experienced software engineer wh...

United States
Software Engineer8 days ago
Full TimeRemoteTeam 10,001+Since 1915H1B Sponsor

Senior Project Developer leading sales and proposal processes at NORESCO

Florida
$146.8K - $205.3K / year
Full TimeRemoteTeam 1,001-5,000

The Senior Software Engineer will design and implement the end-to-end digital backbone for the Digital Pathology ecosystem, acting as the technical bridge between external Image Management Systems, computational pathology algorithms, internal LIMS, and the enterprise data warehouse. This involves ensuring secure, efficient flow of high-volume Whole Slide Imaging data to support operational improvements and AI-driven diagnostic workflows.

United States