This opportunity is available through a leading AI-driven work platform.
Software Engineer (AI Model Trajectory Annotation)
Location
United States + 18 moreAll locations: United States, United Kingdom, Canada, Germany, France, Belgium, Hungary, Poland, Switzerland, Netherlands, Romania, Bulgaria, Czech Republic, Austria, Luxembourg, Slovakia, Moldova, Republic Of, Monaco
Posted
8 days ago
Salary
Not specified
No structured requirement data.
Job Description
Role Description
This role involves contributing to frontier AI research as a part-time consulting opportunity for experienced front-end software engineers. It supports high-impact collaborations with leading AI labs focused on improving how advanced AI systems perform real-world client-side web development tasks.
- Design realistic prompts for client-side web applications, games, tools, or simulations
- Create structured evaluation rubrics that measure frontend implementation quality
- Ensure rubric items are binary (pass/fail) and verifiable through code and screenshots
- Develop evaluation criteria covering UI correctness
Additionally, experts will contribute to building high-quality training datasets by reviewing and annotating software engineering problem-solving trajectories derived from real open-source repositories.
- Review model-generated code trajectories based on real software engineering tasks
- Reconstruct step-by-step reasoning explaining how a solution evolves
- Annotate debugging logic, decision points, and technical problem-solving strategies
- Use full task context (codebase, issues, test cases) to infer plausible reasoning steps
- Ensure annotations reflect realistic developer thinking and technical accuracy
- Maintain consistency and clarity across structured reasoning annotations
Qualifications
- 2+ years of professional software engineering experience
- Hands-on experience debugging and solving issues in real codebases
- Strong proficiency in programming languages such as Python, JavaScript / TypeScript, or other common open-source languages
- Familiarity with version control workflows (Git, pull requests, issue tracking)
- Ability to explain technical reasoning clearly in written form
- Strong analytical thinking and structured problem-solving skills
Requirements
- Part-time commitment (15–25 hours per week)
- Optional scaling up to ~40 hours/week depending on availability
- Location: Candidates should be based in specified regions including the United States, Canada, United Kingdom, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia
Benefits
- Contribute directly to cutting-edge AI research
- Help improve AI models reasoning on real-world coding tasks
- Work with datasets derived from real open-source repositories
- Flexible remote work with competitive compensation
Contract Details
- Independent contractor role
- Fully remote with flexible scheduling
- Compensation ranges up to $70–$130/hr depending on expertise and project scope
- Weekly payments via Stripe or Wise
- Projects may extend depending on performance and project needs
About the Platform
This opportunity is available through a leading AI-driven work platform.
Job Requirements
- 2+ years of professional software engineering experience
- Hands-on experience debugging and solving issues in real codebases
- Strong proficiency in programming languages such as Python, JavaScript / TypeScript, or other common open-source languages
- Familiarity with version control workflows (Git, pull requests, issue tracking)
- Ability to explain technical reasoning clearly in written form
- Strong analytical thinking and structured problem-solving skills
- Part-time commitment (15–25 hours per week)
- Optional scaling up to ~40 hours/week depending on availability
- Location: Candidates should be based in specified regions including the United States, Canada, United Kingdom, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia
Benefits
- Contribute directly to cutting-edge AI research
- Help improve AI models reasoning on real-world coding tasks
- Work with datasets derived from real open-source repositories
- Flexible remote work with competitive compensation
- Contract Details
- Independent contractor role
- Fully remote with flexible scheduling
- Compensation ranges up to $70–$130/hr depending on expertise and project scope
- Weekly payments via Stripe or Wise
- Projects may extend depending on performance and project needs
- About the Platform
- This opportunity is available through a leading AI-driven work platform.
Related Guides
Related Job Pages
More Software Engineer Jobs
Junior Mule Developer at GDIT developing and supporting MuleSoft-based APIs
Sr. Security Software Engineer, Internal Identity & Access Management
PinterestWe are the first CTV advertising platform purpose-built for performance marketers. Our platform combines media buying, optimization, and MMP attribution to help gaming brands automate CTV campaigns, drive app installs, and maximize Return on Ad Spend (ROAS).
The Internal Identity & Access Management (I2AM) team is responsible for critical production infrastructure that provides a foundational notion of Identity and strong authentication and authorization controls across Pinterest. We’re looking for an experienced software engineer wh...
Senior Project Developer leading sales and proposal processes at NORESCO
The Senior Software Engineer will design and implement the end-to-end digital backbone for the Digital Pathology ecosystem, acting as the technical bridge between external Image Management Systems, computational pathology algorithms, internal LIMS, and the enterprise data warehouse. This involves ensuring secure, efficient flow of high-volume Whole Slide Imaging data to support operational improvements and AI-driven diagnostic workflows.