This opportunity is available through a leading AI-driven work platform.
Software Engineer (Code QA)
Location
United States + 8 moreAll locations: United States, United Kingdom, Canada, Germany, France, Australia, Belgium, New Zealand, Austria
Posted
2 days ago
Salary
$70 - $120 / hour
Seniority
Mid Level
Job Description
Role Description
We are sharing a specialised part-time consulting opportunity for software engineers with strong coding, debugging, technical writing, and code review skills. This role supports high-impact research collaborations with leading AI laboratories focused on improving advanced AI systems through evaluation datasets that assess reasoning quality, explanation quality, and technical judgment in coding-related interactions. Selected professionals will help craft realistic developer prompts, create authentic code-related evaluation scenarios, write high-quality technical responses, and contribute to improving how next-generation AI systems reason through software engineering questions.
Key Responsibilities
-
Prompt & Scenario Development
- Craft realistic developer prompts across multiple categories such as code review, debugging, error diagnosis, configuration, and related engineering tasks.
- Source and adapt content from real pull requests to create authentic coding scenarios.
- Structure prompts with all necessary context inline, including code snippets, logs, error messages, or requirements.
-
Technical Response Writing
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
- Contribute to evaluation materials designed to assess natural-language reasoning rather than only executable correctness.
- Help create high-quality question-and-answer datasets for coding-related interactions.
-
Engineering Quality & Review
- Apply software engineering judgment across debugging, testing, and code validation contexts.
- Support quality and realism in technical scenarios used for AI evaluation.
- Help ensure prompts and responses reflect real-world developer workflows and standards.
Qualifications
- 2+ years of experience in software engineering, technical research, or educational content development.
- Bachelor's degree or higher in Software Engineering, Computer Science, or a related field.
- Strong proficiency in languages such as Python, JavaScript, Java, or C++.
- Experience with debugging, testing, and validating code.
- Strong technical writing ability and attention to detail.
- Ability to communicate software reasoning clearly and accurately.
Preferred Qualifications
- Advanced degree in Software Engineering, Computer Science, or a related field.
- Experience reviewing code or creating technically rigorous engineering content.
- Familiarity with real-world developer workflows such as pull requests, debugging, and issue analysis.
- Comfort working in structured, research-oriented technical environments.
- Ability to produce high-quality outputs in flexible, remote, project-based settings.
Benefits
- Contribute to cutting-edge AI research focused on software reasoning and technical judgment.
- Apply real-world engineering expertise to high-impact evaluation dataset development.
- Help improve how advanced AI systems respond to realistic coding and debugging questions.
- Flexible remote work with competitive compensation.
Contract Details
- Independent contractor role.
- Fully remote with flexible scheduling.
- Compensation range of $70–$120 per hour.
- Typical commitment of 15–25 hours per week, with flexibility up to 40 hours per week.
- Project duration of approximately 1–2 months.
- Weekly payments via Stripe or Wise.
- Projects may be extended, shortened, or concluded early depending on project needs and performance.
- Work will not involve access to confidential or proprietary information from any employer, client, or institution.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
- Start date: Immediate.
- Location requirements: United Kingdom, United States, Canada, Australia, New Zealand, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia.
About the Platform
This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects. Experts contribute to improving advanced AI systems by providing specialised expertise across software engineering, technical reasoning, evaluation workflows, and domain-specific problem solving.
Job Requirements
- 2+ years of experience in software engineering, technical research, or educational content development.
- Bachelor's degree or higher in Software Engineering, Computer Science, or a related field.
- Strong proficiency in languages such as Python, JavaScript, Java, or C++.
- Experience with debugging, testing, and validating code.
- Strong technical writing ability and attention to detail.
- Ability to communicate software reasoning clearly and accurately.
- Preferred Qualifications
- Advanced degree in Software Engineering, Computer Science, or a related field.
- Experience reviewing code or creating technically rigorous engineering content.
- Familiarity with real-world developer workflows such as pull requests, debugging, and issue analysis.
- Comfort working in structured, research-oriented technical environments.
- Ability to produce high-quality outputs in flexible, remote, project-based settings.
Benefits
- Contribute to cutting-edge AI research focused on software reasoning and technical judgment.
- Apply real-world engineering expertise to high-impact evaluation dataset development.
- Help improve how advanced AI systems respond to realistic coding and debugging questions.
- Flexible remote work with competitive compensation.
- Contract Details
- Independent contractor role.
- Fully remote with flexible scheduling.
- Compensation range of $70–$120 per hour.
- Typical commitment of 15–25 hours per week, with flexibility up to 40 hours per week.
- Project duration of approximately 1–2 months.
- Weekly payments via Stripe or Wise.
- Projects may be extended, shortened, or concluded early depending on project needs and performance.
- Work will not involve access to confidential or proprietary information from any employer, client, or institution.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
- Start date: Immediate.
- Location requirements: United Kingdom, United States, Canada, Australia, New Zealand, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia.
- About the Platform
- This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects. Experts contribute to improving advanced AI systems by providing specialised expertise across software engineering, technical reasoning, evaluation workflows, and domain-specific problem solving.
Related Guides
Related Categories
Related Job Pages
More QA Engineer Jobs
The Test and Evaluation Engineer will collaborate with engineers, program managers, and subject matter experts to plan and execute various T&E activities, including technology demonstrations, system testing, operational assessment, data analysis, and reporting. Specific duties involve leading or supporting the development of key engineering plans and artifacts like the TEMP, SEP, and IMS, as well as participating in review boards and coordinating project status.
Senior Principal Quality Engineer
BAE SystemsThe London, England, United Kingdom-based BAE Systems is the world’s preeminent provider of defense, security, and aerospace solutions. The company’s produc
The PS business area is seeking a Principal Supplier Quality Engineer to support the Terminal High Altitude Area Defense (THAAD) Development program. This role will be the primary point of contact for Supplier Quality on THAAD Development. The responsibilities include: Develop ro...
Quality Assurance Analyst focusing on Medicaid systems at Clemson University
Quality Assurance Analyst (Medicaid)- Serena Changeman exp must - Remote
SUNSHINE ENTERPRISE USA LLCSunshine Enterprise USA is an “Equal Opportunity Employer—Minorities, Females, Veterans and Disabled Persons.”
This role involves performing Quality Assurance and User Acceptance testing on software changes for the South Carolina Medicaid system, focusing on federally and state-mandated updates. Key tasks include developing and executing test cases, analyzing results, and collaborating with project teams on coding changes.