Role Description

We are sharing a specialised part-time consulting opportunity for German language experts with strong transcription, evaluation, and analytical writing skills. This role supports collaborations with a leading AI research laboratory working to improve advanced language models through audio transcription, annotation, benchmarking, and evaluation workflows in German. Selected professionals will help transcribe and analyse audio and video content, develop evaluation rubrics, assess model outputs, and contribute to improving the overall quality and reliability of multilingual AI systems.

Key Responsibilities

• Audio Transcription & Content Analysis
  • Listen to, analyse, and transcribe audio and video content in German following detailed constraints and instructions.
  • Produce high-quality written outputs in German, with supporting work in English when required.
  • Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines.
  • Capture nuances such as tone, intent, and regional variations, including High German and dialectal influences, where relevant.
• Evaluation Standards & Documentation
  • Establish clear expectations for correct and high-quality responses in general consumer audio contexts.
  • Develop detailed evaluation rubrics and grading guidelines in German and English.
  • Document standards to ensure consistency across reviewers and model evaluations.
  • Identify linguistic nuances, formal versus informal register distinctions, and edge cases specific to German.
• Model Testing & Grading
  • Run prompts through language models and assess generated outputs.
  • Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity.
  • Provide structured feedback to improve model performance in German audio tasks.
• Benchmarking & Quality Assurance
  • Participate in quality assurance and review cycles to ensure tasks, rubrics, and outputs meet project standards.
  • Maintain consistency and reliability before datasets are integrated into official benchmarks.
  • Collaborate with project leads to resolve ambiguities and improve task design.

Qualifications

• Native or near-native fluency in German, both spoken and written, and professional fluency in English.
• Strong writing, editing, and critical thinking skills.
• Ability to accurately transcribe and analyse German audio content across general consumer contexts.
• Ability to work independently, manage time effectively, and meet deadlines.
• Availability to commit 10–20 hours per week.
• Strong attention to detail and ability to produce precise, well-structured written outputs.

Requirements

• College student or recent graduate.
• Background in linguistics, humanities, social sciences, journalism, or technical disciplines.
• Prior experience with transcription, annotation, localisation, evaluation, or research workflows in German.
• Familiarity with regional dialects such as Austrian German or Swiss German and register distinctions.
• Interest in AI, language models, or applied research environments.

Benefits

• Contribute directly to a high-impact audio AI research project.
• Gain hands-on exposure to real-world AI research and evaluation workflows.
• Help benchmark and improve advanced multilingual language models.
• Flexible remote work with clear tooling, structured guidelines, and competitive compensation.

Contract Details

• Independent contractor role.
• Fully remote with flexible scheduling.
• Compensation of $50/hr.
• Typical commitment of 10–20 hours per week.
• Weekly payments via Stripe or Wise.
• Projects may be extended, shortened, or concluded early depending on project needs and performance.
• Work will not involve access to confidential or proprietary information from any employer, client, or institution.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.
• Location requirements: United Kingdom, United States, or Singapore.