LILT AI

Make anything multilingual. Translation, AI data set creation, and human expert evals. For businesses and governments.

Educational Technology AI Rater, Evaluator

Artificial IntelligenceArtificial IntelligenceContractRemoteTeam 201-500Since 2015Company SiteLinkedIn

Location

United States

Posted

17 days ago

Salary

Not specified

Bachelor DegreeEnglish

Job Description

• Evaluate AI outputs related to educational, instructional, and learning content • Perform structured scoring, comparison, classification, and judgment tasks • Assess pedagogical accuracy, clarity, appropriateness, and learning effectiveness • Identify hallucinations, misleading explanations, factual errors, or unsafe educational guidance • Apply domain-specific education and instructional guidelines consistently across tasks • Validate and refine evaluation rubrics and edge-case handling • Perform adjudication where raters disagree • Conduct error analysis and qualitative reviews of model behavior • Partner with LILT research, product, and customer teams on evaluation design • Support red-teaming, educational quality review, and model readiness assessments

Job Requirements

  • Educators, instructional designers, curriculum developers, or learning professionals
  • Experience with teaching, curriculum design, assessment, or educational technology
  • Strong attention to detail and comfort working with structured evaluation criteria
  • Deep domain expertise in education, instructional design, or learning sciences
  • Strong judgment and ability to apply criteria consistently
  • Comfort working with structured evaluation workflows
  • Ability to explain reasoning clearly, especially in instructional or learner-facing scenarios
  • Reliability, professionalism, and respect for quality standards
  • Native or professional fluency in one or more supported languages is required
  • English fluency is required for guidelines, feedback, and collaboration

Benefits

  • Contract-based, flexible participation
  • Project-based work with clear expectations and timelines
  • Opportunities for recurring work based on performance and demand
  • Compensation communicated upfront per project or task type

Related Job Pages

More Artificial Intelligence Jobs

AI-native ERP Consultant

Pine Services Group

A permanent home for industry leading software partners and independent software vendors (ISVs).

Artificial Intelligence17 days ago
Full TimeRemoteTeam 501-1,000Since 2021

AI-native ERP Consultant modernizing finance operations using advanced tools like Rillet.

ERP
United States

Agentic AI Solutions Lead

Kobie

Growing Enterprise Value Through Loyalty.

Artificial Intelligence17 days ago
Full TimeRemoteTeam 201-500Since 1990

Define and operationalize Kobie's approach to agentic AI as AI Solutions Lead

Florida

Forward-Deployed AI Solution Consultant

Qventus, Inc

Your AI teammates to automate hospital operations.

Artificial Intelligence17 days ago
Full TimeRemoteTeam 51-200Since 2012

AI Solution Consultant driving AI-powered operational transformations in healthcare systems

United States
$175K - $225K / year

AI Risk Advisor

KeyBank

We'll meet you in the "am I making the most on my savings?" moment. Bank, borrow, invest—we have it all. Member FDIC.

Artificial Intelligence17 days ago
Full TimeRemoteTeam 10,001+Since 1994H1B Sponsor

AI Risk Advisor guiding ethical AI implementation standards at KeyCorp

ServiceNow
Ohio
$79K - $146K / year