LILT AI logo
LILT AI

Make anything multilingual. Translation, AI data set creation, and human expert evals. For businesses and governments.

Customer Service, Support AI Rater, Evaluator

Customer SupportCustomer SupportContractRemoteSeniorTeam 201-500Since 2015Company SiteLinkedIn

Location

United States

Posted

20 days ago

Salary

Not specified

Seniority

Senior

English

Job Description

• Evaluate AI outputs related to customer service and support interactions • Perform structured scoring, comparison, classification, and judgment tasks • Assess accuracy, clarity, tone, helpfulness, and alignment with support best practices • Identify hallucinations, misleading responses, policy violations, or unsafe guidance • Apply domain-specific customer support guidelines consistently across tasks • Validate and refine evaluation rubrics and edge-case handling • Perform adjudication where raters disagree • Conduct error analysis and qualitative reviews of model behavior • Partner with LILT research, product, and customer teams on evaluation design • Support red-teaming, policy alignment, and model readiness assessments

Job Requirements

  • Customer support professionals, service operations specialists, or CX practitioners
  • Experience handling customer inquiries, support workflows, or service escalation
  • Strong attention to detail and comfort working with structured evaluation criteria

Benefits

  • Flexible participation
  • Project-based work with clear expectations and timelines
  • Opportunities for recurring work based on performance and demand
  • Compensation communicated upfront per project or task type

Related Job Pages

More Customer Support Jobs

Full TimeRemoteTeam 1-10Since 2011H1B No Sponsor

Work From Home Travel Customer Support Specialist assisting clients in travel planning

Utah
Customer Support20 days ago
Full TimeRemoteTeam 5,001-10,000Since 1997H1B Sponsor

Remote Customer Support Associate providing professional client support

New York
Full TimeRemoteTeam 51-200Since 2002H1B No Sponsor

Are you an HVAC residential service technician who is getting tired of running around out in the field? Do you love talking with homeowners? Would you instead like to be able to work from the comfort of your own home, talking with customers on the ph...

United States
Full TimeRemote

The Call Center Representative role at Parmele Disability Advocates assists clients who are waiting for their disability hearing to be scheduled by the Social Security Administration. This role reports to a designated Team Lead and the Legal Assistant Manager and plays a vital pa...

United States