mpathic
Conversation Intelligence to Enhance Outcomes
Senior AI Safety Clinical Reviewer – TPM
Medical ReviewerMedical ReviewerFull TimeRemoteTeam 11-50Since 2021H1B No SponsorCompany SiteLinkedIn
Location
Washington
Posted
39 days ago
Salary
$140K - $190K / year
Postgraduate Degree5 yrs expEnglish
Job Description
• Establish and evolve a reliable clinical QA and adjudication workflow across evaluation projects, identifying gaps and improving on systems
• Train and onboard expert raters on safety rubrics, shared standards, and evaluation philosophy
• Run calibration sessions to reduce disagreement and improve consistency
• Serve as the escalation point for ambiguous or high-risk conversations
• Deliver adjudicated, high-confidence evaluation datasets for an initial pilot
• Demonstrate calibrated clinical judgment aligned with mpathic’s safety philosophy
• Design workflows that others can run without constant oversight
• Own clinical quality systems across multiple concurrent AI safety evaluation programs
• Develop scalable training, certification, and feedback loops for expert evaluators
• Continuously improve inter-rater reliability, rubric clarity, and reviewer consistency
• Build gold-standard examples and clinical playbooks for sensitive user contexts
• Identify recurring model failure patterns and inform rubric/tooling improvements
Job Requirements
- 5+ years of experience in one or more of: Clinical supervision, training, or peer review
- Clinical research operations or qualitative review
- Trust & safety, human-centered AI, or behavioral science workflows
- AI evaluation, annotation QA, or rubric-based assessment systems
- Coaching clinicians or experts to apply shared standards in high-stakes domains
- Licensed clinician (LCSW, LMFT, PsyD, PhD, MD) or equivalent applied experience
- Deep familiarity with psychological stress, trauma, crisis response, or mental health frameworks
- Expertise evaluating emotionally complex conversations for safety, appropriateness, and harm risk
Benefits
- 100% company-funded health, dental, and vision insurance for full-time employees.
- 401k
- Well-being programs
- Flexible paid-time off
Related Guides
Related Categories
Related Job Pages
More Medical Reviewer Jobs
LPN Medical Reviewer
BlueCross BlueShield of South CarolinaSouth Carolina’s largest and oldest health insurance company
Medical Reviewer39 days ago
Full TimeRemoteTeam 10,001+Since 1946H1B No Sponsor
LPN Medical Reviewer performing utilization management and medical reviews for claims
South Carolina
Clinical Reviewer, Behavioral Health
Point32HealthGuiding and empowering healthier lives for everyone.
Medical Reviewer39 days ago
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor
Behavioral Health Clinician conducting benefit coverage reviews and utilization management
Clinical Review Specialist
Premera Blue CrossImprove customers' lives by making healthcare work better.
Medical Reviewer41 days ago
Full TimeRemoteTeam 1,001-5,000Since 1945H1B Sponsor
Clinical Review Specialist conducting claim evaluations for Premera Health.
MS SQL ServerSQL
Alaska + 26 moreAll locations: Alaska, Arizona, California, Colorado, Florida, Idaho, Iowa, Kansas, Kentucky, Maine, Montana, Nevada, New Hampshire, New Mexico, North Carolina, Oklahoma, Oregon, Michigan, Minnesota, Missouri, South Carolina, South Dakota, Tennessee, Texas, Utah, Washington, Wisconsin
$80.2K - $125.6K / year
Senior Medical Reviewer
Simsy VenturesA builder, an institutional co-founder & a partner from ideas to new startups, ventures & beyond 🚀
Medical Reviewer47 days ago
Full TimeRemoteTeam 11-50Since 2022H1B No Sponsor
RN Senior Medical Reviewer focused on complex services and quality assurance processes
United States