We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
Healthcare Expert (MD, DO, RN, NP, PA, MPH)
Location
United States
Posted
28 days ago
Salary
Not specified
Seniority
Mid Level
Job Description
This role is for one of our clients
Compensation: $150-$190 per hour
We partner with leading AI research teams to enhance the quality, reliability, and real-world usefulness of general-purpose conversational AI systems. These systems are increasingly used in healthcare-related contexts, where accuracy, clarity, and responsible reasoning are critical.
This project focuses on evaluating and improving how conversational AI systems respond to medical and healthcare topics. Your clinical expertise will help ensure that responses are factually accurate, clearly explained, clinically sound, and aligned with real-world healthcare standards.
Role Overview
As a Healthcare Expert, you will apply your professional experience to evaluate and refine AI-generated responses related to medicine, patient care, and healthcare systems. You will help identify inaccuracies, strengthen clinical reasoning, and ensure safe and appropriate communication for diverse healthcare scenarios.
Job Requirements
- Key Responsibilities
- Write and refine prompts to guide AI behavior in healthcare-related scenarios.
- Evaluate large language model (LLM) responses for medical accuracy, reasoning quality, clarity, and completeness.
- Fact-check medical and healthcare claims using trusted public and authoritative sources.
- Annotate responses by identifying strengths, weaknesses, factual inaccuracies, and conceptual gaps.
- Assess tone, safety, and appropriateness for real-world healthcare communication, including patient-facing contexts.
- Ensure responses align with expected conversational standards and project guidelines.
- Apply consistent evaluation frameworks, taxonomies, and benchmarking standards.
- Required Qualifications
- Minimum of 5 years of professional experience in healthcare.
- Relevant advanced degree or professional credential (e.g., MD, DO, RN, NP, PA, PharmD, MPH, or equivalent).
- Experience in one or more of the following areas:
- General Clinical Care
- Specialty Medicine or Surgery
- Diagnostics, Imaging, or Laboratory Medicine
- Public Health, Healthcare Systems, or Administration
- Strong familiarity with large language models (LLMs) and practical understanding of how they are used in healthcare and professional contexts.
- Excellent written communication skills for complex medical and clinical topics.
- Exceptional attention to detail, with the ability to detect subtle inaccuracies or gaps in clinical reasoning.
- Preferred Qualifications
- Prior experience with reinforcement learning from human feedback (RLHF), model evaluation, or data annotation.
- Experience writing or editing high-quality medical or healthcare content.
- Background in clinical documentation, charting, or patient communication.
- Familiarity with structured evaluation rubrics, benchmarks, or quality scoring systems.
- What Success Looks Like
- You consistently identify medical inaccuracies, unsafe reasoning patterns, and unclear explanations.
- Your feedback measurably improves the clarity, safety, and reliability of healthcare-related AI responses.
- You deliver structured, reproducible evaluation artifacts that strengthen model performance.
- AI systems evaluated under your guidance demonstrate greater trustworthiness in healthcare scenarios.
- Engagement Details
- This is an independent contractor engagement.
- The role is fully remote and can be completed on a flexible schedule.
- Project duration may vary depending on performance and evolving needs.
- The work does not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are issued weekly via Stripe or Wise based on services rendered.
- Please note: Visa sponsorship, including H1-B or STEM OPT support, is not available for this role.
Related Guides
Related Categories
Related Job Pages
More Medical Reviewer Jobs
RN Medical Reviewer II – RCD Medicare
BlueCross BlueShield of South CarolinaSouth Carolina’s largest and oldest health insurance company
RN Medical Reviewer II at Palmetto GBA performing medical reviews
Clinical Nurse
Sprinter HealthFounded in 2021 and headquartered in Menlo Park, California, Sprinter Health is a rapidly expanding healthcare company that provides in-home services such as la
We're looking for an experienced Registered Nurse (RN) to work as a Clinical Nurse, supporting our mobile care teams and delivering high-quality virtual clinical support. Provide real-time clinical support to mobile care teams, addressing questions and clinical concerns as they a...
The Nurse Practitioner (NP) will deliver high-quality, patient-centered care within a high-volume, well-established bariatric surgery and medical weight loss program. This is an office-based position, with patient care provided primarily through telehealth visits, allowing for ef...
Prior Authorization Nurse
Gillette Children'sAt Gillette Children’s, we foster a culture where every team member feels a sense of belonging and purpose. We are dedicated to building an environment where all feel welcomed, respected, and supported. Our values are embedded at the heart of our culture. We act first from love, embrace the bigger picture, and work side-by-side with our patients, families, and colleagues to help every child create their own story. Together, we work to ensure patients of all backgrounds and abilities reach their full potential. Gillette Children's is an equal opportunity employer and will not discriminate against any employee or applicant for employment because of an individual's race, color, creed, sex, religion, national origin, age, disability, marital status, familial status, genetic information, status with regard to public assistance, sexual orientation or gender identity, military status or any other class protected by federal, state or local laws. Gillette Children’s is a global beacon of care for patients with brain, bone and movement conditions that start in childhood. Our research, treatment and supportive technologies enable every child to lead a full life defined by their dreams, not their diagnoses. To learn more about working at Gillette Children's, please visit https://www.gillettechildrens.org/careers . Gillette Children's participates in the U.S. Department of Homeland Security (DHS) E-Verify program which is an internet-based employment eligibility verification system operated by the U.S. Citizenship and Immigration Services. If E-Verify cannot confirm that you are authorized to work, Gillette will give you written instructions and an opportunity to contact DHS or the Social Security Administration (SSA) to resolve the issue before Gillette takes any further action. Please visit https://www.e-verify.gov/ for further details regarding e-verify.
This position exists to promote the quality and cost effectiveness of medical care by applying clinical acumen and the appropriate application of policies and guidelines to the request for prior authorization. Specific duties are determined by the work setting or patient populati...
