AI work directory Red Pen Jobs

Role details

About the Role

Mercor is partnering with a leading AI research lab to train frontier models on high-quality clinical and biomedical reasoning. We're hiring Healthcare Experts to evaluate and compare model outputs on challenging medical problems, helping shape how the next generation of AI reasons about diagnosis, treatment, and patient care.

Your clinical and medical expertise will ensure each evaluation is accurate, evidence-based, and aligned with real-world medical reasoning.

What You'll Do

  • Compare two AI-generated responses to the same prompt and decide which one is better

  • Work from the provided input files and read each model's reasoning / thought process to inform your judgment

  • Clearly explain why one output outperforms the other, citing clinical accuracy, safety, and quality of medical reasoning

  • Provide written feedback the research team uses to improve model behavior

  • Participate in onboarding and specialty calibration sessions

You're a Good Fit If You

  • Have an MD, DO, PharmD, PhD, or advanced clinical/biomedical degree — or equivalent professional experience

  • Have 2+ years of professional experience in clinical practice, medical research, or a biomedical specialty

  • Are comfortable applying current clinical guidelines and evidence-based medicine

  • Demonstrate excellent written communication with high attention to detail

Role Highlights

  • Flexible workload: 10–20 hours per week

  • Role starts immediately; applications reviewed on a rolling basis

From the Mercor posting.

This role is closed

This role closed, so it carries no apply button. Mercor still has open roles, and the profession page lists the ones we have found.