Back to all roles

Physician AI Trainer, $150/hour

Remote-first Full-time Now hiring

Project Overview Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy. We are seeking a skilled Medical Doctor (MD or DO) to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis. Location: U.S.-based experts only Engagement: Part-time, project-based expert evaluation work Work Type: Remote Project Summary: CareerBench evaluates how effectively AI systems provide career guidance across professional occupations. We are seeking licensed Physicians to evaluate AI-generated career guidance related to medical education, residency training, fellowship pathways, specialty selection, clinical practice, academic medicine, healthcare leadership, and physician career advancement. Contributors will assess whether AI-generated recommendations accurately reflect medical training requirements, credentialing expectations, and professional realities within healthcare. This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities

Contributors will: Create benchmark answers for physician career-related questions Develop profession-specific evaluation rubrics Assess AI-generated guidance related to medical education, residency, and fellowship training Review recommendations concerning specialty selection and clinical career development Evaluate advice involving academic medicine, leadership, and alternative physician career paths Identify inaccurate, misleading, or non-compliant professional guidance Provide written rationale supporting scoring decisions and evaluations Expected Outcomes Accurate benchmark responses aligned with medical training and practice realities Reliable evaluation frameworks for physician career guidance Consistent scoring of AI-generated responses across medical career scenarios Identification of inaccuracies related to licensure, credentialing, and career progression High-quality expert feedback supporting trustworthy AI evaluation Qualifications Active U.S. MD or DO license required Minimum 3 years of post-training professional practice experience Experience in clinical medicine, academic medicine, or healthcare leadership Familiarity with residency, fellowship, and specialty training pathways Strong written communication and analytical skills Ability to evaluate professional guidance objectively and consistently U.S.-based LinkedIn Global Data Privacy Notice for Job Candidates Apply tot his job Apply To this Job

More remote roles

Backend Engineer, Fintech Startup (Remote)

Remote-first Full-time

Biotech Co-Founder / CPTO

Remote-first Full-time

Senior Vice President, Clinical Development Oncology (Remote)

Remote-first Full-time

Pharma & Biotech Industry Advisor (Part-Time / Contractor)

Remote-first Full-time

Compliance Analyst - CIP (Night Shift / Remote)

Remote-first Full-time

Biotech/Pharma Key Account Manager

Remote-first Full-time

Sr. Software Engineer - Fintech / Disruption and Insurance (100% Remote)

Remote-first Full-time

Distinguished Engineer (Fintech)

Remote-first Full-time

Remote Inbound Sales Agent (Fintech)

Remote-first Full-time

Account Lead - Middle East - Fintech Ancillaries (100% Remote - Oman)

Remote-first Full-time

Experienced Virtual Customer Support Specialist – Delivering Exceptional Service with arenaflex

Remote-first Full-time

Freelance Transcription Jobs - Flexible Work-from-Home Opportunity

Remote-first Full-time

Director/Vice President, Product Management - Villa Sport

Remote-first Full-time

Supply Chain Analytics Lead (Remote)

Remote-first Full-time

Experienced Brand Marketing Assistant – Remote Customer Support Role for Freshers at arenaflex

Remote-first Full-time

Experienced Customer Service Representative – Remote Travel Support

Remote-first Full-time

SR Python Developer - Remote

Remote-first Full-time

Director, FP&A - Assisted GTM

Remote-first Full-time

Remote Customer Service Representative – Pet Industry E-Commerce Support (Bilingual English & Canadian French, Maine-Based)

Remote-first Full-time

Sr. Veterinary Account Manager (Remote)

Remote-first Full-time