Position Overview
We are seeking qualified medical professionals to serve as Evaluator Subject Matter Experts for an AI-powered learning platform designed to support medical students during their pre-clinical years and USMLE STEP 1/COMLEX preparation.
Primary Responsibilities
-
Evaluate and assess AI-generated content responses covering basic science topics and medical school curriculum
-
Apply established evaluation metrics to rate content for accuracy, completeness, relevance, and educational utility
-
Provide expert feedback to ensure content meets the learning needs of first and second-year medical students
-
Complete asynchronous evaluations within specified deadlines (5 days to 2 weeks, depending on workload)
-
Participate in quarterly evaluation cycles with potential for ad-hoc assessments
Required Qualifications
Candidates must meet ONE of the following criteria:
-
Current PGY-1 resident in a US medical residency program (MD or DO degree), OR
-
Fourth-year medical student from an ACGME-accredited medical school who has successfully passed USMLE Steps 1 & 2
Preferred Qualifications
-
Prior experience in medical education content review
-
Strong understanding of medical education pedagogy and learning outcomes
Time Commitment
-
5-15 hours per week during active evaluation periods
-
Minimum of 4 evaluation cycles per year
Project Details
-
Duration: November 2025 – December 2026 (with possibility of extension)
-
Start Date: First evaluation round begins November 5, 2025
-
Compensation: $60 USD per hour
-
Work Arrangement: Remote (US time zones)
-
Contract Structure: Employment through third-party contracting agency