Find your next opportunity

Why it matched your search

• Title matches

Job summary

Author and review high-quality academic multiple-choice questions and solutions for an AI research initiative. Establish gold-standard benchmarks by evaluating conceptual understanding and clinical reasoning across various health domains.

Job details

Applied Health & Medicine Benchmark Specialist Position: Applied Health & Medicine Benchmark Specialist Type: Hourly Contract Compensation: $94–$119/hour Location: Remote About the Opportunity Mercor is seeking experienced medical and health science professionals to author and review high-quality academic assessment content for an AI research initiative. You will create and evaluate rigorous multiple-choice questions across core health and medicine domains, assess solution quality, and help establish gold-standard benchmarks designed to advance AI capabilities. You may contribute through one of two task types: Question Authoring or Question Verification. Task Types Question Authoring Create original, challenging multiple-choice questions within your area of medical expertise. Develop questions that assess deep conceptual understanding rather than surface-level recall. Rate each question according to its difficulty. Submit questions for review and refinement. Question Verification Review pre-written questions for accuracy, clarity, completeness, precision, and rigor. Identify ambiguities, factual issues, missing information, or problems affecting solvability. Edit questions where necessary. Rate question difficulty and document the changes made. Health & Medicine Domains Clinical Medicine & Surgery Medical Imaging & Diagnostics Pharmacovigilance Healthcare Management & Economics Rehabilitation & Allied Health Responsibilities Author original health and medicine questions that test advanced conceptual understanding and clinical or scientific reasoning. Ensure questions are unambiguous, self-contained, and precisely defined. Include all information necessary for solving each question within the problem statement. Classify questions as: Medium: Introductory undergraduate level Hard: Advanced undergraduate level Expert: Postgraduate level and above Provide 1 correct answer and 9 plausible but subtly incorrect alternatives. Develop clear, step-by-step solutions explaining the reasoning behind the correct answer. Provide 1–5 academic references per question from reputable sources, including peer-reviewed journals and clinical guidelines. Review existing questions for clarity, completeness, precision, accuracy, and solvability. Identify and justify necessary edits during verification tasks. Maintain high standards of scientific accuracy, academic rigor, and question quality. Required Qualifications MD, DO, PhD, or doctoral-level training in Medicine, Biomedical Sciences, Public Health, or a closely related field. Strong command of graduate-level medical knowledge and clinical reasoning. Demonstrated understanding of biomedical research methodology. Excellent written English with the ability to communicate complex medical concepts clearly and concisely. Strong attention to detail and ability to evaluate academic content critically. Preferred Qualifications Master's degree combined with exceptional depth in a specific medical or health science subdomain. Board certification or equivalent professional specialization. Clinical experience in a relevant health or medical discipline. Research experience or peer-reviewed publications in health sciences or medicine. Experience creating, reviewing, or evaluating academic assessment content. Familiarity with evidence-based medicine, clinical guidelines, and biomedical literature. Key Areas of Expertise Clinical Medicine & Surgery Medical Imaging & Diagnostics Pharmacovigilance Healthcare Management & Economics Rehabilitation & Allied Health Clinical Reasoning Biomedical Research Medical Education & Assessment Evidence-Based Medicine Academic Question Development Scientific Literature Evaluation Compensation & Engagement Compensation: $94–$119/hour Commitment: 10+ hours per week Work Arrangement: Fully remote Schedule: Asynchronous Engagement: AI research and benchmark development Eligibility Candidates should have advanced academic or professional expertise in medicine, biomedical sciences, public health, or a closely related discipline and be able to independently produce or evaluate rigorous health and medicine assessment content. Application Process Submit your resume and complete the application form. Participate in a 25-minute conversational interview covering your background, experience, and motivations. Receive follow-up within a few days regarding next steps and onboarding. Begin contributing to the AI benchmark following successful onboarding.

What you’ll do

Author and review high-quality academic multiple-choice questions and solutions for an AI research initiative. Establish gold-standard benchmarks by evaluating conceptual understanding and clinical reasoning across various health domains.

Requirements

Requires a doctoral-level degree (MD, DO, PhD) in Medicine, Biomedical Sciences, or Public Health. Candidates must possess strong graduate-level medical knowledge and the ability to communicate complex concepts clearly in English.

Listed skills

• Évaluation · Preferred
• precision · Preferred
• assessment · Preferred
• Training · Preferred
• Attention to detail · Preferred
• Health · Preferred
• management · Preferred
• Process · Preferred
• Accuracy · Preferred
• Development · Preferred
• discipline · Preferred
• English · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Clinical Reasoning
• Medical Question Authoring
• Biomedical Research Methodology
• Academic Assessment
• Scientific Literature Evaluation
• Evidence-Based Medicine
• Medical Imaging & Diagnostics
• Pharmacovigilance
• Healthcare Management
• Clinical Medicine & Surgery
• Rehabilitation & Allied Health
• Technical Writing
• Content Verification
• Peer-Reviewed Research
• Medical Education
• Critical Evaluation

Job areas

• Healthcare
• Science & Research
• Education
• Technology
• Data & Analytics