In this hourly, remote contractor position, you will serve as a Medical Doctor (Specialist) Subject Matter Expert (SME) responsible for reviewing AI-generated clinical responses and creating expert medical content. Your role involves evaluating the quality of clinical reasoning and step-by-step problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, safety, and adherence to prompts, identify errors in clinical methodology, differential diagnosis, risk stratification, red-flag recognition, test interpretation, and treatment planning. Additionally, you will fact-check medical information, write high-quality explanations and model solutions that demonstrate correct reasoning, and rate multiple responses based on correctness and reasoning quality.
Board-certified or board-eligible specialists from a wide range of fields are encouraged to apply. These specialties include, but are not limited to, Internal Medicine, Family Medicine, Emergency Medicine, Pediatrics, OB/GYN, Cardiology, Neurology, Psychiatry, General Surgery, Anesthesiology, Critical Care, Radiology, Oncology, Dermatology, Orthopedics, Gastroenterology, Pulmonology, Nephrology, Endocrinology, Infectious Disease, and Pathology.
This opportunity is with SME Careers, a rapidly growing AI Data Services company and subsidiary of SuperAnnotate. The company provides training data for many of the world’s leading AI companies and foundation-model labs. Your healthcare expertise will directly contribute to improving the accuracy, reliability, and clarity of clinical and public-health reasoning in premier AI models.
Important: There is no immediate project available for this role. However, qualified candidates will be among the first contacted when relevant opportunities arise. Joining this expert network also grants access to future projects.
Key Responsibilities
- Develop AI Training Content by creating detailed prompts and gold-standard answers across clinical topics aligned with your specialty, ensuring accuracy and appropriate scope.
- Optimize AI Performance through evaluating and ranking AI responses to improve correctness, safety, clarity, and contextual relevance.
- Ensure Model Integrity by testing AI outputs for inaccuracies, unsafe recommendations, and bias, and validating reliability across various use cases and patient populations.
Required Qualifications
- MD/DO (or equivalent) with completed specialty training (residency/fellowship as applicable) and board eligibility or certification (or local equivalent).
- Minimum of 5 years of post-training clinical experience in a specialty setting such as hospital, outpatient, academic, or community practice.
- Strong clinical reasoning skills, including differential diagnosis, triage, red-flag recognition, and escalation pathways relevant to your specialty.
- Deep understanding of disease processes, guideline-based care, diagnostic pathways, and patient safety considerations within your specialty.
- Exceptional attention to detail in fact-checking clinical content, identifying unsafe assumptions, missing contraindications, inappropriate tests or therapies, and misinterpretation of results.
- Proficiency in English at a minimum C1 level.
- Ability to evaluate answers for internal consistency (timelines, physiology, dosing/contraindications), appropriateness for clinical settings (emergency department, inpatient, outpatient), and risk/benefit tradeoffs.
- Reliable, self-directed work ethic with the ability to deliver consistent quality in an hourly, remote contractor workflow across different time zones.
Preferred Qualifications and Benefits
- Prior experience in AI data training or annotation, clinical guideline development, utilization review, clinical documentation review, or healthcare editorial quality assurance is strongly preferred.
- This role offers the flexibility of remote work and the opportunity to contribute to cutting-edge AI healthcare applications.
- Being part of a fast-growing company focused on improving AI models used by leading global organizations provides a unique chance to impact healthcare technology at scale.
This position is ideal for medical specialists seeking to leverage their clinical expertise in the evolving field of AI-driven healthcare solutions while working remotely and on a flexible schedule.