In this hourly, remote contractor position, you will play a crucial role in reviewing AI-generated legal analyses and producing expert legal content. Your primary tasks will include evaluating the quality of reasoning and issue-spotting in AI outputs, providing precise written feedback, and ensuring responses are accurate, clear, and aligned with the given prompts. You will identify errors in legal methodology or doctrine, fact-check citations and stated rules, write high-quality explanations and model solutions, and rate multiple responses based on correctness and reasoning quality. This opportunity is with SME Careers, a rapidly growing AI Data Services company and subsidiary of SuperAnnotate, which supplies training data to some of the world’s largest AI companies and foundation-model labs. Your legal expertise will directly contribute to improving the accuracy, reliability, and clarity of leading AI models’ legal reasoning.
Key Responsibilities
- Develop AI Training Content: Create detailed prompts and responses across various legal topics to guide AI learning, ensuring comprehensive subject coverage.
- Optimize AI Performance: Evaluate and rank AI-generated answers to improve the model’s accuracy, fluency, and contextual relevance.
- Ensure Model Integrity: Test AI models for inaccuracies or biases and validate their reliability across different legal use cases.
Required Qualifications
- Bachelor’s degree or higher in Law (JD/LLB), Legal Studies, Public Policy, or Political Science, with strong knowledge in Constitutional Law, Contracts, Torts, Criminal Law, Civil Procedure, and Regulatory/Administrative Law.
- Minimum of 5 years professional experience in Law, Legal Studies, Public Policy, or Political Science.
- Strong legal reasoning and issue-spotting abilities, including statutory interpretation, case analysis, and the ability to translate facts into legal elements and defenses.
- Proficiency in compliance concepts, rights and obligations analysis, and policy frameworks, with the capacity to identify missing facts or assumptions that could alter outcomes.
- Exceptional attention to detail when verifying rule statements, citations, jurisdictional relevance, procedural posture, and logical consistency. English proficiency at minimum C1 level is required.
- Ability to write clear, structured feedback that explains errors and the correct reasoning path concisely and effectively.
- Reliable, self-motivated, and capable of maintaining consistent quality in a remote, hourly contractor role across multiple time zones.
Preferred Qualifications and Benefits
- Previous experience in AI data training, annotation, expert review, legal editing, or quality assurance is highly preferred.
- While there is no immediate project available, qualified candidates will be among the first contacted for upcoming opportunities and gain access to future projects within the expert network.
This role offers a unique chance to leverage your legal expertise in advancing AI technologies, contributing to the development of more accurate and trustworthy legal AI models.