Overview
This hourly, remote contractor role involves reviewing AI-generated legal analyses and/or generating expert legal content. The primary tasks include evaluating the quality of reasoning and step-by-step issue-spotting, providing precise written feedback, assessing answers for accuracy, clarity, and adherence to prompts, identifying errors in legal methodology or doctrine, fact-checking citations and stated rules, writing high-quality explanations and model solutions, and rating and comparing multiple responses based on correctness and reasoning quality.
This position supports the improvement of AI models' legal reasoning by ensuring their outputs are accurate, reliable, and clearly explained.
Note: There is no immediate project available for this role. Qualified candidates will be among the first contacted when relevant opportunities arise and will gain access to future projects through the expert network.
Responsibilities
- Develop AI training content by creating detailed prompts and responses across various legal topics to guide AI learning.
- Evaluate and rank AI responses to improve model accuracy, fluency, and contextual relevance.
- Test AI models for potential inaccuracies or biases to validate their reliability across different use cases.
Requirements
- Bachelor’s degree or higher in Law (JD/LLB), Legal Studies, Public Policy, or Political Science.
- Strong foundation in Constitutional Law, Contracts, Torts, Criminal Law, Civil Procedure, and Regulatory/Administrative Law.
- Minimum of 5 years of professional experience in Law, Legal Studies, Public Policy, or Political Science.
- Proficient legal reasoning and issue-spotting skills, including statutory interpretation, case analysis, and translating facts into legal elements and defenses.
- Fluent understanding of compliance concepts, rights and obligations analysis, and policy frameworks.
- Ability to identify missing facts and assumptions that affect legal outcomes.
- Exceptional attention to detail when verifying rule statements, citations, jurisdictional relevance, procedural posture, and logical consistency.
- Minimum C1 level English proficiency.
- Ability to write clear, structured feedback explaining errors and correct reasoning concisely.
- Reliable, self-directed, and capable of delivering consistent quality in an hourly, remote contractor workflow across time zones.
Preferred Qualifications
- Previous experience with AI data training or annotation, expert review, legal editing, or quality assurance.
Desired Skills
- Legal reasoning
- Statutory interpretation
- Case law analysis
- Contracts
- Criminal law
- Regulatory and administrative law
- Compliance
- English proficiency (C1+)
- Torts
- Civil procedure