Overview
This is an hourly, remote contractor role focused on reviewing AI-generated legal analyses and/or generating expert legal content. You will evaluate reasoning quality and step-by-step issue-spotting, then provide precise written feedback.
There is no immediate project for this role; however, if qualified, you will be among the first experts the organization reaches out to when relevant opportunities arise. You will also gain access to future projects available through its expert network.
Responsibilities
- Review and evaluate AI responses for:
- Accuracy, clarity, and adherence to the prompt
- Correct legal methodology or doctrine
- Reasoning quality and step-by-step issue-spotting
- Missing facts or assumptions that could change outcomes
- Check and fact-check:
- Citations and stated rules
- Jurisdictional relevance and procedural posture
- Logical consistency
- Produce high-quality legal content, including:
- Clear explanations and model solutions
- Structured feedback that identifies errors and the correct reasoning path
- Write and optimize AI training materials:
- Develop detailed prompts in various topics and responses to guide AI learning
- Optimize AI performance by:
- Evaluating and ranking multiple responses based on correctness and reasoning quality
- Ensure model integrity by:
- Testing for potential inaccuracies or biases and validating reliability across use cases
Requirements
- Bachelor’s degree (or higher) in Law (JD/LLB), Legal Studies, Public Policy, or Political Science
- Strong grounding in:
- Constitutional Law
- Contracts
- Torts
- Criminal Law
- Civil Procedure
- Regulatory/Administrative Law
- 5+ years of professional experience in Law, Legal Studies, Public Policy, or Political Science
- Strong legal reasoning and issue-spotting skills, including:
- Statutory interpretation
- Case analysis
- Translating facts into elements and defenses
- Strong compliance and obligations analysis, including the ability to identify missing facts/assumptions that affect outcomes
- Exceptional attention to detail when checking:
- Rule statements
- Citations
- Jurisdictional relevance
- Procedural posture
- Logical consistency
- Minimum C1 English proficiency
- Ability to write clear, structured feedback that explains errors and the correct reasoning path without unnecessary verbosity
- Reliable, self-directed work style with consistent quality in an hourly remote contractor workflow across time zones
Preferred Qualifications
- Previous experience with:
- AI data training/annotation
- Expert review
- Legal editing
- QA
Location
Remote (contractor role across time zones)
Desired Skills and Experience
Contracts, Statutory Interpretation, Case Law Analysis, Legal Reasoning, Criminal Law, Regulatory & Administrative Law, Compliance, English (C1+), Civil Procedure, Torts