Overview
This hourly, remote contractor role involves working as an Attorney / Lawyer Subject Matter Expert (SME) to review AI-generated legal responses and create expert legal content. The position requires evaluating the quality of legal reasoning and step-by-step issue analysis while providing precise written feedback. The role supports improving AI models by enhancing their legal reasoning accuracy, reliability, and clarity.
Responsibilities
- Develop AI training content including detailed prompts and gold-standard legal outputs such as issue analyses, drafting examples, checklists, policies, and memos.
- Evaluate and rank AI-generated legal responses to improve correctness, clarity, defensibility, and risk awareness.
- Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across various legal scenarios.
Requirements
- JD, LLB, or equivalent law degree with active bar membership or eligibility in at least one jurisdiction.
- Minimum of 5 years of professional legal experience in law firms, in-house legal departments, government, or legal aid.
- Strong skills in issue spotting and structured legal analysis, including identifying assumptions and uncertainties.
- Experience in one or more practice areas such as commercial/contracts, employment, privacy, corporate, litigation, intellectual property, real estate, or compliance.
- Proficient in legal research, including locating and synthesizing primary authorities like statutes, regulations, and case law.
- Excellent drafting and editing skills for contracts, memos, letters, policies, pleadings, with attention to precision and tone.
- Exceptional attention to detail for fact-checking, identifying overconfident claims, missing exceptions, jurisdictional pitfalls, or procedural risks.
- Minimum C1 English proficiency.
- Ability to evaluate answers for internal consistency, client safety, and appropriateness to context (e.g., consumer vs. business, HR vs. litigation).
- Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
Preferred Qualifications
- Prior experience with AI data training, annotation, legal quality assurance, editorial review, or knowledge management.
- Skills in legal reasoning, contract drafting and review, litigation and procedure, regulatory compliance, issue spotting, risk assessment, legal writing, and citation/authority checking.
Additional Information
- There is no immediate project available for this role; however, qualified candidates will be among the first contacted for relevant future opportunities.
- This role provides access to future projects through an expert network.
Location
- Remote contractor position with flexible time zones.