Overview
This is an hourly, remote contractor position for an Attorney / Lawyer Subject Matter Expert (SME) to review AI-generated legal responses and create expert legal content. The role involves evaluating the quality of legal reasoning and step-by-step issue analysis, providing precise written feedback, and ensuring accuracy and clarity in AI outputs. The legal expertise provided will help improve AI models' legal reasoning capabilities.
There is no immediate project available; however, qualified candidates will be among the first contacted for future opportunities and gain access to additional projects through the expert network.
Responsibilities
- Develop AI training content including detailed prompts and gold-standard legal outputs such as issue analyses, drafting examples, checklists, policies, and memos.
- Evaluate and rank AI-generated legal responses to enhance correctness, clarity, defensibility, and risk awareness.
- Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias, ensuring reliability across various legal scenarios.
Requirements
- JD, LLB, or equivalent law degree with active bar membership or eligibility in at least one jurisdiction.
- Minimum of 5 years of professional legal experience in law firms, in-house legal departments, government, or legal aid.
- Strong skills in issue spotting and structured legal analysis, including identifying assumptions and uncertainties.
- Experience in one or more practice areas such as commercial/contracts, employment, privacy, corporate, litigation, intellectual property, real estate, or compliance.
- Proficient in legal research, including locating and synthesizing primary authorities like statutes, regulations, and case law.
- Excellent drafting and editing skills for contracts, memos, letters, policies, pleadings, with attention to precision and tone.
- Exceptional attention to detail in fact-checking and identifying overconfident claims, missing exceptions, jurisdictional issues, or procedural risks.
- Minimum C1 English proficiency.
- Ability to evaluate answers for internal consistency, client safety, and contextual appropriateness.
- Reliable, self-directed, and capable of delivering consistent quality in a remote, hourly contractor role across time zones.
Preferred Qualifications
- Prior experience with AI data training, annotation, legal quality assurance, editorial review, or knowledge management.
- Skills in citation and authority checking, legal reasoning, risk assessment, regulatory/compliance matters, litigation and procedure, and contract drafting/review.
Location
Remote contractor role; candidates must be able to work across time zones as required.
Compensation & Benefits
This is an hourly contractor position. Specific compensation details will be provided during the recruitment process.