Overview
This is an hourly, remote contractor role for an Attorney / Lawyer Subject Matter Expert (SME) to review AI-generated legal responses and create expert legal content. The role involves evaluating the quality of legal reasoning and step-by-step issue analysis, providing precise written feedback, and ensuring accuracy and clarity in AI outputs. The legal expertise provided will help improve AI models' legal reasoning by making it more accurate, reliable, and clearly explained.
There is no immediate project available; however, qualified candidates will be among the first contacted for future opportunities and gain access to additional projects through the expert network.
Responsibilities
- Develop AI training content including detailed prompts and gold-standard legal outputs such as issue analyses, drafting examples, checklists, policies, and memos.
- Evaluate and rank AI-generated legal responses to improve correctness, clarity, defensibility, and risk awareness.
- Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias.
- Validate the reliability of AI responses across various legal scenarios.
Requirements
- JD, LLB, or equivalent law degree.
- Active bar membership or eligibility in at least one jurisdiction.
- Minimum of 5 years of professional legal experience in law firms, in-house legal departments, government, or legal aid.
- Strong skills in issue spotting and structured legal analysis (rules, application, conclusion), including identifying assumptions and uncertainties.
- Experience in one or more practice areas such as commercial/contracts, employment, privacy, corporate, litigation, intellectual property, real estate, or compliance.
- Proficient legal research skills, including locating and synthesizing primary authorities (statutes, regulations, cases) and accurately characterizing holdings.
- Excellent drafting and editing skills for contracts, clauses, memos, letters, policies, pleadings, with attention to precision and tone.
- Exceptional attention to detail in fact-checking and identifying overconfident claims, missing exceptions, jurisdictional pitfalls, or procedural risks.
- Minimum C1 English proficiency.
- Ability to evaluate answers for internal consistency, client safety, and appropriateness to context (e.g., consumer vs business, HR vs litigation).
- Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
Preferred Qualifications
- Prior experience with AI data training, annotation, legal quality assurance, editorial review, or knowledge management.
- Skills in contract drafting/review, legal research, legal reasoning, citation and authority checking, legal writing, risk assessment, issue spotting, regulatory/compliance, and litigation procedure.
Compensation & Benefits
- This is an hourly contractor position.
- Remote work with flexible scheduling across time zones.
Location
- Remote position; candidates must be able to work effectively in a remote, hourly contractor capacity.