Attorney and Lawyer

Overview

This is an hourly, remote contractor role for an Attorney / Lawyer Subject Matter Expert (SME). You will review AI-generated legal responses and/or create expert legal content. Work focuses on evaluating reasoning quality and step-by-step issue analysis, providing precise written feedback, and producing high-quality legal explanations and model answers.

Please note: there is no immediate project for this role. If qualified, you will be among the first experts contacted when relevant opportunities arise, and you may gain access to future projects through the organization’s expert network.

Responsibilities

• Develop AI training content by creating detailed prompts and gold-standard legal outputs (issue analyses, drafting examples, checklists, policies, and memos).
• Optimize AI performance by evaluating and ranking AI responses to improve correctness, clarity, defensibility, and risk awareness.
• Ensure model integrity by testing AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across legal scenarios.
• Review and improve responses by assessing solutions for accuracy, clarity, completeness, and adherence to the prompt.
• Identify issues in legal analysis including errors in legal reasoning, rule application, procedural steps, and risk/assumption handling.
• Fact-check legal concepts and citations (when required).
• Write clear feedback explaining what is correct, what is missing, what needs revision, and why.
• Rate and compare multiple responses based on correctness and reasoning quality.

Requirements

• JD/LLB (or equivalent law degree) and active bar membership (or eligibility) in at least one jurisdiction.
• 5+ years of professional experience practicing law (law firm, in-house, government, or legal aid).
• Strong ability to perform issue spotting and structured legal analysis (rules → application → conclusion), including identifying assumptions and uncertainty.
• Demonstrated experience in one or more practice areas, such as:
  • commercial/contracts
  • employment
  • privacy
  • corporate
  • litigation
  • IP
  • real estate
  • compliance
• Strong research skills, including locating and synthesizing primary authority (statutes, regulations, cases) and accurately characterizing holdings.
• Excellent drafting/editing skills for legal documents such as contracts/clauses, memos, letters, policies, and pleadings (as applicable), with attention to precision and tone.
• Exceptional attention to detail when fact-checking and identifying overconfident claims, missing exceptions, jurisdictional pitfalls, or procedural risks.
• Minimum C1 English proficiency.
• Comfortable evaluating answers for internal consistency, client safety, and appropriateness to context (e.g., consumer vs business; HR vs litigation).
• Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.

Preferred Qualifications

• Prior experience with AI data training/annotation, legal QA, editorial review, or knowledge-management work.

Compensation & Benefits

• Hourly, remote contractor work. (No additional compensation details were provided.)

Location

• Remote