Attorney and Lawyer

Overview

This is an hourly, remote contractor role for an Attorney / Lawyer Subject Matter Expert (SME). You will review AI-generated legal responses and/or create expert legal content. Responsibilities include evaluating reasoning quality and step-by-step issue analysis, providing precise written feedback, and rating and comparing multiple responses based on correctness and reasoning quality.

There is no immediate project for this role; however, if qualified, you may be among the first experts contacted when relevant opportunities arise. This role may also provide access to future projects through the organization’s expert network.

Responsibilities

• Develop AI Training Content: Create detailed prompts and gold-standard legal outputs (issue analyses, drafting examples, checklists, policies, and memos).
• Optimize AI Performance: Evaluate and rank AI responses to improve correctness, clarity, defensibility, and risk awareness.
• Ensure Model Integrity: Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across legal scenarios.
• Quality Evaluation & Feedback:
  • Assess solutions for accuracy, clarity, completeness, and adherence to the prompt.
  • Identify errors in legal reasoning, rule application, procedural steps, and risk/assumption handling.
  • Fact-check legal concepts and, when required, citations.
  • Write high-quality explanations and model answers that demonstrate correct legal analysis and clear communication.
• Answer Comparison: Rate and compare multiple responses based on correctness and reasoning quality.

Requirements

• Education & Licensing: JD/LLB (or equivalent law degree) and active bar membership (or eligibility) in at least one jurisdiction.
• Experience: 5+ years of professional experience practicing law (law firm, in-house, government, or legal aid).
• Legal Analysis: Strong ability to perform issue spotting and structured legal analysis (rules → application → conclusion), including identifying assumptions and uncertainty.
• Practice Areas: Demonstrated experience in one or more practice areas (e.g., commercial/contracts, employment, privacy, corporate, litigation, IP, real estate, compliance).
• Research: Strong research skills, including locating and synthesizing primary authority (statutes, regulations, cases) and accurately characterizing holdings.
• Drafting & Editing: Excellent drafting/editing skills for contracts/clauses, memos, letters, policies, and pleadings (as applicable), with attention to precision and tone.
• Attention to Detail: Exceptional attention to detail when fact-checking and identifying overconfident claims, missing exceptions, jurisdictional pitfalls, or procedural risks; minimum C1 English proficiency.
• Context Appropriateness: Ability to evaluate answers for internal consistency, client safety, and appropriateness to context (e.g., consumer vs business, HR vs litigation).
• Work Style: Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.

Preferred Qualifications

• Prior experience with AI data training/annotation, legal QA, editorial review, or knowledge-management work.

Compensation & Benefits

• Hourly, remote contractor role. (Compensation details not provided in the source description.)

Location

• Remote (across time zones).