Overview
This hourly, remote contractor role is for a Paralegal Subject Matter Expert (SME). You will review AI-generated legal support responses and/or create expert paralegal content. Work focuses on evaluating reasoning quality and step-by-step task execution, then providing precise written feedback.
There is no immediate project for this role; however, if qualified, you may be among the first experts contacted when relevant opportunities arise. This work may also connect you to future projects available through the organization’s expert network.
Responsibilities
- Develop AI training content: Create detailed prompts and gold-standard paralegal deliverables, including document templates, checklists, research summaries, and drafting examples.
- Optimize AI performance: Evaluate and rank AI responses to improve correctness, clarity, formatting, and procedural usefulness.
- Ensure model integrity: Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across legal support use cases.
- Provide precise written feedback: Assess solutions for accuracy, clarity, completeness, and adherence to the prompt.
- Identify legal and procedural issues: Flag errors in legal terminology, procedural steps, document structure, issue spotting, and citation/authority handling (where applicable).
- Fact-check legal-adjacent information: Verify and correct factual and legal-adjacent claims.
- Create high-quality explanations and model outputs: Produce explanations and outputs that demonstrate correct methods.
- Rate and compare responses: Compare multiple responses based on correctness and reasoning quality.
Requirements
- Associate’s or Bachelor’s degree (or higher) in Paralegal Studies, Legal Studies, or a related field; paralegal certification is a plus.
- 4+ years of professional experience as a paralegal or legal assistant (law firm, in-house, or public sector).
- Strong command of legal support workflows, including intake, fact gathering, document drafting, version control, and matter organization.
- Proven experience with legal research and summarizing authorities (cases, statutes, regulations) clearly and accurately.
- Familiarity with either:
- litigation processes (pleadings, discovery, subpoenas, motion practice support), and/or
- transactional workflows (contracts, corporate filings), depending on lane.
- Exceptional attention to detail, including spotting inconsistencies, missing facts, formatting issues, and ambiguous wording.
- Minimum C1 English proficiency.
- Comfort working with confidentiality requirements and handling sensitive information appropriately.
- Reliable, self-directed work style with the ability to deliver consistent quality in an hourly, remote contractor workflow across time zones.
Preferred Qualifications
- Prior experience with AI data training/annotation, document QA, legal ops, or editorial review.
Desired Skills and Experience
- Court Filings
- Legal Writing
- Contract Review
- Case Management
- E-discovery
- Compliance Basics
- Litigation Support
- Legal Research
- Document Drafting