Freelance Legal Specialist

Overview

Freelance Legal Domain Experts (SME)

• Work mode: Remote
• Engagement type: Ongoing / recurring pipeline (following an initial calibration pilot)
• Priority tracks: US Corporate, US Securities, US Labor, Philippines Corporate, China IP

This role supports the creation of ground truth data, the development of evaluation rubrics, assessment of agent trajectories, and analysis of failure modes (including primary vs. secondary authority confusion, jurisdiction over-generalization, and citation hallucination).

Responsibilities

• Establish ground truth data for legal evaluations
• Construct evaluation rubrics, including pass/fail criteria
• Assess agent trajectories and analyze loss patterns
• Perform claim verification and factual precision checks
• Audit legal research outputs (e.g., legal memoranda) for unsupported claims, citation misattributions, and factual inaccuracies
• Distinguish and correctly apply controlling jurisdiction and authority hierarchy
• Create sample evaluation rubrics for rubric authoring and evaluation calibration

Candidate Profile

The employer is seeking legal domain experts across multiple jurisdictions (United States and International) with practical experience in statutory analysis, legal research, and legal drafting.

Acceptable background (any one)

• Licensed Attorneys: Actively licensed or formerly practicing attorneys with 3+ years of practice experience in corporate, securities, labor, tax, IP, health, or civil litigation
• JD / LL.M. Graduates: Strong academic credentials with specialized experience in legal research and writing
• Senior Legal Research Specialists & Paralegals: 3+ years of experience performing statutory analysis, case law precedent research, and complex document drafting

Engagement Model & Task Scale

• Engagement type: Ongoing / recurring pipeline (following an initial calibration pilot)
• Staffing structure: Flex headcount model, scaling the expert pool with task volume and turnaround requirements
• Unit of effort & complexity: High complexity; each evaluation task requires an estimated 10 to 15 hours of comprehensive expert effort (deep legal analysis, trajectory review, claim verification, and rubric authoring)
• Initial volume: Starting with 5 core calibration tasks in Phase 1 for full alignment between researchers and domain experts, followed by ongoing weekly task allocations

Candidate Screening & Assessment Workflow

Candidates should be prepared for a structured 3-stage evaluation.

Stage 1: Resume & Credential Verification

• Verification of law degree (JD, LL.B., LL.M.) and active/past bar admission or certified legal specialist credentials
• Minimum 3+ years of relevant practice or specialized legal research experience in target domains

Stage 2: AI Based Interview (Technical Legal Knowledge Assessment)

• Jurisdiction Dissection: Identify controlling jurisdiction and distinguish applicable statutory provisions
• Authority Hierarchy Test: Evaluate a mixed list of sources and correctly rank binding primary authority versus persuasive secondary materials
• Citation & Claim Verification: Audit a legal memorandum for unsupported claims, citation misattributions, and factual inaccuracies

Stage 3: Rubric Authoring & Evaluation Calibration

• Create a sample evaluation rubric for an agentic legal research trajectory, including:
  • pass/fail criteria
  • factual precision checks
  • loss pattern categorizations

Location

• Remote

Compensation & Benefits

Not specified in the provided job description.