Overview
This role involves evaluating and improving AI model performance on U.S. litigation tasks. The organization is seeking Litigation and Civil Procedure experts to join projects that fine-tune AI models like ChatGPT. You will apply your experience with trial strategy, motion practice, discovery, and procedural rules to assess how AI handles complex litigation scenarios. Prior AI experience is not required—U.S. civil litigation practice experience is the primary need.
Responsibilities
- Review and evaluate AI-generated responses to U.S. litigation hypotheticals, including:
- Motion to dismiss arguments
- Summary judgment analyses
- Discovery disputes
- Trial strategy questions
- Use a structured legal rubric to assess:
- Issue spotting
- Procedural accuracy under the Federal Rules of Civil Procedure
- Proper application of case law and evidentiary standards
- Identify gaps in AI reasoning related to:
- Standing
- Jurisdiction
- Burden of proof
- Pleading standards (Twombly/Iqbal)
- Remedies
- Provide detailed, high-quality annotations and written feedback to help refine AI models
- Collaborate with researchers and project managers to align evaluation standards and project goals
Requirements
- Juris Doctor (J.D.) from an accredited U.S. law school
- Bar admission (active or inactive)
- 3+ years of U.S. legal practice in civil litigation, commercial litigation, or appellate work
- Strong reasoning skills across:
- Federal Rules of Civil Procedure
- Evidence
- Trial advocacy
- Excellent written communication skills and strong attention to detail
- High ethical standards
Preferred Qualifications
Compensation & Benefits
Location
- Flexible, fully remote work arrangement
Commitment
- 10–30 hrs/week (flexible)
- Duration: ~1 month, with the possibility of extension based on performance and project needs