Domain Expert, AI Evaluation (Law)

Overview

Position: Domain Expert, AI Evaluation (Law)

Location: Remote (USA)

Employment Type: Full-time, Short-term Fixed Contract

Contract Duration: 1 to 6 Months (Project-Based)

Compensation: Task-Based (Competitive payment per approved task)

Department: Research Operations

Responsibilities

• Design original legal tasks grounded in real-world legal practice.
• Produce accurate, fully reasoned, and defensible "golden answers."
• Develop challenging legal reasoning scenarios to identify limitations in advanced AI systems.
• Ensure all deliverables meet quality, formatting, and accuracy standards.
• Complete assigned tasks independently before starting new assignments.
• Incorporate reviewer feedback while maintaining consistent quality across submissions.

Required Qualifications

Education & Experience

• Juris Doctor (JD) or equivalent recognized professional law qualification.
• Minimum 2 years of professional legal experience.

Skills

• Strong legal expertise with current knowledge of legal practice.
• Excellent legal analysis and reasoning abilities.
• Outstanding written English communication skills.
• Strong attention to detail.
• Ability to work independently in a structured environment.

Requirements

• Full-time availability during the contract period.
• Personal laptop with a modern web browser.
• Reliable high-speed internet connection.

Compensation & Work Integrity

• Competitive task-based payment for each approved submission.
• Earnings depend on the quality and quantity of completed tasks.
• Detailed payment structure provided during onboarding.
• Successful completion of a project onboarding assessment is required.
• All deliverables must be original, human-authored work; use of AI writing, editing, or grammar assistance tools is strictly prohibited.
• Employment is contingent upon signing a Non-Disclosure Agreement (NDA).