Overview
This role involves evaluating AI-generated outputs related to legal reasoning, case analysis, contract review, and legal research. The position requires applying structured rubrics to assess legal accuracy and contributing to the improvement of AI models on legal tasks. Candidates should have practicing experience and strong legal reasoning skills.
Responsibilities
- Evaluate AI-generated legal analysis, case briefs, and contract reviews.
- Apply structured rubrics to assess legal accuracy, citations, and reasoning.
- Identify factual errors, hallucinated citations, and gaps in legal reasoning.
- File clear evaluation tickets with well-justified written explanations.
- Collaborate with legal and product teams to define quality criteria.
- Contribute to the design of rubrics for specific legal practice areas.
Requirements
- JD, LLB, or equivalent law degree from an accredited institution.
- Minimum of 2 years of legal practice experience.
- Active or recent bar admission in good standing.
- Familiarity with at least one major legal practice area.
- Strong written communication skills for legal writing and analysis.
- Ability to work independently in a remote environment.
Preferred Qualifications
- Experience practicing at a law firm, as in-house counsel, or in a government legal role.
- Experience evaluating AI or large language model output quality.
- Specialization in corporate, litigation, intellectual property, regulatory, or transactional law.
- Background in legal research and writing.
- Familiarity with legal technology and e-discovery platforms.
Compensation & Benefits
- Hourly pay ranging from $50 to $90.
- Remote and flexible work environment.
- Contract options with potential paths to full-time employment.
- Access to modern legal AI environments and active feedback loops.
- Collaborative team focused on quality.
- Opportunities for learning in legal AI evaluation and rubric design.
Location