Overview
A remote opportunity is available for experienced lawyers to evaluate AI-generated legal outputs. This role involves assessing AI performance in legal reasoning, case analysis, contract review, and legal research using structured rubrics. The position requires strong legal expertise and the ability to provide detailed, accurate evaluations to improve AI models.
Responsibilities
- Evaluate AI-generated legal analyses, case briefs, and contract reviews.
- Apply structured rubrics to assess legal accuracy, citations, and reasoning.
- Identify factual inaccuracies, hallucinated citations, and gaps in legal reasoning.
- Submit clear and well-justified evaluation reports.
- Collaborate with legal and product teams to define quality criteria.
- Assist in designing evaluation rubrics for specific legal practice areas.
Requirements
- Juris Doctor (JD), Bachelor of Laws (LLB), or equivalent law degree from an accredited institution.
- Minimum of 2 years of legal practice experience.
- Active or recent bar admission in good standing.
- Familiarity with at least one major legal practice area.
- Strong written communication skills for legal writing and analysis.
- Ability to work independently in a remote setting.
Preferred Qualifications
- Experience practicing at a law firm, as in-house counsel, or in a government legal role.
- Prior experience evaluating AI or large language model (LLM) output quality.
- Specialization in corporate, litigation, intellectual property, regulatory, or transactional law.
- Background in legal research and writing.
- Familiarity with legal technology and e-discovery platforms.
Compensation & Benefits
- Hourly pay ranging from $50 to $90.
- Remote and flexible work environment.
- Contract opportunities with potential pathways to full-time employment.
- Access to modern legal AI tools and active feedback processes.
- Collaborative team focused on quality and continuous learning.
Location