Overview
A remote opportunity is available for a Lawyer to evaluate AI outputs related to legal reasoning, case analysis, contract review, and legal research. This role involves applying structured rubrics to assess the legal accuracy of AI-generated content and contributing to the improvement of AI models in legal tasks. Candidates should have practicing experience and strong legal reasoning skills.
Responsibilities
- Evaluate AI-generated legal analysis, case briefs, and contract reviews.
- Apply structured rubrics to assess legal accuracy, citations, and reasoning.
- Identify factual errors, hallucinated citations, and gaps in legal reasoning.
- File clear evaluation tickets with well-justified written explanations.
- Collaborate with legal and product teams to define quality criteria.
- Contribute to the design of rubrics for specific legal practice areas.
Requirements
- JD, LLB, or equivalent law degree from an accredited institution.
- Minimum of 2 years of legal practice experience.
- Active or recent bar admission in good standing.
- Familiarity with at least one major legal practice area.
- Strong written communication skills for legal writing and analysis.
- Ability to work independently in a remote setting.
Preferred Qualifications
- Experience practicing at a law firm, as in-house counsel, or in a government legal role.
- Experience evaluating AI or large language model output quality.
- Specialization in corporate, litigation, intellectual property, regulatory, or transactional law.
- Background in legal research and writing.
- Familiarity with legal technology and e-discovery platforms.
Compensation & Benefits
- Hourly pay ranging from $50 to $90.
- Remote and flexible work environment.
- Contract options with potential paths to full-time employment.
- Access to modern legal AI environments and active feedback loops.
- Collaborative team focused on quality.
- Opportunities for learning in legal AI evaluation and rubric design.
Location