Corporate Lawyer

Overview

A leading organization connecting top creative and technical talent with AI research labs is seeking a Legal AI Evaluator. This role offers flexible full-time or part-time contract work with a compensation rate of $105 per hour. The position is open to candidates located in the USA, EU, UK, and Canada.

Responsibilities

• Develop and refine prompts to guide large language model (LLM) behavior in legal contexts.
• Evaluate LLM-generated responses to legal queries for accuracy, reasoning, clarity, and completeness.
• Perform fact-checking using trusted public sources and authoritative references.
• Annotate model responses by identifying strengths, areas for improvement, and factual or conceptual inaccuracies.
• Assess tone, completeness, and appropriateness of responses for real-world legal scenarios.
• Apply consistent evaluation standards by following established taxonomies, benchmarks, and detailed guidelines.

Requirements

• Minimum of 5 years of professional experience in the legal field.
• Possession of an expert legal degree such as JD, LLB, LLM, or equivalent.
• Experience in one or more legal sub-domains including Corporate, Business & Commercial Law; Employment, Labor & Human Rights; Public, Criminal & International Governance; or Private Law.
• Significant experience working with large language models (LLMs).
• Excellent writing skills.
• Ability to evaluate complex arguments and identify subtle reasoning or detail-level issues.

Preferred Qualifications

• Prior experience with reinforcement learning from human feedback (RLHF), model evaluation, or data annotation.
• Experience writing or editing high-quality legal or analytical content.
• Ability to translate legal concepts for non-legal audiences.
• Familiarity with evaluation rubrics, benchmarks, or quality scoring systems.

Application Process

• Upload your resume.
• Complete an AI interview based on your resume.
• Submit the application form.

The application process typically takes 20–30 minutes.

Location

Remote work available for candidates based in the USA, EU, UK, and Canada.