Overview
The organization is seeking Remote Legal Experts to support freelance projects focused on improving AI models (e.g., ChatGPT) through legal evaluation. This role is well-suited for experienced U.S. legal professionals who enjoy legal reasoning, analyzing complex hypotheticals, and providing structured, detailed feedback.
No prior AI experience is required—U.S. legal knowledge will be used to evaluate and improve how AI systems understand and reason about legal concepts.
Responsibilities
- Review and evaluate AI-generated responses to U.S. legal hypotheticals
- Assess legal responses for:
- Issue spotting
- Accuracy
- Reasoning quality
- Application of law
- Apply structured legal evaluation rubrics consistently
- Identify gaps, edge cases, and weaknesses in AI-generated legal reasoning
- Provide detailed annotations and written feedback to improve AI models
- Help establish benchmarks for legal AI performance
- Collaborate with researchers and project managers on evaluation standards and project objectives
- Apply strong legal judgment and ethical standards throughout assigned projects
Basic Qualifications
- Juris Doctor (J.D.) from an accredited U.S. law school
- Active or inactive U.S. Bar admission
- 3+ years of U.S. legal practice or teaching experience
- Strong legal reasoning skills across core areas of U.S. law
- Excellent written communication skills
- Exceptional attention to detail
- Ability to analyze complex legal scenarios and provide structured feedback
- High ethical standards and professional judgment
Preferred Qualifications
- Experience evaluating legal reasoning, legal research, or complex hypothetical scenarios
- Strong interest in artificial intelligence and emerging technologies
- Experience with structured evaluation, annotation, or quality-review processes
- Ability to communicate complex legal concepts clearly and concisely
- Adaptability when working with evolving AI research and project requirements
Compensation & Benefits
- Fully remote and flexible freelance work
- Competitive compensation
- Opportunity to contribute to cutting-edge AI projects
- Work on projects involving leading large language model (LLM) companies
- Opportunity to explore the application of AI within the legal field
- Flexible commitment based on project requirements
- Initial project duration of approximately one month, with potential extension based on performance and project needs
Location
Remote (U.S. legal expertise required).