Overview
This contractor role is remote and supports an AI evaluation project focused on assessing the quality of AI-generated legal and technical content.
You will use your expertise in legal writing, drafting, document review, and critical analysis to evaluate written responses. This is an evaluation-focused position—no prior AI experience is required.
Responsibilities
- Evaluate and compare AI-generated responses to legal and technical prompts.
- Assess content for clarity, accuracy, tone, precision, and adherence to instructions.
- Provide analytical quality assessments with clear written rationales.
- Identify unsupported claims, overstatements, ambiguities, and inconsistencies.
- Review content for factual and logical accuracy.
- Document findings using digital review and annotation platforms.
- Collaborate remotely with project managers and reviewers to maintain consistent evaluation standards.
- Manage assignments independently and meet project deadlines.
Required Qualifications
- Native or near-native written fluency in English.
- Qualifying law degree from a university in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
- Professional experience drafting briefs, motions, memoranda, legal opinions, regulatory submissions, or similar documents.
- Experience reviewing, editing, or supervising legal writing.
- Strong legal writing, drafting, document-review, and critical-analysis skills.
- Excellent attention to detail and written communication skills.
- Ability to evaluate content for different legal, regulatory, client, or public audiences.
- Ability to work independently in a remote environment.
Preferred Qualifications
- Experience with digital document review or annotation platforms.
- Background in AI model evaluation, data annotation, or RLHF.
- Strong understanding of legal research and fact-checking.
- Experience identifying unsupported or overly broad legal claims.