Overview
This contract, fully remote role involves evaluating and analyzing written legal content for clarity, precision, accuracy, and appropriate use of legal reasoning. Work is based on written responses to legal and technical prompts.
You will review multiple responses, compare them against defined quality standards, assign analytical quality scores, and provide detailed written rationales for each evaluation.
This is an evaluative engagement. You will assess and analyze written legal content rather than provide legal advice or legal representation. No attorney-client relationship is created through the work.
Responsibilities
- Evaluate and compare multiple written responses to legal and technical prompts.
- Assess clarity, tone, precision, accuracy, and adherence to instructions.
- Apply defined evaluation criteria consistently.
- Assign analytical quality scores and provide detailed written rationales.
- Identify authoritative-sounding content that lacks adequate precision or support.
- Detect overstatements, unsupported claims, ambiguities, contradictions, and factual inaccuracies.
- Assess whether legal arguments and explanations are appropriately qualified.
- Evaluate whether content is suitable for its intended legal, regulatory, client, or public audience.
- Document findings and observations accurately using digital content review platforms.
- Maintain consistent evaluation standards across assignments.
- Collaborate asynchronously with project managers and reviewers.
- Work independently while managing assigned deliverables and deadlines.
Requirements
- English as a first language or fully equivalent written fluency.
- A qualifying law degree from a university in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
- Demonstrated experience drafting legal documents such as briefs, motions, memoranda, legal opinions, or regulatory submissions.
- Experience reviewing, editing, supervising, or providing feedback on legal writing produced by junior lawyers, trainees, or paralegals.
- Strong ability to assess legal writing for precision, appropriate qualification, factual support, and audience suitability.
- Excellent critical analysis and attention to detail.
- Strong legal writing and editing skills.
- Ability to clearly explain the reasoning behind an assessment or quality judgment.
- Comfortable working independently in a remote, project-based environment.
- Familiarity with digital document review or annotation platforms is desirable.
Preferred Qualifications
- Experience with model evaluation, RLHF, annotation, or similar quality-review workflows is helpful but not required.
Compensation & Benefits
- Annual compensation equivalent: $172,800–$268,800/year, calculated at 40 hours per week across 48 workable weeks per year.
- Hourly rate: $90–$140/hour.
- Contractor engagement.
- Fully remote.
- Flexible, project-based work.
- No previous AI experience required.
Location
Fully remote.