Legal Expert - AI Training & Evaluation

Overview

This role is an internal, project-based contract opportunity with the organization. It is not a client role.

Advanced AI models are being used in legal work such as research, contract review, and compliance. This project focuses on legal experts who will build and evaluate the complex tasks those models are tested on.

Responsibilities

• Design complex legal tasks (e.g., a research question, a contract to analyze, or a compliance scenario) with a clear, defensible model answer.
• Review AI-generated legal responses line by line and grade them for accuracy, reasoning, and completeness.
• Identify errors such as hallucinated case law, misread clauses, missed exceptions, and reasoning that sounds plausible but is incorrect.
• Write clear rationales for evaluations so the model (and the team) can learn from the feedback.
• Work across multiple areas including legal research, contract analysis, regulatory compliance, and legal reasoning (not limited to a single niche).
• Meet task deadlines; the work is task-based and depends on timely submissions.

Requirements

• 3+ years of relevant legal experience as a practising lawyer or legal professional (practice, in-house, or at a firm).
• Strong legal research and analytical skills, including the ability to trace a question to the appropriate authority and explain why it applies.
• Comfort with contracts, compliance, and legal reasoning across more than one area of law.
• High precision in writing—clearly state what is wrong and why, without padding.
• Low tolerance for plausible-sounding errors or misinformation.

Preferred Qualifications

• Curiosity about how AI will change legal work, with a preference for shaping outcomes rather than only observing changes.

Compensation & Benefits

• ₹20,000–25,000 per task.
• Remote, flexible work with no fixed working days.
• Additional tasks and larger projects may be available if submitted work is consistently strong.

Location

Remote