Overview
The organization is inviting Real Estate and Property Law experts to support evaluation projects focused on fine-tuning AI models for U.S. property law topics (no prior AI experience required).
This role involves reviewing and assessing AI-generated responses to legal hypotheticals and providing detailed annotations and feedback to improve model performance, including accuracy of property law doctrines and correct application of relevant legal rules.
Responsibilities
- Review and evaluate AI-generated responses to U.S. property law hypotheticals, including:
- Commercial purchase agreements
- Title defects
- Zoning variances
- Landlord-tenant disputes
- Mortgage foreclosure proceedings
- Apply a structured legal rubric to assess:
- Issue spotting
- Accuracy of property doctrines
- Proper application of recording statutes, the Rule Against Perpetuties, and state landlord-tenant codes
- Identify gaps or weaknesses in AI reasoning, including around:
- Concurrent estates
- Easements
- Restrictive covenants
- Constructive eviction
- 1031 exchange structuring
- Provide detailed, high-quality annotations and written feedback to refine AI models
- Collaborate with researchers and project managers to align evaluation standards and project goals
Requirements
- Juris Doctor (J.D.) from an accredited U.S. law school
- Bar admission (active/inactive)
- 3+ years of U.S. legal practice in real estate transactions, property litigation, or land use and zoning
- Strong reasoning skills across relevant areas, including:
- Property law doctrines
- Commercial leasing
- Title insurance
- Real estate finance
- Excellent written communication and attention to detail
- High ethical standards
Preferred Qualifications
Compensation & Benefits
Location
- Flexible, fully remote work arrangement
Commitment
- Flexible scheduling: 10–30 hrs/week
- Duration: ~1 month, with the possibility of extension based on performance and project needs