This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

This role supports a fast-scaling AI quality evaluation initiative in the shopping domain, where experts help define and maintain high-quality standards for AI-generated outputs.

• Contribute to rubric development and evaluation frameworks for AI-generated outputs
• Apply expert judgment to assess whether outputs meet clearly defined quality standards
• Help establish evaluation guidelines and best practices during early project phases
• Provide structured feedback that strengthens the quality of AI-generated content
• Ensure consistency and reliability in evaluation processes across multiple tasks

Qualifications

• Prior experience working with Plato evaluation systems or similar rubric-based review frameworks
• Strong analytical thinking and ability to apply structured evaluation criteria
• Experience reviewing, grading, or evaluating complex outputs
• Ability to maintain consistency and quality across evaluation tasks
• High attention to detail
• Strong written communication skills
• Ability to work independently in a remote environment

Requirements

• Independent contractor role
• Fully remote with flexible scheduling
• Weekly payments via Stripe or Wise
• Projects may be extended based on performance and program needs

Benefits

• Pay: $130 per task
• Average time per task: ~1.5 hours
• Equivalent hourly rate: ~65/hr
• Initial 3-week sprint with high likelihood of continued work depending on project needs and performance
• Early contributors may help shape evaluation standards as the project scales

Company Description

This opportunity is available through a leading AI-driven work platform.