AI Evaluator, English

About the Role

Outlier seeks talented, detail-oriented English speakers to help train generative AI voice, image, and video models. This is a freelance, remote opportunity with flexible hours.

Key Responsibilities

• Hold live, scenario-based conversations in English with AI voice models, ranking them on naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos, judging which better follows the prompt.
• Inspect outputs closely (zooming, replaying) to identify problems such as distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
• Rate outputs across dimensions like adherence, quality, and realism.
• Write specific explanations in English detailing observations.

Requirements & Tech Stack

• A computer with a reliable internet connection.
• Headphones.
• A quiet place to talk for projects involving live conversation.
• No AI tools can be used for writing ratings and explanations.
• A short screening and onboarding process, which may include a brief spoken English check.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Comfortable with natural, everyday conversational speech.
• Pursuing or holding a Bachelor's degree or above.
• Strong attention to detail, with patience for close listening and replaying/zooming.
• Comfortable thinking on your feet and discussing realistic situations conversationally.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions, even when both options have flaws.

Payment

• On average, Outlier Contributors earn an additional 7.5% on top of core project rates through Missions (Outlier's surge pricing).
• Top quartile contributors boost earnings by an average of 11%.
• Rates vary based on expertise, skills assessment, location, project need, and other factors. Higher rates may be offered for PhDs.
• Lower rates may apply for non-core work (e.g., initial onboarding, project overtime).
• Additional incentive data is based on payments made in the past six months and is updated quarterly.
• Certain projects offer incentive payments. Review payment terms for each project.