$20/hr

About the Role

We are seeking experienced AI Product Evaluators, AI QA Testers, Model Evaluation Specialists, and detail-oriented technology professionals to contribute to a remote AI project focused on testing advanced models and agents. You will follow structured evaluation scenarios, execute operational test cases, assess AI behavior, document anomalies, and submit high-quality evaluation data according to detailed project guidelines.

Key Responsibilities

• Evaluate AI models and AI agents using predefined scenarios, instructions, and grading criteria.
• Execute structured tasks designed to test model accuracy, reasoning, responsiveness, reliability, and instruction-following.
• Compare model behavior against expected outcomes and identify incorrect, incomplete, inconsistent, or unexpected responses.
• Document findings, errors, unusual behaviors, and evaluation results in structured written reports.
• Repeat evaluations when required to verify consistency or test behavior across multiple sessions.
• Reset usage limits or testing environments according to project procedures and continue evaluation workflows.
• Record findings and submit evaluation datasets through designated AI training or assessment platforms.
• Follow detailed project instructions precisely and apply the same standards across large volumes of tasks.
• Escalate unclear scenarios, unexpected platform behavior, or ambiguous evaluation cases when necessary.
• Maintain strong accuracy, consistency, and documentation quality across all assigned evaluations.

Requirements & Tech Stack

• Experience using AI products, AI models, AI agents, or similar digital tools.
• Strong ability to follow complex instructions precisely and consistently.
• Exceptional attention to detail and operational accuracy.
• Regular use of AI tools in daily life or professional work.
• Ability to identify errors, inconsistencies, and unexpected model behavior.
• Strong written communication and documentation skills.
• Comfortable completing repetitive or high-volume evaluation tasks.
• Strong time management and self-organization skills.
• Ability to work independently in a remote environment.

Preferred Background

• Experience with AI model evaluation, AI product testing, RLHF, human data, or response rating.
• Experience with software QA, manual testing, user acceptance testing, or digital product evaluation.
• Experience reviewing AI-generated text, code, images, research outputs, or agent behavior.
• Experience working with annotation platforms, evaluation dashboards, or structured grading systems.
• Experience documenting bugs, test results, or operational findings.
• Experience participating in AI research, digital product testing, or software quality projects.
• Experience with high-volume operational workflows or structured data collection is valuable.

This opportunity is ideal for people who use AI frequently, enjoy testing how systems behave, can follow detailed instructions without skipping steps, notice small inconsistencies that others miss, and can document exactly what happened in a clear and structured way.