Personal Account Generalist Raters
Turing
Pittsburgh, PAFresher1h agovia LinkedIn
About the Role
- Join an innovative AI evaluation project focused on improving how AI understands personal context and delivers relevant, personalized responses.
- As a Mobile AI Rater, you will review AI-generated outputs using selected data from G-Suite Apps, along with relevant content from Google Messages and device SMS.
- Your feedback will help assess the accuracy, relevance, and quality of AI personalization in real-world scenarios.
Project Snapshot
- $25/hour
- 16-week project (with potential chances of extension)
- 20 hours/week commitment, with eligibility for up to 40 hours/week
- Fully remote | Paid in USD
- Potential Start date - 26/October/2026 or nearby dates
Key Responsibilities
- Review AI-generated prompts and responses in English.
- Evaluate responses for relevance, accuracy, helpfulness, and personalization.
- Assess how well AI understands everyday context, preferences, relationships, routines, and experiences.
- Provide clear ratings, explanations, and feedback.
- Follow project guidelines and maintain a high level of consistency.
- Help improve the quality and reliability of next-generation AI systems.
Requirements & Tech Stack
- Primary Android Smartphone users.
- Users with a primary Google Pixel 8 or newer device.
- Users with Android 17 or higher.
- Regular users of the Google Messages app for personal SMS/RCS conversations.
- Individuals comfortable reviewing AI content in English.