Conversation Quality Analyst
Alignerr
About the Role
We are looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they sound genuinely human, helpful, and clear. This is a fully remote, flexible contract role.
- Organization: Alignerr
- Type: Hourly Contract
- Location: Remote
- Commitment: 10–40 hours/week
Key Responsibilities
- Read and evaluate AI-generated conversations across a wide variety of topics and contexts
- Assess responses for naturalness, helpfulness, tone, and conversational flow
- Identify awkward phrasing, off-topic replies, logical errors, or robotic-sounding language
- Compare multiple conversation paths and rank them by overall quality
- Provide structured, detailed feedback using rating rubrics and written commentary
- Work independently and asynchronously on your own schedule
Qualifications
- Strong reading comprehension and a natural sense for how conversation should feel
- Able to assess quality objectively and explain your reasoning clearly
- Detail-oriented and consistent
- Self-motivated and reliable when working independently
- No prior AI, linguistics, or content evaluation experience required
Nice to Have
- Background in writing, editing, communications, or customer-facing roles
- Experience with quality assurance, research, or critical analysis
- Familiarity with AI tools or chatbots as an everyday user









