About The Opportunity
Help our client improve how AI systems personalize responses for professionals. In this remote contractor assignment, you will review AI-generated answers using authorized professional email history as context. You will judge whether each response is relevant, accurate, helpful, and appropriately personalized. Your careful, structured feedback will help improve the quality and reliability of future AI experiences.
What you will do
- Assess AI-generated responses for relevance, accuracy, helpfulness, and appropriate personalization.
- Compare multiple responses and determine which delivers the stronger overall experience.
- Identify unsupported assumptions, incorrect personalization, irrelevant recommendations, and subtle inconsistencies.
- Explain your judgments through clear, detailed, and well-reasoned written feedback.
- Follow evaluation guidelines consistently while protecting privacy and maintaining confidentiality.
What we are looking for
- Strong proficiency in Spanish as used in Spain, including the ability to read and evaluate nuanced written content.
- An active Google Workspace account that you use regularly for professional communication.
- A Gmail interface or display language set to Spanish, with the majority of inbox content in Spanish.
- A well-established professional inbox with approximately 1,000 or more emails and regular account activity.
- A bachelor's degree or equivalent practical experience in any field.
- At least two years of professional experience.
- Strong analytical judgment, attention to detail, and the ability to work independently in a remote setting.
- Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical area is helpful but not required.
- A desktop or laptop, reliable internet access, and the ability to follow detailed project instructions.
Account authorization and privacy
You must be authorized to use the qualifying account's email history for this evaluation project. Do not use an employer-managed account unless you have explicit authorization from the employer or account owner. You will never be asked to share your password. You must follow all project privacy and confidentiality requirements throughout the assignment.
Engagement details
- Remote contractor assignment with an immediate start.
- Expected duration of 12 to 16 weeks.
- At least 4 hours of availability per day, up to 40 hours per week.
- At least 4 hours of working-time overlap with Pacific Time.
