Back to all roles

AI Translation Evaluator; Spanish-English

Remote-first Full-time Now hiring

Join the Appen team as an Independent Contractor for Project Centric. Project Centric is seeking individuals for an ongoing, ad-hoc project focused on improving AI-powered translation. In this project, participants will evaluate context-dependent translations produced by an AI chatbot, where each item includes a conversation history, a translation request with additional context (such as dialect preferences, selective non-translation rules, tone/register requirements, or domain-specific terminology), and the chatbot's response. You will apply MQM error annotations, verify auto-generated rubric items for relevance, and evaluate each applicable rubric item as Pass or Fail based on whether the translation meets the user's stated requirements. Help improve AI translation systems by evaluating Spanish-English translations for accuracy, quality, and adherence to user-specified requirements. Key Responsibilities: - Review conversation history and translation requests with additional contextual instructions - Apply MQM error annotations with appropriate categories and severity levels - Verify auto-generated rubric items for relevance, marking spurious items as needed - Evaluate each rubric item as Pass or Fail based on the user's stated requirements - Provide accurate and consistent ratings based on project guidelines - Complete assigned tasks within the given timelines Key Requirements: - Must be a native Spanish speaker with a strong command of English, including grammar, vocabulary, and translation conventions - Must be a language specialist, professional translator, or hold a Master's Degree in a language-related field - Keen attention to detail - Access to a stable internet connection and a computer This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role. If you have a passion for language and translation, this is a great opportunity to help shape AI systems that produce accurate, context-aware multilingual translations. Slots are limited — apply through CrowdGen and start evaluating! #crowdgen \n \n$20 - $20 an hour \n Apply To This Job

More remote roles

Lead Risk Analyst

Remote-first Full-time

Project Manager

Remote-first Full-time

GenAI Integrated Project Manager

Remote-first Full-time

QA Automation Engineer

Remote-first Full-time

Software Engineer Python or Java

Remote-first Full-time

Motor Recoveries Handler

Remote-first Full-time

Private Sector Partnerships Consultant Rabat Morocco. 12 Months Remote# 592846

Remote-first Full-time

Senior Health Economics Associate

Remote-first Full-time

Traductor/a Italiano (Sustitución de Maternidad)

Remote-first Full-time

Account Manager

Remote-first Full-time

Sales Associate – Part Time, Contractor

Remote-first Full-time

Senior Manager, Technical Operations

Remote-first Full-time

Sr. Director, International - Operations

Remote-first Full-time

Remote Customer Service Representative – Pet‑Lovers Support Specialist (Work‑From‑Home) at arenaflex

Remote-first Full-time

Digital Infrastructure - Senior Consultant

Remote-first Full-time

2026 Summer Internship (Golisano Institute Partnership) - Retail Banking, Greece

Remote-first Full-time

Experienced Remote Data Entry Clerk – Entry-Level Position with arenaflex

Remote-first Full-time

Part-Time Remote Data Entry Specialist – Global Airline Operations

Remote-first Full-time

Remote Customer Service Representative – Travel Support & Passenger Experience at arenaflex – $25/hr – Flexible Hours, Home‑Based

Remote-first Full-time

Experienced Weekend Customer Service Representative – Delivering Exceptional Support and Ensuring Customer Satisfaction

Remote-first Full-time