Mirrai Careers
Resume BuilderCareer Test
InsightsPricing
Get Started Free
Jobs/AI Translation Evaluator; Russian-English

AI Translation Evaluator; Russian-English

appen

Any Remote$42k / year Posted 2w ago
Apply on company site
Join the Appen team as an Independent Contractor for Project Centric. Project Centric is seeking individuals for an ongoing, ad-hoc project focused on improving AI-powered translation. In this project, participants will evaluate context-dependent translations produced by an AI chatbot, where each item includes a conversation history, a translation request with additional context (such as dialect preferences, selective non-translation rules, tone/register requirements, or domain-specific terminology), and the chatbot's response. You will apply MQM error annotations, verify auto-generated rubric items for relevance, and evaluate each applicable rubric item as Pass or Fail based on whether the translation meets the user's stated requirements. Help improve AI translation systems by evaluating Russian-English translations for accuracy, quality, and adherence to user-specified requirements. Key Responsibilities: - Review conversation history and translation requests with additional contextual instructions - Apply MQM error annotations with appropriate categories and severity levels - Verify auto-generated rubric items for relevance, marking spurious items as needed - Evaluate each rubric item as Pass or Fail based on the user's stated requirements - Provide accurate and consistent ratings based on project guidelines - Complete assigned tasks within the given timelines Key Requirements: - Must be a native Russian speaker with a strong command of English, including grammar, vocabulary, and translation conventions - Must be a language specialist, professional translator, or hold a Master's Degree in a language-related field - Keen attention to detail - Access to a stable internet connection and a computer This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role. If you have a passion for language and translation, this is a great opportunity to help shape AI systems that produce accurate, context-aware multilingual translations. Slots are limited — apply through CrowdGen and start evaluating! #crowdgen

See how well you match this job

Upload your resume and we’ll score your fit for this role and 6 similar roles — then tailor your CV to it with AI. Free, no credit card.

Check your match

Similar jobs

  • Translation Evaluator – Korean/English

    appen

    Remote$5k–$52k
  • Text-to-Speech Voice Rater; French (Canada)

    appen

    Remote
  • AI Data Expert - Spanish (US) - Remote

    lilt-production

    Remote
  • Subeject Matter Expert - Russian - Medical Devices

    lilt-production

    Remote
  • Language Fluency Instructors - Freelance AI Trainer Project

    agency

    United States of America
  • German Audio Evaluations Specialist - Freelance AI Trainer Project

    agency

    Remote
Apply on company site

Want more roles like this? Browse fresh jobs or tailor your resume with AI.

Mirrai Careers

AI-powered career platform: build resumes, match jobs, and plan your career.

Product

  • All Tools
  • Resume Builder
  • Career Test
  • Pricing

Legal

  • Privacy Policy
  • Terms of Service
  • Fair Use Policy

Company

MIRRAI CHAT LTD (Company No. 16403306)

71-75 Shelton Street, Covent Garden

London, WC2H 9JQ, UNITED KINGDOM

[email protected]

© 2026 Mirrai Careers. All rights reserved.