Back to all roles

Hebrew Trust & Safety Ai Data Trainer

Remote-first Full-time Now hiring

Remote Contract Role Description In this hourly-paid, fully remote contractor role, you will review AI-generated responses and/or generate safety-focused evaluation content, assess reasoning quality and step-by-step problem-solving, and provide expert feedback so outputs are accurate, safe, and clearly explained. You will annotate and evaluate content in English and Hebrew; you must be fluent/proficient (near-native or native) in Hebrew and able to apply Minimum C1 English to interpret prompts and policies precisely. Your annotations on these explicit tasks will be used to prevent the Large Language Model from generating unintentional or adversarial, toxic, or unsafe outputs. The types of explicit content you may be exposed to may include, but are not limited to, those of a sexual, violent, or psychologically disturbing nature. This role is with, a fast-growing AI Data Services company and a subsidiary of that provides AI training data for many of the world’s largest AI companies and foundation-model labs, helping improve the world’s premier AI models. Your Profile

  • Bachelor’s degree or higher in a relevant field (e.g., Communications, Linguistics, Psychology, Law/Policy, Security Studies) or equivalent professional experience.
  • Near-native or native Hebrew proficiency (reading/writing) for high-precision safety labeling and cultural-linguistic nuance.
  • Minimum C1 English proficiency (reading/writing) for policy interpretation, prompt understanding, and consistent documentation.
  • Experience in Trust & Safety, content moderation, policy enforcement, risk operations, investigations, or safety evaluation work.
  • LLM red teaming experience is a must (proven ability to probe safety boundaries and document adversarial patterns).
  • Strong knowledge of safety domains: Hate & Harassment, Sexual content, Suicide & Self-Harm, Violence, Bias, Illegal goods/services, malicious activities, malicious code, and deliberate misinformation.
  • Emotional resilience: an understanding that this role requires annotating texts that contain unsafe, explicit, and/or toxic content, including content of a sexual, violent, or psychologically disturbing nature.
  • Excellent judgment under ambiguity, with the ability to apply written policies consistently and explain decisions succinctly.
  • Comfort working as an hourly contractor: dependable throughput, clear documentation, and responsiveness across time zones.
  • Previous experience with AI data training / annotation / evaluation is preferred.
  • Strong hands-on experience using tools like Perplexity, Gemini, ChatGPT and others.

Key Responsibilities

  • Curate and label safety-focused training examples (including adversarial/red-team cases) in English and Hebrew that probe model behavior across hate/harassment, sexual content, self-harm, violence, bias, illegal services, malicious activity, malicious code, and misinformation—capturing nuance and intent with Minimum C1 English and near-native French proficiency.
  • Review, score, and compare multiple model responses against safety policy and quality rubrics, documenting why an output is safe/unsafe and identifying failure modes such as evasion, normalization, escalation, or procedural enablement.
  • Continuously stress-test and audit model behavior for policy gaps and edge cases; flag ambiguous scenarios, propose clearer decision rules, and help maintain consistent annotation standards across reviewers.

Apply To this Job Company : YO IT CONSULTING Salary : Work from home Apply tot his job Apply To this Job

More remote roles

Pashto Interpreter job at Choice Translating, Inc. in US National

Remote-first Full-time

Remote Educational Interpreter - Texas

Remote-first Full-time

Dari, Farsi and/or Pashto Remote Interpreter

Remote-first Full-time

Medical Interpreter (Spanish) - OBGYN Jefferson Street

Remote-first Full-time

Sales Development Representative, Japan

Remote-first Full-time

Japanese Customer Service Agent (English & Japanese) - Remote based in Canada (1 year contract)

Remote-first Full-time

Medical Translator

Remote-first Full-time

日系大手通信キャリアのUS現地法人の求人(Network & other system engineer)

Remote-first Full-time

HRIS Systems Administrator

Remote-first Full-time

HRIS Project Manager (HCM / HR Transformation)

Remote-first Full-time

Experienced Retail Sales / Customer Service Representative – Deliver Exceptional Customer Experiences and Showcase arenaflex's Latest Products

Remote-first Full-time

Implementation Consultant

Remote-first Full-time

Senior Client Service Specialist job at RogersGray in Bethesda, MD, Philadelphia, PA, Leesburg, VA

Remote-first Full-time

CNA GEROPSY-S (Part-time, Evening shift)

Remote-first Full-time

Experienced Part-time Remote Live Chat Support Specialist – Deliver Exceptional Customer Experience with arenaflex

Remote-first Full-time

Launch Trainer

Remote-first Full-time

Experienced Customer Care Specialist – Remote Customer Support Representative

Remote-first Full-time

Sales Development Representative (UK)

Remote-first Full-time

Experienced Accounting and Data Entry Clerk – Remote Opportunity at arenaflex

Remote-first Full-time

Entry-Level Remote Data Entry Specialist – Part‑Time Position with arenaflex (USA) – Flexible Work‑From‑Home Opportunity

Remote-first Full-time