AI Jobs in India — Remote AI Data Annotation Specialist
About The Role Rex.zone is hiring remote, full-time AI Data Annotation Specialists to support LLM training pipelines through high-quality data labeling, RLHF evaluation, prompt evaluation, and QA evaluation. You will work on multimodal datasets (text and image) and deliver rubric-aligned judgments that improve training data quality and model performance.
What You Will Do
- Execute data labeling and data annotation for NLP and computer vision datasets
- Perform RLHF-style preference comparisons and graded reward-model judgments
- Run prompt evaluation and response grading using detailed rubrics
- Complete QA evaluation audits, guideline compliance checks, and rework cycles
- Apply named entity recognition (NER), taxonomy tagging, and text classification
- Conduct content safety labeling (policy, harm, hate, self-harm, sexual content) with escalation workflows
- Document edge cases and contribute to annotation guidelines updates
- Report throughput, agreement rates, and error categories to improve production quality
What We Are Looking For
- Mid-Senior experience delivering high-precision labeling/evaluation work
- Strong written English and ability to follow complex rubrics
- Familiarity with LLM evaluation, RLHF concepts, and prompt evaluation methods
- Strong QA mindset: sampling, audits, disagreement analysis, and root-cause analysis
- Comfort working remotely with asynchronous communication and versioned guidelines
Compensation $30–$50 per hour (base salary, hourly). Final compensation depends on scope and evaluation complexity. How To Apply Apply via Rex.zone and share relevant labeling, evaluation, and QA experience. Apply tot his job Apply To this Job