Back to all roles

AI Evaluator - Library and Information Science

Remote-first Full-time Now hiring

Straive is a global leader in enterprise-grade data analytics and AI solutions, committed to empowering businesses across various industries with cutting-edge technology and expert insights. Backed by EQT, a top private equity firm, we are uniquely positioned to drive innovation through significant investments and an entrepreneurial spirit. Our core focus is on delivering advanced Data Analytics & AI Solutions. By combining sophisticated technology with subject matter expertise, we deliver material impact on our clients' topline and streamline their operations. We specialize in providing tailored solutions across financial services, CPG, legal, pharma, life sciences, retail and logistics, helping them build robust data analytics and AI capabilities. With a client base spanning 30 countries, Straive's strategically located teams operate from eight countries and is headquartered in Singapore. This global presence enables us to offer localized expertise with a worldwide perspective. Join Straive to be part of a dynamic team at the forefront of data analytics and AI innovation. Here, you'll have the opportunity to contribute to transformative projects, supported by significant investments and an entrepreneurial drive fueled by our partnership with EQT. Website: https://www.straive.com/ Job Title: AI Evaluator - Library and Information Science Type: FTE Location: Remote Roles and responsibilities (I) Key Responsibilities: Review and Validate AI Responses: a) Evaluators will work via Straive, or client-provided online platform. b) All decisions of the Evaluators must be applied in line with the project-specific criteria and guidelines. c) The goal is to assess the quality, safety, and utility of AI-generated content for different use cases like assessing literature summarization done by AI, AI responses to queries raised by users of various databases in subjects like Biological sciences, Social sciences, Chemistry, Engineering or Clinical medicine. d) Each AI generated response should be rated across specific criteria that will be provided (Eg. Accuracy, Factuality, Comprehensiveness etc) e) Wherever applicable a justification or commentary must be written on the rationale behind a particular rating. f) Justification/commentaries must be error-free, concise and consistent with the established knowledge in the corresponding subject area. g) Rewriting the commentary and revisiting the evaluation based on quality checks or client feedback is also within scope (II) SMEs must stay well versed in their area of expertise; ensure that their validation and feedback are informed by the most current and accurate information in their domain. (III) Maintain Confidentiality: Adhere to strict confidentiality of the data received for processing and comply with data protection protocols and other relevant contract commitments and laws This job description is not intended to cover or contain a comprehensive listing of all responsibilities, duties, or activities that are required. Responsibilities, duties, and/or activities may change, or new ones may be added at any time with or without notice. If you are a motivated professional with a passion for delivering impactful solutions, we’d love to hear from you. Apply today to be part of a dynamic and forward-thinking team at Straive. “Straive is an Equal Opportunity Employer. Our policy is clear: there shall be no discrimination based on age, disability, sex, race, religion or belief, gender reassignment, marriage/civil partnership, pregnancy/maternity, or sexual orientation. We are an inclusive organization and actively promote equality of opportunity for all with the right mix of talent, skills and potential. We welcome all applications from a wide range of candidates. Selection for roles will be based on individual merit alone.” Apply tot his job Apply To this Job

More remote roles

PRODUCT OWNER, CARD PROGRAMS

Remote-first Full-time

Product Owner/Manager - Homebuilding Industry

Remote-first Full-time

Sr Business Product Owner-UM Intake Automation

Remote-first Full-time

Product Owner / Product Manager

Remote-first Full-time

Associate Digital and Technology Product Owner (Hybrid)

Remote-first Full-time

Remote Client Services – Vacation Coordinator

Remote-first Full-time

Senior Project Manager - High Voltage Substation

Remote-first Full-time

Client Support Specialist - San Antonio, TX Area (REMOTE)

Remote-first Full-time

Experienced Customer Service Coordinator – Remote Customer Support Team at arenaflex

Remote-first Full-time

French-Speaking Customer Support Specialist

Remote-first Full-time

Experienced Customer Adoption Specialist (f/m/d) for AI - arenaflex Business AI Unit

Remote-first Full-time

Experienced Customer Service Agent – eCommerce and Amazon Expertise

Remote-first Full-time

Remote Data Entry Specialist – High‑Volume Accurate Input – $25/hr – Join arenaflex’s Virtual Team

Remote-first Full-time

Experienced Online Chat Agent – Remote Opportunity for Global Citizens

Remote-first Full-time

Experienced Full Stack Customer Support Specialist – Remote Jobs at arenaflex

Remote-first Full-time

Field Sales Representative

Remote-first Full-time

Program Manager, Microsoft Strategic Partnership (Remote, United States)

Remote-first Full-time

Senior Software Engineer, Windows/Desktop Applications - State College, PA, USA

Remote-first Full-time

Sr. Software Engineer (Python + PySpark + Java)

Remote-first Full-time

Software Engineer - AI Productivity

Remote-first Full-time