Back to all roles

[Remote] Research Program Manager - Model Evals and Safety

Remote-first Full-time Now hiring

Note: The job is a remote job and is open to candidates in USA. ReflectionAI is on a mission to build open superintelligence and make it accessible to all. They are seeking a Research Program Manager who will lead the development of model evaluations and safety infrastructure, ensuring that their work aligns with the broader safety ecosystem while driving operational excellence in model development.

Responsibilities

  • Build the foundational infrastructure for model evals and safety at Reflection
  • Define the evaluation frameworks, tooling requirements, and operational processes that will underpin how we assess model capabilities, risks, and readiness for release
  • Stand up model safety operations as a function, including establishing the workflows, review cadences, and decision frameworks that connect safety evaluation to the model development and release lifecycle
  • Partner with research and engineering leads across pre-training, mid-training, and post-training to embed safety and evaluation checkpoints into the development process in a way that is rigorous without being a bottleneck
  • Drive the scoping and prioritization of eval science and eval infrastructure investments, working with technical leads to determine what to build in-house, what to adopt, and where to invest research effort
  • Establish Reflection's engagement with the external safety ecosystem, including third-party assessments, academic partnerships, and industry safety frameworks
  • Represent the company's safety posture to external stakeholders with credibility and clarity
  • Create visibility and reporting structures that give leadership a clear, honest picture of model safety status, evaluation coverage, and open risks, so they can make informed decisions at the pace the business requires
  • Champion a culture of blameless post-mortems and continuous learning, turning every safety-relevant finding into a concrete improvement to our systems and processes

Skills

  • 7+ years of experience in technical program management, research operations, or ML engineering, with demonstrated experience standing up new functions, teams, or programs from scratch
  • Familiar with the landscape of model evaluation and AI safety, including evaluation methodologies, red-teaming, alignment research, and the evolving regulatory and industry safety ecosystem
  • Deep enough technically to engage with researchers and engineers on topics like model behavior, evaluation design, data pipelines, and safety-critical system architecture
  • Proven ability to build structures where none exists. You've taken ambiguous mandates and turned them into functioning programs with clear ownership, measurable outcomes, and durable processes
  • Strong stakeholder management skills spanning deeply technical ICs, research leadership, and external partners
  • Excited to build from zero to one. We are a small, fast-moving team and this role will help define how model safety and evaluation works at Reflection
  • Motivated by enabling researchers and engineers to build the world's most capable open-weight AI systems, responsibly

Benefits

  • Comprehensive medical, dental, vision, life, and disability insurance.
  • Fully paid parental leave for all new parents, including adoptive and surrogate journeys.
  • Financial support for family planning.
  • Paid time off when you need it, relocation support, and more perks that optimize your time.
  • Lunch and dinner are provided daily.
  • Regular off-sites and team celebrations.

Company Overview

  • Reflection is an AI lab building frontier open weight models. Our team previously built frontier LLMs at labs like DeepMind, OpenAI, and Anthropic. It was founded in undefined, and is headquartered in New York, NY, US, with a workforce of 51-200 employees. Its website is https://www.reflection.ai/.
  • Apply To This Job

    More remote roles

    [Remote] Account Executive, New Business (Mid-Market)

    Remote-first Full-time

    [Remote] Senior Software Engineer, Streaming

    Remote-first Full-time

    [Remote] Salesforce Senior Consultant

    Remote-first Full-time

    [Remote] Account Executive

    Remote-first Full-time

    [Remote] Product Marketing Manager - Product Growth

    Remote-first Full-time

    [Remote] Sr. Technical Marketing Engineer - Lakebase/Apps

    Remote-first Full-time

    [Remote] Business Analytics Lead - Predictive Modeling

    Remote-first Full-time

    [Remote] Account Executive- Strategic- North Central

    Remote-first Full-time

    [Remote] Operations Manager, Research

    Remote-first Full-time

    [Remote] Product Manager, Partnerships and Marketplaces

    Remote-first Full-time

    Operations and People Lead

    Remote-first Full-time

    Senior Counsel (Complex Trial)

    Remote-first Full-time

    Experienced Customer Service Representative – Remote Opportunities at arenaflex

    Remote-first Full-time

    Senior SEM Specialist (Remote) Masonboro, NC, USA

    Remote-first Full-time

    Compliance Officer (BSA/AML & MTL) | Remote (U.S. Only)

    Remote-first Full-time

    Executive Assistant | Remote Role, Project Coordination & Strategic Admin Support

    Remote-first Full-time

    Marketing Qualification Specialist

    Remote-first Full-time

    Experienced Virtual Chat Support Specialist - Phone-Free Remote Role (Entry Level) at arenaflex

    Remote-first Full-time

    Experienced Customer Service Representative – Operations Payments

    Remote-first Full-time

    Senior/Principal Researcher, Medicaid Policy and Program (Remote Eligible)

    Remote-first Full-time