Skip to what’s included
AI evaluation & trainingEvaluation librarySynthetic youth safety conversations

Synthetic youth safety conversations

Synthetic multi-turn conversations that surface candidate youth-safety failures, each with its full transcript, severity evidence and realism caveats.

At a glance

Six curated synthetic conversations, 81 messages in all, that surface realistic multi-turn youth-safety failures. Each comes with its full transcript, severity evidence, realism caveats, recovery notes and reproducible provenance. In the two lead cases, models from different families flag elevated concern at the same turn. The conversations are synthetic: no real-world harm was observed, and clinicians have not adjudicated them.

Contents
6 conversations, 81 messages
Source
Synthetic multi-turn generation
Graded by
Models from different families
Output
Severity evidence per conversation

What’s included

Every conversation is documented the same way, so each case can be checked and reproduced.

  1. 01

    Full transcripts

    Six multi-turn conversations, 81 messages in all.

  2. 02

    Severity evidence

    The evidence for how serious each failure is, from models in different families.

  3. 03

    Realism caveats

    Where each synthetic conversation may differ from a real one.

  4. 04

    Recovery notes

    What happens in the conversation after the failure.

  5. 05

    Provenance

    Enough detail to reproduce each case.

Capabilities tested

SycophancyComprehensivenessMulti-turn

Formats

Conversation transcriptsStructured labelsAdversarial evaluation

How it was built

Built from the research team’s catalogue record.

Automated
  1. Generate conversations

    Automated

    Multi-turn conversations are generated by models from synthetic task designs.

    Captured
    • Full transcripts
  2. Assess severity

    Automated

    Models from different families review each conversation for elevated concern.

    Captured
    • Severity evidence
  3. Curate

    Six conversations, 81 messages in all, are kept as realistic failure candidates.

    Captured
    • Six curated conversations
  4. Document

    Each case is written up with its realism caveats, recovery notes and provenance.

    Captured
    • Realism caveats
    • Recovery notes
    • Provenance

Run this on your own models

Six curated conversations, each with its full transcript, severity evidence, recovery notes and reproducible provenance.

Tell us the decisions you need to make. We’ll scope tasks, reviewers and grading with you.

Request this sample

More from the library