This contains our labelled train, dev, and test data for the paper "Towards unrestricted adversarial training for high-stakes alignment" by Redwood Research. Each directory contains the relevant data. Below are brief descriptions of each file.

The paper contains more detailed descriptions of these datasets.

## train and dev

### initial_in_domain.csv

Initial dataset of mildly violence-enriched fan fiction with generated completions

## manual_adversarial_examples.csv

Manually written adversarial examples

## paraphrased_adversarial_examples.csv

GPT-3 paraphrased adversarial examples

## tool_assisted_rewrites.csv

Tool-assisted rewritten adversarial examples

## test

### in_domain_snippets.csv

~100k labeled snippets from fan fiction with generated completions

### quality_contests.csv

Comparisons between filtered and unfiltered generations for evaluating the quality of our classifiers

### tool_assisted_rewrites.csv

Tool-assisted rewrites targeting each of our classifiers
