SUDOER (System/User Dataset for Obedience Evaluation in Responses)
Introduced by Sanchez et al. in Stay on topic with Classifier-Free Guidance
The dataset aims to provide system prompts and user prompts for assistant. You should make random pairs and compute human preference for both system prompt obedience and user prompt relevance through A/B testing.
Papers
| Paper | Code | Results | Date | Stars |
|---|
Dataset Loaders
No data loaders found. You can
submit your data loader here.
No data loaders found. You can
submit your data loader here.
