The dataset is here I presume: https://huggingface.co/datasets/Intel/orca_dpo_pairs https://huggingface.co/datasets/Intel/orca_dpo_pairs you can look at the sa

The dataset is here I presume: https://huggingface.co/datasets/Intel/orca_dpo_pairs https://huggingface.co/datasets/Intel/orca_dpo_pairs you can look at the samples. Mostly its questions and accepted/rejected answers.