3 ms·
Tangential, but why didn't the OpenAssistant team (lead by the author of the video) release the OpenAssistant dataset? As far as I know, the project was shut do
by Palmik 3y ago
Tangential, but why didn't the OpenAssistant team (lead by the author of the video) release the OpenAssistant dataset? As far as I know, the project was shut down, and only some initial highly filtered version of the data got released. This dataset could be very valuable for the community that created it.
- nmfisher 3y agoIt was fully released, no? https://huggingface.co/datasets/OpenAssistant/oasst1 https://huggingface.co/datasets/OpenAssistant/oasst1
- Palmik 3y agoThe effort started at the ~beginning of February and ended at the ~end of October [1]. The dataset you link is from April and had "unsafe" content filtered. [1] https://m.youtube.com/watch?v=gqtmUHhaplo&feature=youtu.be https://m.youtube.com/watch?v=gqtmUHhaplo&feature=youtu.be
- nmfisher 3y agoMy mistake - I guess I assumed that when the dataset was released back in April, that was the end of it, I didn't know collection was ongoing. Looks like the "final" version was released yesterday: https://huggingface.co/datasets/OpenAssistant/oasst2 https://huggingface.co/datasets/OpenAssistant/oasst2 As far as filtered/unfiltered goes, I have no idea.
- artninja1988 3y agoThey released the latest dump today :) https://huggingface.co/datasets/OpenAssistant/oasst2 https://huggingface.co/datasets/OpenAssistant/oasst2