3 ms·
Here's a link to open up and explore that training data in Datasette Lite: https://lite.datasette.io/?json=https://github.com/databrickslabs/dolly/blob/master/d
by simonw 4y ago
Here's a link to open up and explore that training data in Datasette Lite: https://lite.datasette.io/?json=https://github.com/databrickslabs/dolly/blob/master/data/databricks-dolly-15k.jsonl#/data/databricks-dolly-15k?_facet=category https://lite.datasette.io/?json=https://github.com/databrick...
- jarek83 4y agoCan someone help me to understand why categories for these two differ? row #51 "Think of some family rules to promote a healthy family relationship" - brainstorsming [1] row #68 "What is the future for human?" - general_qa [2] In nature they both are brainstorming to me - does the question mark is what assigned the #68 as _qa? [1] https://lite.datasette.io/?json=https://github.com/databrickslabs/dolly/blob/master/data/databricks-dolly-15k.jsonl#/data/databricks-dolly-15k/51 https://lite.datasette.io/?json=https://github.com/databrick... [2] https://lite.datasette.io/?json=https://github.com/databrickslabs/dolly/blob/master/data/databricks-dolly-15k.jsonl#/data/databricks-dolly-15k/68 https://lite.datasette.io/?json=https://github.com/databrick...
- gpm 4y agoThe labelling doesn't seem to be entirely consistent to me, but I think the idea is that 51 is inviting you to brainstorm, while 68 is asking a question that just happens to be open ended.
- ankitmathur 4y agoHey! Worked on this here at Databricks: the blog post goes into the dataset collection design a bit (https://www.databricks.com/blog/2023/04/12/dolly-first-open-commercially-viable-instruction-tuned-llm https://www.databricks.com/blog/2023/04/12/dolly-first-open-...). In summary, you're right - brainstorming and GeneralQA will have overlap because the taxonomy naturally has some overlap
- rnosov 4y agoI'm going through the dataset with your datasette tool and it looks like it might be a good idea to clean things up a bit. There are many duplicates[1], creepypastas[2] and other strange things in there. [1] https://lite.datasette.io/?json=https%3A%2F%2Fraw.githubusercontent.com%2Fdatabrickslabs%2Fdolly%2Fmaster%2Fdata%2Fdatabricks-dolly-15k.jsonl#/data?sql=select+count%28instruction%29%2C+instruction%2C+group_concat%28context%2C+%27%0A%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%0A%27%29+as+c%2C+group_concat%28response%2C+%27%0A%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%0A%27%29+as+r%2C+group_concat%28category%2C+%27%0A%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%3D%0A%27%29+as+cat++from+%5Bdatabricks-dolly-15k%5D+group+by+instruction+having+count%28instruction%29%3E1+order+by+count%28instruction%29desc+limit+500 https://lite.datasette.io/?json=https%3A%2F%2Fraw.githubuser... [2] https://lite.datasette.io/?json=https://github.com/databrickslabs/dolly/blob/master/data/databricks-dolly-15k.jsonl#/data/databricks-dolly-15k?_filter_column=instruction&_filter_op=like&_filter_value=%25Imagine+you+are+the+last+person+on+Earth%25&_sort=rowid&_facet=category https://lite.datasette.io/?json=https://github.com/databrick... EDIT: Maybe I'm passing link wrong, the query I'm using is select count(instruction), instruction, group_concat(context, ' ============= ') as c, group_concat(response, ' ============= ') as r, group_concat(category, ' ============= ') as cat from [databricks-dolly-15k] group by instruction having count(instruction)>1 order by count(instruction)desc limit 100 [databricks-dolly-15k] should be the name of dataset, first column is the number of instruction duplicates Creepypastas are responses to instruction: Imagine you are the last person on Earth. Write a diary entry describing your thoughts and feelings.
- robterrell 4y agoTypo on row 7!
- rnosov 4y agorow 7 is the name of the dataset, you might need to load it yourself