4 ms·
Databricks had their employees write up 15,000 of them. https://www.databricks.com/blog/2023/04/12/dolly-first-open-commercially-viable-instruction-tuned-llm ht
by sp332 3y ago
Databricks had their employees write up 15,000 of them. https://www.databricks.com/blog/2023/04/12/dolly-first-open-commercially-viable-instruction-tuned-llm https://www.databricks.com/blog/2023/04/12/dolly-first-open-...
- code_runner 3y agoI’ve worked at plenty of places where we did a ton of labeling by hand. People concerned with data quality from LLMs should really see the inconsistencies we came up with!
- icyfox 3y agoFavorite part of this piece: > We were initially skeptical whether we would get to 10,000 results. But with nightly leaderboard gamification, we managed to break 15,000 results within a week. Out of fear of eating into our productivity, we closed the contest. I've hosted a few of these corporate data labeling events. If sufficiently gamified / there's a good enough UX, they can be surprisingly engaging. It helps a lot if you have a large employee base though. Distributing results over 5000 employees is exponentially easier than even 50 - in practicality, even larger than the orders of magnitude.
- ThrowawayTestr 3y agoAnybody have this downloaded and can paste a few examples?
- sp332 3y agoYou can browse them here: https://huggingface.co/datasets/databricks/databricks-dolly-15k https://huggingface.co/datasets/databricks/databricks-dolly-...