4 ms·
You can already use an LLM to train a smaller, more efficient LLM without significant loss in results.
by JimDabell 4y ago
You can already use an LLM to train a smaller, more efficient LLM without significant loss in results.
- canoebuilder 4y agoDo you mean the output of a LLM as the training data for the new model? What is the specification for the prompts that generate the training data? Any links with more info?
- luxcem 4y agoThere were just an article submitted few days ago about Alpaca, a LLM trained on GPT prompts: https://news.ycombinator.com/item?id=35136624 https://news.ycombinator.com/item?id=35136624
- canoebuilder 4y agoThanks!