3 ms·
I'm curious about it too. I think there are two bottlenecks, one is that training a relatively large LLM can be resource-intensive (so people go for RAGs and ot
by pu_pe 1y ago
I'm curious about it too. I think there are two bottlenecks, one is that training a relatively large LLM can be resource-intensive (so people go for RAGs and other shortcuts), and making it finetuned to your use cases might make it dumber overall.
- koakuma-chan 1y ago> making it finetuned to your use cases might make it dumber overall. LoRa doesn't overwrite weights.
- pu_pe 1y agoDo you need to overwrite weights to produce the effect I mentioned above?
- koakuma-chan 1y agoGood point