3 ms·
Can't we just finetune the model based on the LLM's output? Has anyone tried it?
by amelius 2y ago
Can't we just finetune the model based on the LLM's output? Has anyone tried it?
- soulofmischief 2y agoNot only does a training pass take more time and memory than an inference pass, but if you remember the Microsoft Tay incident, it should be self-explainatory why this is a bad idea without a new architecture.