3 ms·
So perhaps could be useful for fine-tuning on smaller models?
by cootsnuck 2y ago
So perhaps could be useful for fine-tuning on smaller models?
- max93 2y agoI think so. I believe this type of reasoning method, which achieves better results through longer computation time, is very useful on edge devices like mobile phones. Consider a scenario where we only need the model to output a function/action call on the phone; we don't require it to provide an immediate response.