3 ms·
This document seems to have been written before the toolformer paper[0], which fine tunes the model to use tools (e.g search) to retrieve information. [0]: htt
by johntb86 3y ago
This document seems to have been written before the toolformer paper[0], which fine tunes the model to use tools (e.g search) to retrieve information.
[0]: https://arxiv.org/abs/2302.04761 https://arxiv.org/abs/2302.04761
- simonw 3y agoI think that's something different. Toolformer looks more similar to ChatGPT Plugins (it wouldn't surprise me if ChatGPT Plugins was partly inspired by that paper in fact). It's a way of teaching a model to call tools when it needs to - see also the ReAct pattern. When you're implementing Q&A on top of a LLM that's not necessarily the right approach. You don't need the model to be able to make searches itself - you need a good strategy for searching for the most appropriate content that fits in the prompt, then sending that to the prompt along with the user's question. They're both really useful techniques, but I don't see toolformer as a replacement for retrieval augmented generation.