2 ms·
See REALM[1] for some older(2 years) work on this idea. 1. https://arxiv.org/abs/2002.08909 https://arxiv.org/abs/2002.08909
by kelseyfrog 4y ago
See REALM[1] for some older(2 years) work on this idea.
1. https://arxiv.org/abs/2002.08909 https://arxiv.org/abs/2002.08909
- ricopags 4y agoOr Meta's Atlas[0] for more recent work [0]https://arxiv.org/abs/2208.03299 https://arxiv.org/abs/2208.03299
- sdenton4 4y agoOr RETRO, from deep mind, last year. https://www.deepmind.com/publications/improving-language-models-by-retrieving-from-trillions-of-tokens https://www.deepmind.com/publications/improving-language-mod...