3 ms·
Perhaps but TinyStories was one of the first papers to show that we don't need a lot of parameters to build a coherent generative model.
by dmezzetti 3y ago
Perhaps but TinyStories was one of the first papers to show that we don't need a lot of parameters to build a coherent generative model.
- mistrial9 3y agofwiw this link looks interesting, everyone https://github.com/neuml/txtai https://github.com/neuml/txtai
- p1esk 3y agoWhat is “coherent”?
- dmezzetti 3y agoGenerates plausible continuations of text.
- p1esk 3y agoBoth gpt-2 and gpt-4 do that.
- SgtBastard 3y ago> we don't need a lot of parameters to build a coherent generative model. GPT-4 is likely to be a trillion+ parameters over its MoR models.