4 ms·
Actually I am not very familiar with the internals, I am mostly repeating what Yann Lecun said in an interview a few months ago about autoregressive models. ht
by TaylorAlexander 2y ago
Actually I am not very familiar with the internals, I am mostly repeating what Yann Lecun said in an interview a few months ago about autoregressive models.
https://www.youtube.com/watch?v=1lHFUR-yD6I https://www.youtube.com/watch?v=1lHFUR-yD6I
- croemer 2y agoSo beam search _does_ do some sort of search: https://towardsdatascience.com/temperature-scaling-and-beam-search-text-generation-in-llms-for-the-ml-adjacent-21212cc5dddb https://towardsdatascience.com/temperature-scaling-and-beam-...