2 ms·
Language models are really good at free association tasks, such as semantic fuzzy search. Next token prediction is among the worst possible ways to use them (al
by wizzwizz4 1y ago
Language models are really good at free association tasks, such as semantic fuzzy search. Next token prediction is among the worst possible ways to use them (although if there's no other obvious way of getting the information out of the model, it works in a pinch).
Which project did you use?
- toomuchtodo 1y agohttps://news.ycombinator.com/item?id=42974851 https://news.ycombinator.com/item?id=42974851 https://github.com/OpenHealthForAll/open-health https://github.com/OpenHealthForAll/open-health
- wizzwizz4 1y agoAw, it's next-token prediction. This is not generally useful, only a "last resort" research tool.