3 ms·
Not anymore. There's arguably more than enough data to form a base for strong LLMs; extra data is nice, but doesn't have to come in such quantity. (In fact, th
by TeMPOraL 2y ago
Not anymore. There's arguably more than enough data to form a base for strong LLMs; extra data is nice, but doesn't have to come in such quantity.
(In fact, there's value in trying to filter excess crap out of existing training sets.)
- jsheard 2y agoWe're talking about LLM-driven search engines here, the assumption is that they will always need up-to-date information. A "strong LLM" can't give you to latest on the presidential election if its knowledge cut-off is in 2023, so these companies "solution" is to scrape today's New York Times and get the LLM to write a summary.
- theappsecguy 2y agoUh, sorry what? What happens when you need to search something new? Just hallucinations all the way down?
- whiplash451 2y agoYou still need fresh data for many use cases.
- HDThoreaun 2y agoLLMs arent embodied. They can not break news as they have no ability to gather fresh news