4 ms·
This resonates with the current AI skeptic view that language models are a supercharged search engine on the pile of text they're trained on. Also the fact tha
by VHRanger 3y ago
This resonates with the current AI skeptic view that language models are a supercharged search engine on the pile of text they're trained on.
Also the fact that evaluating language models is difficult, and we tend to end up with models that game the evaluation benchmarks.
- wongarsu 3y agoGood information retrieval is a problem we are trying to solve for thousands of years, so even if that's all LLMs are doing then that's still a great achievement. Of course a more explicit approach like this paper is a really good step in that direction by making it easier to trace information provenance. It might still be nontrivial to answer why the model selected this specific piece of information, and why it was composed in this specific way, but it seems trivial to say where the model got the information from. Which is really all we demand from humans too.
- croes 3y agoWas the training data quality checked? If so then LLMs are search engines for catalogs like Yahoo once was and not a good search engine for SEO optimized click farms. Google search once was great too but then ads and SEO killed it.
- actionfromafar 3y agoEh, the free to use commercial LLMs will surely be spiced with commercials eventually.
- bob1029 3y ago> Good information retrieval is a problem we are trying to solve for thousands of years Quantum computers would have something to say about this, assuming they ever materialize.
- hdior 3y ago[dead]