4 ms·
If an llm is trained on knowledge up until say September 2023, could you use a corpus of interesting/insightful scientific discoveries and new methods developed
by internet_points 2y ago
If an llm is trained on knowledge up until say September 2023, could you use a corpus of interesting/insightful scientific discoveries and new methods developed after that date to evaluate/tune it? (Though I fear it would be a small corpus.)
- kingkongjaffa 2y agoGet a research paper, look at the references. Give an llm all of the references but not the current paper. See if it can conclude something like the current paper? Or at least design the same experiment as detailed in the paper?
- pishpash 2y agoThe fact that the references are what they are, out of all possible sets of references, is a significant part of the research. It's not about reading, it's about aiming in a direction without knowing where it ends up.
- Yizahi 2y agoOne of the problems would be acquiring said corpus. NN corporations got away with scraping all human made content for free (arguably stealing it all), but no one can really prove that their specific content was taken without asking, so no lawsuits. NYT tried but that was workaround and I don't know the status of that case. But if NN corpo will come out with explicitly saying that "here, we are using a Nature journal dump from 2024" then Nature journal will come to them and say "oh, really?".