5 ms·
Most software dev is repetitive as hell, monkey see monkey do within a computer readable language that has well defined syntax. LLMs can do fairly well in this
by semi-extrinsic 3y ago
Most software dev is repetitive as hell, monkey see monkey do within a computer readable language that has well defined syntax. LLMs can do fairly well in this niche.
Research is by definition not repetitive, the text is free form and the data is never formatted in a way that makes comparison between different papers straight forward.
- agronomicon 3y agoThat's exactly the type of data set that can be analyzed by large neural networks. Heterogeneous data with hidden and non-obvious statistical correlations which would be hard to uncover with classical statistical tools and techniques.
- throwbadubadu 3y agoNot at all convinced that this is true, the contrary. Do you have a reference, or something similar that did this successful in another field? (No, that's not ChatGPT and writing some limited software).
- galactician 3y agoFacebook's Galactica.
- gamblor956 3y agoWhich failed miserably at this task... https://www.technologyreview.com/2022/11/18/1063487/meta-large-language-model-ai-only-survived-three-days-gpt-3-science/ https://www.technologyreview.com/2022/11/18/1063487/meta-lar... "A fundamental problem with Galactica is that it is not able to distinguish truth from falsehood, a basic requirement for a language model designed to generate scientific text. People found that it made up fake papers (sometimes attributing them to real authors), and generated wiki articles about the history of bears in space "