5 ms·
Any potential for something like this to be added to gpt-4's training data set. Being far from an expert, I assume the figures and any non-text data could pose
by gabcoh 6y ago
Any potential for something like this to be added to gpt-4's training data set. Being far from an expert, I assume the figures and any non-text data could pose a problem, but it also seems like providing it with a huge high-quality source of scientific reasoning could lead to some pretty amazing and revolutionary results. gpt inspiring research directions or even coauthoring. Anyone who knows more about this have any thoughts? Have I just drunk the gpt cool aid or is their some potential for it to revolutionize science quite soon?
- phreeza 6y agoMy money is on the next iteration of gpt being multi-modal (See image-gpt). So this kind of thing would fit right in. I don't think this would lead to the kind of scientific revolution you are thinking of, given the tendency of gpt to confabulate things instead of basing itself on facts. That may be entering cool-aid territory :)
- jessriedel 6y agoI thought the arXiv was already included in GPT-3's training data.
- woah 6y agoCould be interesting, and maybe useful, but the distinctive thing about scientific papers is that they tend to be reports on things that happened in the real world. Might be useful on something self referential like math or philosophy though.