7 ms·
What Does ChatGPT Know About Science?
- JoeAltmaier 4y agoNot a lot of science in that. Basic understanding maybe. I tried asking about Caffeine and it's chemical formula. I got the right atomic description C8H10N4O2 but then it vectored off into nonsense. Maybe a mashup of chemical descriptions for everything it had digested? ChatGPT doesn't 'know' about anything. It 'knows' about what people wrote about things, all mashed up into a statistical wad. So it's about as accurate as the average internet poster, with generous amounts of topic confusion thrown in. It never does anything like logic as far as I know.
- ftxbro 4y agoThroughout their article they repeatedly show how GPT-4.0 is generally much more competent than GPT-3.5 at everything including science and they show it's not yet to the level of a trained human scientist. Their conclusion is "Until true AI comes along, viewing GPT-4 as your partner in IA [intelligence assistance] can be mutually beneficial." I have a hard time understanding what they mean by "true AI" but I assume they mean one who can be respected on equal terms as a human Ph.D. researcher. To me that's a weird terminology. It reminds me of the gaming trope where 'everyone less skilled than me is a noob ("not yet true AI") and everyone more skilled than me has no life (maybe "too dangerous AI").'