7 ms·
LLMs can do weather prediction? There is no way that is true. Considering ChatGPT sometimes insists 2+2=5, I sincerely doubt it is solving PDEs used to model we
by camdenreslink 2y ago
LLMs can do weather prediction? There is no way that is true. Considering ChatGPT sometimes insists 2+2=5, I sincerely doubt it is solving PDEs used to model weather systems.
- famouswaffles 2y agoTransformers can do weather prediction yes. https://arxiv.org/abs/2312.03876 https://arxiv.org/abs/2312.03876
- camdenreslink 2y agoThis thread is about large language models and generative AI. AFAIK LLMs perform pretty badly at time series prediction. Maybe some specially trained weather prediction neural network could perform well, but that isn’t really what we’re talking about here.
- famouswaffles 2y agoA Large Language Model is just a text predicting Transformer (and sometimes image and/or audio predicting if they're multimodal). Transformers are general sequence to sequence predictors. The only difference between this and GPT is the data it's been trained on. They're the same kind of neural network.
- lblume 2y agoThink base models. LLMs are extremely good at predicting the future when applied to human languages, as this is literally their only optimization goal. Why couldn't they also be good at predicting the future when applied to other complex forecasting tasks? Of course what can be mathematically calculated without inference is going to be. LLMs may however be able to interpret the results of these calculations better than humans or current stochastical evaluations.