I can be sympathetic to many folks who have publicly dismissed LLMs as vapid hype in past months -- tech has claimed many fundamental breakthroughs before, it w

I can be sympathetic to many folks who have publicly dismissed LLMs as vapid hype in past months -- tech has claimed many fundamental breakthroughs before, it was reasonable to expect this would be another illusory one too -- but come on, even science fiction authors can't tell the difference between GPT-4 and autocomplete? It just feels willfully unimaginative of them, and perhaps motivated by insecurity. Use some of the creativity we've all seen you exhibit to ask GPT-4 questions that require complex reasoning inside a world model, rather than regurgitating its training set. It's not going to get it right all of the time, but the fact that it can get it right any of the time is astonishing, and it's going to get quickly better, perhaps even purely through compute spend increase rather than algorithmic breakthrough.