2 ms·
LLMs are trained on far too many reddit posts and top 12 kangs of ancient history type blogs to even contend with wikipedia for anything beyond surface level. T
by p3rls 2y ago
LLMs are trained on far too many reddit posts and top 12 kangs of ancient history type blogs to even contend with wikipedia for anything beyond surface level. Thucydidean-level insights? Forget it.
- astrange 2y ago"Training on" a website doesn't mean the output will agree with the website. (eg: imagine pretraining where some of the documents are prepended with a "this is a bad example" token.)
- p3rls 2y agoI just mean the format and topics. When I use o1, it's great for things like calculating square mile comparisons based on your uploaded map of tribes or translating script like the OP's example, but as far as history itself goes, like drawing inferences and making sense of primary sources-- not so much. Ask a question about anything in-depth and it feels like you're interacting with Buzzfeed and not Gibbon.