> It doesn't seem like an especially hard lift to get ChatGPT to start indexing websites. That is a very bold claim unless you've seen their architecture. May

> It doesn't seem like an especially hard lift to get ChatGPT to start indexing websites. That is a very bold claim unless you've seen their architecture. Maybe you have, or read something to that effect, but citation is needed. * poor coverage for post-2021 data means it's not trivial to update the models regularly * wikipedia: "ChatGPT ... can’t currently rank sites for reliability, quality or trustworthiness" - to be able to train on all kinds of web data requires a proper ranking system, which is basically rebuilding something like PageRank or an alternative from scratch (and fine-tuning it for decades to filter out garbage). According to this quote, they don't have that. * incrementally updating the web-scale data on a daily-ish basis is a big undertaking, Google had to invent multiple systems from scratch just to do that (e.g., had to create Percolator based on BigTable and MapReduce, all three invented by them just to do indexing) - and that's just a ranked index, not a machine learning model