3 ms·

Nice paper, thank you for bringing it up. I think OP meant to compare LLM-driven operations with classical algorithms (they mention web search). It's not clear

• PaulHoule 4y ago
  I think he’s talking about the energy being consumed by GPT systems as well GPT++ systems which combine GPT plus web search not so much as a competitor but as the next step. As an example of the latter, I can answer questions out of my long term memory and GPT-4 does the same. I can answer more questions with more accurate results I’d I search for documents and use the capabilities encoded in my long term memory to evaluate, summarize and otherwise process those documents and no doubt that GPT-4 could be embedded in a system that does this as well and the large attention window would be a big help. (E.g. a few papers a week are submitted to arXiv about this now) One of the most fun things I did in grad school was when, for my A exam, I was asked to write a summary in the literature for giant magnetoresistance which involved looking at 50 or so papers. One would imagine it could take 50x the effort (queries, energy, etc.) for GPT-4 to do this than it would take to speak extemporaneously on the subject. (Funny I’d have a hard time talking about the physics w/o looking it up now but I could definitely talk about applications off the cuff.)