4 ms·

> We have at minimum gained a huge body of knowledge on "how to talk like people" that will stay there forever for researchers to use. This is spot on. I think

> We have at minimum gained a huge body of knowledge on "how to talk like people" that will stay there forever for researchers to use. This is spot on. I think we'll be able to capitalize on other talents of "AI" once we recognize the big shift is done happening. It's like five years after the Louisiana Purchase: we have a bunch of new resources but we've barely catalogued them, let alone begun to exploit them. > how long until all the LLM corporate initiatives die? Sooner than I personally thought, and I place a lot of that with Apple's. They've led the way in hardware that supports LLMs, and I believe (hope?) they'll eventually wipe out most hosted chat-based products, leaving the corporate players to build APIs and embedded products for search, tech support, images, etc. The massive amounts of capital going into OpenAI, Anthropic, etc., will ebb as consumer demand falls. I hope for this because the question I keep asking is, how can our energy infrastructure sustain the huge demand AI companies have without pushing us even further into a climate catastrophe?

chasd00 1y ago
> This is spot on. I think we'll be able to capitalize on other talents of "AI" once we recognize the big shift is done happening. It's like five years after the Louisiana Purchase: we have a bunch of new resources but we've barely catalogued them, let alone begun to exploit them. one thing about LLMs used as a replacement for search is they have to be continually retrained or else they become stale. Lets say a hard recession hits and all the AI companies go out of business but we're left with all these models on huggingface that can still be used. Then, a new programming language hits the scene and it's a massive hit, how will LLMs be able to autocomplete and add dependencies for a language they've never seen before? Maybe an analogy could be asking an LLM to translate a written language you make up on the spot to English/other language.

chasd00 1y ago

> This is spot on. I think we'll be able to capitalize on other talents of "AI" once we recognize the big shift is done happening. It's like five years after the Louisiana Purchase: we have a bunch of new resources but we've barely catalogued them, let alone begun to exploit them. one thing about LLMs used as a replacement for search is they have to be continually retrained or else they become stale. Lets say a hard recession hits and all the AI companies go out of business but we're left with all these models on huggingface that can still be used. Then, a new programming language hits the scene and it's a massive hit, how will LLMs be able to autocomplete and add dependencies for a language they've never seen before? Maybe an analogy could be asking an LLM to translate a written language you make up on the spot to English/other language.