Chamath was talking about this near the end of the All In Podcast released yesterday. He was talking about development and energy cost vs. revenue and even more

Chamath was talking about this near the end of the All In Podcast released yesterday. He was talking about development and energy cost vs. revenue and even more importantly profit. My gut feeling is that small large language models and ever decreasing model size and computational resource use on edge devices will lead to great outcomes in a few years, but that is only my hunch. Right now, I get the most use out of pipelined systems like Perplexity that use an LLM to understand what you want and produce search terms, do the search and set up a temporary RAG type system with search results, identify the most useful retrieved text, and then feed this into another LLM that formats and presents a report that contains links back to source material. I find this very useful, and incidentally makes the Internet “fun” again. Also right now, my favorite play activity is writing a lot of code (Python, Racket, Common Lisp) to do small tasks using APIs fronting LLMs (mostly running locally with Ollama).