There was a really good point in this podcast episode about the speed of LLMs. They are so slow that all of the progress messages and token streaming are necess

There was a really good point in this podcast episode about the speed of LLMs. They are so slow that all of the progress messages and token streaming are necessary. But the core problem is that the technology is so darn slow. https://podcasts.apple.com/us/podcast/this-episode-is-a-cognitohazard-with-efron-licht/id1737204926?i=1000762187227 https://podcasts.apple.com/us/podcast/this-episode-is-a-cogn... As someone who both uses and builds this technology I think this is a core UX issue we’re going to be improving for a while. At times it really feels like a choose 2+ of: slow, bad, and expensive.