> 2. The cost to use a given level of AI falls about 10x every 12 months, and lower prices lead to much more use. You can see this in the token cost from GPT-4

> 2. The cost to use a given level of AI falls about 10x every 12 months, and lower prices lead to much more use. You can see this in the token cost from GPT-4 in early 2023 to GPT-4o in mid-2024, where the price per token dropped about 150x in that time period. Moore’s law changed the world at 2x every 18 months; this is unbelievably stronger. This is so exciting. I guess NVIDIA's Project DIGITS [0] will be the starting point for a bit more serious home lab usage of local LLMs, while still being a bit like what Quadro used to be in the pro/prosumer market in the 00s/10s. Now it's all RTX, and while differences still exist between pro gamer cards and workstation cards, most of what workstation GPUs were used back then is easily doable by pro gamer cards nowadays. Let's just hope that the quoted values are also valid for these prosumer devices like Project DIGITS. Also, let's hope that companies start targeting that user base specifically, like a Groq SBC. [0] https://nvidianews.nvidia.com/news/nvidia-puts-grace-blackwell-on-every-desk-and-at-every-ai-developers-fingertips https://nvidianews.nvidia.com/news/nvidia-puts-grace-blackwe...