3 ms·
I was going to interject that very sentiment. The upfront costs of running any model of value to the average consumer is so large to be basically non-existent.
by dabbz 2mo ago
I was going to interject that very sentiment. The upfront costs of running any model of value to the average consumer is so large to be basically non-existent. We need hardware to become commoditized and capable of handling LLMs at the scale necessary to enjoy these agentic workflows.
- dTal 2mo agoMmm, software too though. Even those with capable hardware (Macbook Pro for instance) are usually incapable of getting over the hump of assembling an inference framework, agentic harness etc. If that ever becomes easy, watch out! Governments will not appreciate the user/developer dichotomy being blown away.