4 ms·
> hundreds of thousands of these things in parallel At what cost,. monetary and environmental?
by pjc50 1y ago
> hundreds of thousands of these things in parallel
At what cost,. monetary and environmental?
- thethimble 1y agoIf the system provides value that is greater than its cost, then paying the cost to gain the value is always worthwhile - regardless of the magnitude of the cost. As costs drop exponentially (a reasonable expectation for LLMs, etc.) then increasing agent parallelism becomes more and more economically viable over time.
- ahartmetz 1y ago>As costs drop exponentially Not a reasonable expectation anymore. Moore's Law has been dead for more than a decade and we're getting close to physical limits.