4 ms·
Separately, you have to consider that "wasting tokens spinning" might be acceptable if you're able to run hundreds of thousands of these things in parallel. If
by thethimble 1y ago
Separately, you have to consider that "wasting tokens spinning" might be acceptable if you're able to run hundreds of thousands of these things in parallel. If even a small subset of them translate to value, then you're far net ahead vs with a strictly manual/human process.
- pjc50 1y ago> hundreds of thousands of these things in parallel At what cost,. monetary and environmental?
- thethimble 1y agoIf the system provides value that is greater than its cost, then paying the cost to gain the value is always worthwhile - regardless of the magnitude of the cost. As costs drop exponentially (a reasonable expectation for LLMs, etc.) then increasing agent parallelism becomes more and more economically viable over time.
- ahartmetz 1y ago>As costs drop exponentially Not a reasonable expectation anymore. Moore's Law has been dead for more than a decade and we're getting close to physical limits.