3 ms·

This is the same pitch that people make about AI today. Speed isn’t the differentiator, quality is

Certhas 2mo ago
So for every work produced by AI have ten separate agents review it thoroughly.
sroerick 2mo ago
They are both the differentiator. AI previously provided speed but not quality. As soon as quality reached an acceptable threshold, the speed became the reigning factor. In my opinion the quality is still much lower, but speed means the cost is significantly lower also.
- TeMPOraL 2mo ago
  AI is already fast enough that human is a bottleneck. Hell, typing speed became a bottleneck like it was never before. I mean, if an agent can do half-decent work in less time than it takes the user to prompt them (and "user" in this context is a fast touch-typist like most programmers are), it's obvious it's not the agent that's the bottleneck anymore.
  - tripzilch 2mo ago
    Because finishing someone else's (or something else's) "half decent work" to the point of "actually decent" becomes the bottleneck. This has always been the case for human project management, and LLMs just aren't at that level yet. It's more like everyone is speed running to how fast they can convince others that "half decent" is good enough. And for sure, newer models of LLM seem to be getting better at that.
    - TeMPOraL 2mo ago
      > It's more like everyone is speed running to how fast they can convince others that "half decent" is good enough. But that's what Agile is all about, isn't it? We've been speedrunning delivering increasingly smelly shit at increased velocity ever since SaaS became a thing, because ubiquitous Internet access is what allowed our industry to adopt the "lob feces over the fence for users to deal with" release model. AI does speed that up, true (though since the market - and management - didn't catch up with it yet, we have a brief moment where we can use AI to increase quality while keeping usual delivery rate.)
tiborsaas 2mo ago
Speed will be one of the killer features once you get closer to instant speeds of 300ms. Just remember what changes were made possible simply by upgrading from ADSL to broadband. If inference speed goes up, I can launch the same query 5 times, evaluate the best result and proceed from there. Of course, evaluation is also instant, so in seconds I can get a near perfect solution. Or maybe 10 and I can pick what I like the best.

So for every work produced by AI have ten separate agents review it thoroughly.

They are both the differentiator. AI previously provided speed but not quality. As soon as quality reached an acceptable threshold, the speed became the reigning factor. In my opinion the quality is still much lower, but speed means the cost is significantly lower also.

TeMPOraL 2mo ago
AI is already fast enough that human is a bottleneck. Hell, typing speed became a bottleneck like it was never before. I mean, if an agent can do half-decent work in less time than it takes the user to prompt them (and "user" in this context is a fast touch-typist like most programmers are), it's obvious it's not the agent that's the bottleneck anymore.
- tripzilch 2mo ago
  Because finishing someone else's (or something else's) "half decent work" to the point of "actually decent" becomes the bottleneck. This has always been the case for human project management, and LLMs just aren't at that level yet. It's more like everyone is speed running to how fast they can convince others that "half decent" is good enough. And for sure, newer models of LLM seem to be getting better at that.
  - TeMPOraL 2mo ago
    > It's more like everyone is speed running to how fast they can convince others that "half decent" is good enough. But that's what Agile is all about, isn't it? We've been speedrunning delivering increasingly smelly shit at increased velocity ever since SaaS became a thing, because ubiquitous Internet access is what allowed our industry to adopt the "lob feces over the fence for users to deal with" release model. AI does speed that up, true (though since the market - and management - didn't catch up with it yet, we have a brief moment where we can use AI to increase quality while keeping usual delivery rate.)

tiborsaas 2mo ago

Speed will be one of the killer features once you get closer to instant speeds of 300ms. Just remember what changes were made possible simply by upgrading from ADSL to broadband. If inference speed goes up, I can launch the same query 5 times, evaluate the best result and proceed from there. Of course, evaluation is also instant, so in seconds I can get a near perfect solution. Or maybe 10 and I can pick what I like the best.