3 ms·
Opus 4.8 plus OpenClaw. I feel like the space is moving so fast that the result with this setup says very little about how close we are actually now.
by daavidhauser 14d ago
Opus 4.8 plus OpenClaw. I feel like the space is moving so fast that the result with this setup says very little about how close we are actually now.
- dgellow 14d agoYeah, it’s crazy how fast things have changed in a month. I couldn’t find a more recent replication or similar study but it would be interesting to see it done with the current frontiers. Though I don’t think that would change much about the overall conclusion of the paper
- pinkmuffinere 14d agoI made this same reply to another thread, so I'm sorry to say essentially the same thing twice, but -- the comment has a familiar structure, "it doesn't work for you because you used an [old / suboptimal / non-frontier] model. If you use X you'll see that it works". These sorts of claims push the onus back onto the other person (or in this case tfa), without really accepting the result, or taking on any work for yourself. It gets tiresome to retest with the newest model every other week. Is there any data you can provide to support your claim, or any result you can contribute here?
- peterashford 14d agoIt may be tiresome, but it's true. It doesn't refute the article's premise thou, only retesting with newer models would and that would be the same tiresome requirement you already called out
- 1attice 13d agoYes, that's an annoying predicament, but we come by it honestly. Limits of scientific method in the face of exponential takeoff, IMO, and kind of proves the opposite result (RSI appears to be here)