I'm definitely not on the side that AI models can outright replace humans for a large variety of economic tasks. However, one issue I have with the approach of

I'm definitely not on the side that AI models can outright replace humans for a large variety of economic tasks. However, one issue I have with the approach of this study is that instead of using agents integrated with various tools, they just used direct computer use agents, where all the agent gets is some file manipulation tools and then the ability to use the mouse and keyboard, and take screenshots of the screen. As a result, they're not really testing agents in the kind of harnesses they would actually be deployed in to perform these jobs, nor in, like, the harnesses they're really mostly RL'd to be most effective in. So it feels more like they're just testing the competence of computer use RL, not the competence in various economic sectors of the models themselves. For instance, I'm not at all surprised that models would struggle to use just the mouse, the keyboard, and taking screenshots to produce a viable 3D model. But then, on the other hand, we have stuff like this: https://www.trylad.com/ https://www.trylad.com/