2 ms·
Ok, but a random educated person will not perform well on vast majority of specialized tasks where professionals operate. A model like Astra probably will beat
by p1esk 29d ago
Ok, but a random educated person will not perform well on vast majority of specialized tasks where professionals operate. A model like Astra probably will beat random educated person performance on majority of specialized tasks. It’s getting close to the level of professionals in many domains, and to genius level on some (e.g. math).
I’m just trying to understand the implications of the current frontier model capabilities.
- drdeca 28d agoCurrent models can do a variety of tasks that requires substantial expertise for people to do, yes. But there are also many cognitive tasks that the typical educated person would do better at than these models. Like, e.g. long-term managing what a vending machine gets stocked with and what prices the items should be sold for. Or, various things like that. When there are essentially no more tasks like that, then we’ve reached AGI.
- p1esk 28d agoInteresting, you think a random educated person would beat Astra on Vending-Bench 2? Honestly I would not make that bet, I think it would be 50/50.