4 ms·
> SWE-Lancer, built on more than 1,400 software engineering tasks from the freelancer site Upwork What's not mentioned here (I think) is that tasks in this ben
by scotty79 2y ago
> SWE-Lancer, built on more than 1,400 software engineering tasks from the freelancer site Upwork
What's not mentioned here (I think) is that tasks in this benchmark are priced and they sum up to million dollars.
And current AIs were able to earn nearly half of that.
So while technically they can't solve most problems (yet) they are already perfectly capable of taking about 40% of the food off your plate.