They are on par on many tasks, surpass us in some tasks, and catching up on the rest quite fast. Both humans and LLMs forget details, both have to go through it

They are on par on many tasks, surpass us in some tasks, and catching up on the rest quite fast. Both humans and LLMs forget details, both have to go through iterative bug fixing when creating something. Longer contexts and memory are coming, they already exist but need improvement. > I have never “hallucinated” a feature You never mistook an argument, or forgot one of the 100 details we have to mind while writing complex apps? I would rather measure humans vs AI not in basic skill capability but in authonomy. I think AI still has much more to catch up on that front.