> Notably, humans also underperform Transformers on recall tasks... Thank you. Yes, that's obviously true... but keep in mind that human beings can pull up inf

> Notably, humans also underperform Transformers on recall tasks... Thank you. Yes, that's obviously true... but keep in mind that human beings can pull up information from notes, books, URLs, etc. and store that information in "short-term memory" at any time, as needed, for cognitive tasks. To match or exceed peak human performance, AI models must be able to do that too -- whether it's via a long context window or some other mechanism (e.g., searching on external storage) is a secondary issue. I'd say recall is a prerequisite to match peak human performance.