2 ms·
They used to be quite bad at common-sense-reasoning type tasks like HellaSwag: https://arxiv.org/pdf/1905.07830.pdf https://arxiv.org/pdf/1905.07830.pdf but it
by recursivecaveat 3y ago
They used to be quite bad at common-sense-reasoning type tasks like HellaSwag: https://arxiv.org/pdf/1905.07830.pdf https://arxiv.org/pdf/1905.07830.pdf but it seems like they're creeping up into the high-80s for % of responses correct now.