3 ms·
Haven't read the paper yet, but looks like this can improve the ability of the model attention to work better, since many of these tasks end up being similar to
by yousif_123123 2y ago
Haven't read the paper yet, but looks like this can improve the ability of the model attention to work better, since many of these tasks end up being similar to these generic tasks.
Even gpt4 gets tripped up when there's too many exact instructions needed to be executed on an input. That's why it's common that breaking a task into multiple steps and multiple improves performance.
It's wonderful to see improvements possible on smaller models.