> context length doesn't unlock intelligence, just more information This isn't correct (for most definitions of "unlock intelligence"). In-Context Learning (IC

> context length doesn't unlock intelligence, just more information This isn't correct (for most definitions of "unlock intelligence"). In-Context Learning (ICL) can do everything off-line training can do. > We find that both Reinforced and Unsupervised ICL can be quite effective in the many-shot regime, particularly on complex reasoning tasks. Finally, we demonstrate that, unlike few-shot learning, many-shot learning is effective at overriding pretraining biases and can learn high-dimensional functions with numerical inputs. https://arxiv.org/abs/2404.11018 https://arxiv.org/abs/2404.11018