There is some debate about whether in-context learning is real or not, but there are many data points (and articles) showing that it is an emergent pronomena, a

There is some debate about whether in-context learning is real or not, but there are many data points (and articles) showing that it is an emergent pronomena, and it emergence in models of that order of magnitude (gpt-3.5-turbo, gpt-4, and beyond). References found here: https://www.hopsworks.ai/dictionary/in-context-learning-icl https://www.hopsworks.ai/dictionary/in-context-learning-icl