I think the intuition is that we made a lot of progress and there are still a bunch of low hanging fruits to grab. Once we have very large context window (>1M t

I think the intuition is that we made a lot of progress and there are still a bunch of low hanging fruits to grab. Once we have very large context window (>1M tokens) and multimodal training we will unleash unprecedented gains.