Zuckerburg said even the smallest model isn't fully converged and continues to improve with more data. Larger model takes much larger amount of data to converge

Zuckerburg said even the smallest model isn't fully converged and continues to improve with more data. Larger model takes much larger amount of data to converge. And as llama is trained on 15T tokens, we have lot more tokens remaining on the internet. And different modalities like video will have orders of magnitude more token and more information.