3 ms·Not literally infinite, but Llama2 scale models can handle about 10 trillion tokens.by gdiamos 3y agoNot literally infinite, but Llama2 scale models can handle about 10 trillion tokens.