3 ms·One of the main models here is LLama so it’s limited to 2K tokens. Not sure about the Pythia one.by bugglebeetle 4y agoOne of the main models here is LLama so it’s limited to 2K tokens. Not sure about the Pythia one.