2 ms·
Any idea what the context length is? Can't see it from the page linked.
by exe34 3y ago
Any idea what the context length is? Can't see it from the page linked.
- titaniumtown 3y agoI assume the same as the models that they're fine tuned off of.
- spmurrayzzz 3y agoFor future reference, you can always check the `config.json` file in the repo for this info. Specifically `max_position_embeddings` is the key you're looking for. 7B: 32k 8x22B: 65k
- exe34 3y agoThanks!