3 ms·
That's correct. The current base model is an int8 quantization of LaMini-Flan-T5-248M described here: https://github.com/mbzuai-nlp/lamini-lm https://github.co
by jncraton 3y ago
That's correct. The current base model is an int8 quantization of LaMini-Flan-T5-248M described here:
https://github.com/mbzuai-nlp/lamini-lm https://github.com/mbzuai-nlp/lamini-lm
I shared more details over on Reddit:
https://www.reddit.com/r/LocalLLaMA/comments/14btk3a/explore_large_language_models_on_any_computer/ https://www.reddit.com/r/LocalLLaMA/comments/14btk3a/explore...