7 ms·
Does anyone use the super tiny models for anything ? Like in the 2billion or lower parameter level?
by Decabytes 7mo ago
Does anyone use the super tiny models for anything ? Like in the 2billion or lower parameter level?
- genpfault 7mo agoSpeculative decoding[1]? [1]: https://github.com/ggml-org/llama.cpp/blob/master/docs/speculative.md#draft-model-draft https://github.com/ggml-org/llama.cpp/blob/master/docs/specu...