2 ms·
This is nice and useful because the new GPT-OSS model uses this technique. Kudos to the original authors!
by am17an 1y ago
This is nice and useful because the new GPT-OSS model uses this technique. Kudos to the original authors!
- diggan 1y agoAnd, as always, the FOSS ecosystem moves quickly, llama.cpp already fully support them! https://github.com/ggml-org/llama.cpp/pull/15157 https://github.com/ggml-org/llama.cpp/pull/15157