For anyone interested in exploring this, llama.cpp has an example implementation here: https://github.com/ggerganov/llama.cpp/tree/master/examples/speculative

For anyone interested in exploring this, llama.cpp has an example implementation here: https://github.com/ggerganov/llama.cpp/tree/master/examples/speculative https://github.com/ggerganov/llama.cpp/tree/master/examples/...