25 ms·
> Hoping they add support for llama 2 soon! The 7B and 13B models use the same architecture, so llama.cpp already supports it. (Source: running 13b-chat myself
by LoganDark 3y ago
> Hoping they add support for llama 2 soon!
The 7B and 13B models use the same architecture, so llama.cpp already supports it. (Source: running 13b-chat myself using llama.cpp GPU offload.) It's only 70B that has additional extensions that llama.cpp would need to implement.