Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
llmthrowaway
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
llmthrowaway
1y ago
Meant to say llama-swap instead of llama-server. llama-swap adds a gui and dynamic model switching on top of llama-server. Somewhat tricky to set up as it relies on a .yaml file that is poorly documented for using with docker but something
2.
▲
by
llmthrowaway
1y ago
Confusing title - thought this was about Ollama finally supporting sharded GGUF (ie. the Huggingface default for large gguf over 48gb). https://github.com/ollama/ollama/issues/5245 Sadly it is not and the iss