2 ms·
You're confused. The compression algorithm was something different. TextSynth is an LLM inference server, similar to (but older than) llama.cpp.
by simonw 11mo ago
You're confused. The compression algorithm was something different. TextSynth is an LLM inference server, similar to (but older than) llama.cpp.
- yeasku 11mo agoCreating a llama.cpp like software is not using LLMs to develop software neither.