3 ms·
It’s as secure as any C++ backend that performs no input validation. Ie. whatever memory safety or sandbox you had from using wasm or rust is gone when you use
by wokwokwok 3y ago
It’s as secure as any C++ backend that performs no input validation.
Ie. whatever memory safety or sandbox you had from using wasm or rust is gone when you use it.
- jart 3y agoThe llama.cpp author thinks security is "very low priority and almost unnecessary". https://github.com/ggerganov/llama.cpp/pull/651#pullrequestreview-1368052138 https://github.com/ggerganov/llama.cpp/pull/651#pullrequestr... So I'm not sure why a sandbox would bundle llama.cpp and claim to be secure. They would need more evidence than this to make such a claim.
- halyconWays 3y agoThis user was caught stealing code and banned from llama.cpp by its creator https://news.ycombinator.com/item?id=35411909 https://news.ycombinator.com/item?id=35411909