3 ms·
As others have pointer out, this is format-dependent. One of the formats that hasn't been white-listed in this thread yet is GGUF, used by llama.cpp and derivat
by worstspotgain 2y ago
As others have pointer out, this is format-dependent. One of the formats that hasn't been white-listed in this thread yet is GGUF, used by llama.cpp and derivates. It's pretty much "big matrices of numbers and some metadata." Some vulnerabilities were found [1] and patched.
[1] https://www.databricks.com/blog/ggml-gguf-file-format-vulnerabilities https://www.databricks.com/blog/ggml-gguf-file-format-vulner...