4 ms·
Would you say that is the state of the art CPU inference library?
by anonymousDan 3y ago
Would you say that is the state of the art CPU inference library?
- Kubuxu 3y agoggml.cpp with blast backend could be one example of it See for instance: https://github.com/ggerganov/ggml/blob/57c468b8655f3630d174950e46ae2eb1fd5042f4/src/ggml-quants.c https://github.com/ggerganov/ggml/blob/57c468b8655f3630d1749... which are the parts not available in blast