ggml.cpp with blast backend could be one example of it See for instance: https://github.com/ggerganov/ggml/blob/57c468b8655f3630d174950e46ae2eb1fd5042f4/src/ggm

ggml.cpp with blast backend could be one example of it See for instance: https://github.com/ggerganov/ggml/blob/57c468b8655f3630d174950e46ae2eb1fd5042f4/src/ggml-quants.c https://github.com/ggerganov/ggml/blob/57c468b8655f3630d1749... which are the parts not available in blast