All their tensor/math magic seems to happen in https://github.com/ggerganov/llama.cpp/blob/master/ggml.h https://github.com/ggerganov/llama.cpp/blob/master/ggml

All their tensor/math magic seems to happen in https://github.com/ggerganov/llama.cpp/blob/master/ggml.h https://github.com/ggerganov/llama.cpp/blob/master/ggml.h . So maybe if you implement the ggml.c with tensorflow/libcoral - you'd have a chance.