4 ms·
LLaMA.go - open-source framework for LLM inference on regular CPUs [0] It took me about a month of full-time, hard, day and night coding (including weekends) t
by Ambix 3y ago
LLaMA.go - open-source framework for LLM inference on regular CPUs [0]
It took me about a month of full-time, hard, day and night coding (including weekends) to finally build a solid piece which can handle some crazy CPU workloads of tensor math.
[0] https://github.com/gotzmann/llama.go https://github.com/gotzmann/llama.go