4 ms·
Out of curiosity- there's a focus on local llm then talk about no GPU, only FPGA. Those feel- at odds. But maybe I'm out of the loop for how far local LLMs on c
by jasonjmcghee 1y ago
Out of curiosity- there's a focus on local llm then talk about no GPU, only FPGA. Those feel- at odds. But maybe I'm out of the loop for how far local LLMs on custom hardware has come?
- ItsHarper 1y agoThey're still at the compiler stage. LLM features and hardware seem far enough away that it's reasonable to wait to evaluate if that combination is actually practical.