3 ms·
i don't care about microcontroller, what is the decent option to have local llm in my raspi4 that does not take 30 seconds to answer?
by anonymous344 2mo ago
i don't care about microcontroller, what is the decent option to have local llm in my raspi4 that does not take 30 seconds to answer?
- Rohansi 2mo agoRun a smaller LLM. It won't be as smart but the one shown here isn't either.