3 ms·
I generally think there is a lot of good use for local models. Works like Lucy have a ton of potential to help drive tools, do basic reasoning. https://huggingf
by jauntywundrkind 1y ago
I generally think there is a lot of good use for local models. Works like Lucy have a ton of potential to help drive tools, do basic reasoning. https://huggingface.co/Menlo/Lucy https://huggingface.co/Menlo/Lucy
But I think this week we are seeing a lot of extremely capable large models. DeepSeek V3 (670B) was joined by Kimi K2 (1T), and now Qwen3 Coder (480B). Trying to run these at home with any reasonable speed is very hard. Smaller models can be quite useful too but I feel like one absolutely wants to be able to tap these large models for a lot of core crucial work.
https://www.reddit.com/r/LocalLLaMA/ https://www.reddit.com/r/LocalLLaMA/