3 ms·
Your positive view makes sense to me and is refreshing. Let's see how things play out. So the pattern will be: that which can be done with smaller models will b
by edg5000 5mo ago
Your positive view makes sense to me and is refreshing. Let's see how things play out. So the pattern will be: that which can be done with smaller models will be decentralized first; gradually the more advanced stuff will become within reach.
I already do use google search's AI Mode (probably a 300B model) for many quick questions. Local models would be great for things like checking my email and many other things (sensitive + continuously running = not suitable for Opus). My 64GB DDR4 laptop can already run Qwen 47B at .7 tok/s, that's already usable for some usecases (overnight stuff mostly).