4 ms·
AI will dominate but only on huge distributed compute clusters. Local will be able to run models at reasonable speeds only when they're 4 years old.
by atleastoptimal 4y ago
AI will dominate but only on huge distributed compute clusters. Local will be able to run models at reasonable speeds only when they're 4 years old.
- thatjoeoverthr 4y agoFour years will come and go.
- yreg 4y agoDoesn't the recent development (Stable Diffusion, LLaMA) tell us that these things actually run surprisingly well locally and that the models can be compressed much further? And aren't we finding out that the amount of parameters seems to matter less than we used to believe?
- xyzzy123 4y agoAll indications are that you can scale LLMs up & down pretty smoothly, I bet there will be lots of workflows in future using AI on pc-or mobile scale hardware which can call out to cloud AI for "deep thinking" or to double check stuff. It seems likely there will be AIs specialised in taxes or medicine, people/systems will consult multiple AIs to smooth out errors and look for consensus etc. In short, I agree with OP that we will probably end up with something that looks more like an ecosystem than a hegemony.
- nico 4y agoFor the other replies: I think @atleastoptimal was making a joke about families/parenting.