3 ms·
> ... local generative AI lunch I agree, just for my PC, something that'd enable small devs to create interesting foundation model apps that'd deploy to users
by renecito 2y ago
> ... local generative AI lunch
I agree, just for my PC, something that'd enable small devs to create interesting foundation model apps that'd deploy to users using this local AI cards to run these new Apps.
- davrosthedalek 2y agoThere might be an hen-egg problem if the apps end up requiring a 128Gb AI accelerator card. You only get the card if there are apps to run, and you only develop the apps if the cards are wide-spread. With so much RAM, the cards will not be let's-through-them-into-a-cheap-build cheap. I think there have to be a couple of killer apps that run "OK" with CPU or GPU, but would run tremendously better with such a card.