4 ms·
How many devs would be able to keep working if GitHub disappeared tomorrow? You can do inference on SOME laptops, but the current shape of GenAI need massive da
by lccerina 5mo ago
How many devs would be able to keep working if GitHub disappeared tomorrow?
You can do inference on SOME laptops, but the current shape of GenAI need massive data centers to be used at scale.
Also the existence of various big tech companies rely on these data centers being place, without them they are useless.
- zozbot234 5mo agoThe nice thing about local AI is that it really can run anywhere, you just need enough storage space for the weights and the context. It just gets slower if you run it on potato-level hardware.
- DrewADesign 4mo agoFor bang-on user cases like coding, sure. For concept art and other still-image diffusion tasks, sure. For damn near anything else, calling hardware that doesn’t approach the inference breadth and performance of data-center-hosted remote services ‘potato-level’ is pretty disingenuous… never mind any significant training. Not only that, hardware is less accessible than it’s been in years— nvidia is re-releasing the 3060 so gamers can buy something. For anything you’d stake your business on? Good luck.