4 ms·
The cat's out of the bag. There's no way self-hostable versions don't come along, and soon.
by Baeocystin 4y ago
The cat's out of the bag. There's no way self-hostable versions don't come along, and soon.
- Madmallard 4y agoYou realize the monumental compute involved on the backend?
- dns_snek 4y agoBloom? This is just a general observation but I'm surprised everyone's forgotten about it this quickly. I haven't seen it mentioned in these sorts of discussions in a very long time.
- root_axis 4y agoThe hardware necessary for self-hosting definitely won't be in reach of most people any time soon.
- tyfon 4y agoOne day it will though. I think we will also see a lot of weights optimisation/pruning and model architecture optimisations that allow them to run on much less hardware.
- Baeocystin 4y agoLike you say, we can self-host GPT-2 today. And Bloom is a large-scale open source LLM model available for anyone, and has been around for months. Look how rapidly the RAM/hardware requirements for the diffusion generators has dropped over the past couple of months, now that they passed the critical interest threshold. I see no reason not to expect similar here.