3 ms·

Crypto has been equally revolutionary, but the value lies in a different stratum that’s harder to relate to than the immediate gratification of AI-enhanced chat

Crypto has been equally revolutionary, but the value lies in a different stratum that’s harder to relate to than the immediate gratification of AI-enhanced chat. Things are going to get really interesting where these worlds collide. I look forward to truly open models built on blockchains. I know I’ll give off mad scientist vibes for saying this, but a highly distributed model that can’t be shut down, blocked, centrally programmed, or constrained is the future I’m excited to see.

vineyardmike 4y ago
> a highly distributed model that can’t be shut down, blocked, centrally programmed, or constrained is the future I’m excited to see Brushing over the idea that we’d run an ML model on a blockchain like it’s a general purpose computer… we already have a distributed model that can’t be shut down. LLaMA leaked over BitTorrent, and that was used to build Alpaca - and that’s a small model (~4gb) that basically anyone can download and run on any device. As long as people keep seeding it, then it’ll stay distributed and resistant to being blocked etc. as long as we distribute info like we do today, anyone will be able to train the model (like they did from LLaMA -> alpaca).
- textninja 4y ago
  > Brushing over the idea that we’d run an ML model on a blockchain like it’s a general purpose computer Glad you were able to brush that straw man out of the way for us. > LLaMA leaked over BitTorrent . . . small model . . . anyone can download and run I’m aware of that, but I’m referring to models with parameter counts in the trillions; that is, the kinds of models that require super computers (or globally distributed commodity infrastructure and ASICs) to run. As the state of the art advances, what leaked years or even weeks ago will not matter; people want the latest and greatest, and they’ll demand that it serves their interests, not OpenAI’s.

vineyardmike 4y ago

> a highly distributed model that can’t be shut down, blocked, centrally programmed, or constrained is the future I’m excited to see Brushing over the idea that we’d run an ML model on a blockchain like it’s a general purpose computer… we already have a distributed model that can’t be shut down. LLaMA leaked over BitTorrent, and that was used to build Alpaca - and that’s a small model (~4gb) that basically anyone can download and run on any device. As long as people keep seeding it, then it’ll stay distributed and resistant to being blocked etc. as long as we distribute info like we do today, anyone will be able to train the model (like they did from LLaMA -> alpaca).

textninja 4y ago
> Brushing over the idea that we’d run an ML model on a blockchain like it’s a general purpose computer Glad you were able to brush that straw man out of the way for us. > LLaMA leaked over BitTorrent . . . small model . . . anyone can download and run I’m aware of that, but I’m referring to models with parameter counts in the trillions; that is, the kinds of models that require super computers (or globally distributed commodity infrastructure and ASICs) to run. As the state of the art advances, what leaked years or even weeks ago will not matter; people want the latest and greatest, and they’ll demand that it serves their interests, not OpenAI’s.