8 ms·
The first question I had was "what are the economics?" From the FAQ: Will Petals incentives be based on crypto, blockchain, etc.? No, we are working on a ce
by esafak 3y ago
The first question I had was "what are the economics?" From the FAQ:
Will Petals incentives be based on crypto, blockchain, etc.?
No, we are working on a centralized incentive system similar to the AI Horde kudos, even though Petals is a fully decentralized system in all other aspects. We do not plan to provide a service to exchange these points for money, so you should see these incentives as "game" points designed to be spent inside our system.
Petals is an ML-focused project designed for ML researchers and engineers, it does not have anything to do with finance. We decided to make the incentive system centralized because it is much easier to develop and maintain, so we can focus on developing features useful for ML researchers.
https://github.com/bigscience-workshop/petals/wiki/FAQ:-Frequently-asked-questions#general https://github.com/bigscience-workshop/petals/wiki/FAQ:-Freq...
- brucethemoose2 3y ago> similar to the AI Horde kudos What they are referencing, which is super cool and (IMO) criminally underused: https://lite.koboldai.net/ https://lite.koboldai.net/ https://tinybots.net/artbot https://tinybots.net/artbot https://aihorde.net/ https://aihorde.net/ In fact, I can host a 13B-70B finetune in the afternoon if anyone on HN wants to test a particular one out: https://huggingface.co/models?sort=modified&search=70B+gguf https://huggingface.co/models?sort=modified&search=70B+gguf
- swyx 3y ago> GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. GGUF offers numerous advantages over GGML, such as better tokenisation, and support for special tokens. It is also supports metadata, and is designed to be extensible is there a more canonical blogpost or link to learn more about the technical decisions here?
- brucethemoose2 3y agohttps://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md#historical-state-of-affairs https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md#... It is (IMO) a necessary and good change. I just specified gguf because my 3090 cannot host a 70B model without offloading outside of exLlama's very new ~2 bit quantization. And pre quantized gguf is a much smaller download than raw fp16 for conversion.
- swyx 3y agothanks very much!
- Szpadel 3y agoif that part could be replaced with any third party server it would be a tracker in BitTorrent analogy.
- deleted 3y ago[deleted]
- seydor 3y agoIt's a shame that every decentralized projects needs to be compared to cryptocoins now
- AnthonyMouse 3y agoIt's not the comparison, it's that it's one of the things cryptocoins are actually useful for: You have people all over the world with GPUs, some of them want to pay the others for use of them, but their countries use different payment networks or the developers want to be able to automate it without forcing the users to all sign up with the same mercurial payment processor who could screw over any of the users at random.
- littlestymaar 3y ago> it's that it's one of the things cryptocoins are actually useful for It's what their proponent claim that they are useful for, yet there's no single instance of a successful blockchain project actually achieving this kind of resource-sharing goal. > You have people all over the world with GPUs, some of them want to pay the others for use of them The gigantic success of bitTorrent shows that humans as a group don't need to have monetary incentives to share their spare hardware. In fact, it's likely that trying to add money into the mix will just break the system instead of improving it: https://en.wikipedia.org/wiki/Overjustification_effect https://en.wikipedia.org/wiki/Overjustification_effect
- joshuaissac 3y ago> It's what their proponent claim that they are useful for, yet there's no single instance of a successful blockchain project actually achieving this kind of resource-sharing goal Sia and Filecoin already work in this way to for people to share storage. > In fact, it's likely that trying to add money into the mix will just break the system instead of improving it This depends on the amount of money people are willing to pay for processing power. Volunteer contributions would be reduced, but the paid contributions could make up for it if the people who want to train their model pay enough to attract more people into the system and if those people can compete with conventional commercial offerings.
- kordlessagain 3y agoThe logical conclusion is that they (the models) will eventually be linked to crypto payments though. This is where Lightning becomes important... Edit: To clarify, I'm not suggesting linking these Petal "tokens" to any payment system. I'm talking about, in general, calls to clusters of machine learning models, decentralized or not, will likely use crypto payments because it gives you auth and a means of payment. I do think Petal is a good implementation of using decentralized compute for model use and will likely be valuable long term.
- vorpalhex 3y agoI mean, I can sell you Eve or Runescape currency but we don't need any crypto to execute on it. "Gold sellers" existed well before crypto.
- AnthonyMouse 3y agoIs there an API for that which doesn't require each of the users to create a separate account on something else?
- sn0wf1re 3y agoSimilarly there have been distributed render farms for graphic design for a long time. No incentives other than higher points means your jobs are prioritized. https://www.sheepit-renderfarm.com/home https://www.sheepit-renderfarm.com/home
- beardog 3y ago>What's the motivation for people to host model layers in the public swarm? >People who run inference and fine-tuning themselves get a certain speedup if they host a part of the model locally. Some may be also motivated to "give back" to the community helping them to run the model (similarly to how BitTorrent users help others by sharing data they have already downloaded). >Since it may be not enough for everyone, we are also working on introducing explicit incentives ("bloom points") for people donating their GPU time to the public swarm. Once this system is ready, we will display the top contributors on our website. People who earned these points will be able to spend them on inference/fine-tuning with higher priority or increased security guarantees, or (maybe) exchange them for other rewards. It does seem like they want a sort of centralized token however.
- nextaccountic 3y agoCan they actually prevent people from trading petals for money though?