4 ms·
I'd like to add to this list: The related work section closes with "Our PoUW facilitates better AI through decentralisation, enhanced security and the right inc
by tastroder 7y ago
I'd like to add to this list: The related work section closes with "Our PoUW facilitates better AI through decentralisation, enhanced security and the right incentives.".
Decentralisation: Their own paper states in 7.2 that "distributed solution will never be as efficient as running the whole training on a local machine". What incentive for buying into this would I have here then? I occasionally use cloud training if what I'm doing exceeds the capability I have locally. As a client I don't particularly care about the internal infrastructure of whoever I pay to do that (with small exceptions like the next point).
Enhanced security: Security that's only required because of me using a blockchain solution? 7.3 starts out with "We assume that the majority of participants is honest.". That's an assumption I can make today with the cloud providers I pay for my training time, without any blockchain overhead. Nothing in that section seems to be related to real world security concerns, e.g. trusting random mining worker nodes with my - potentially proprietary - training data and intermittent results. 3.4, the outline of a task definition, also specifies that I basically provide the full model and really convenient formats to steal all of that away from me. I think the major risk factor of using the idea outlined in the paper doesn't have anything to do with a revolution of cryptocurrencies, but one of the corporate espionage in the ML world it would enable.
Right incentives: For me, as a client, a theoretical 30% savings doesn't outweigh the above (and all the ancillary considerations like infrastructure, ...). If any of their economical analysis is off, they just generate more people going back to bitcoin mining on the other side of the equation. Not sure what the right incentive is supposed to be here. This might be a good system to proove useful work but somehow I don't see the text convincing the reader that the system itself is useful, maybe I missed it.
- onefuncman 7y agoassuming the participants are honest is useful because someone else can prove how to participate in a trust-less fashion, e.g. via homomorphic encryption
- tastroder 7y agoThat kind of sounds too "move fast and break things" for something that's essentially a systems description with an actual implementation they likely want to sell. At any rate, it might be useful for the Blockchain part of the system I don't care too much about. My comment was meant to address the actual work part of the system. It relies on client trust w.r.t. not only the network but also the models and data they put in, which I don't even see mentioned in the document. I don't see how the architecture described in there would be able to even attempt to break down training processes enough to prevent a malicious actor from extracting substantial parts of the system without crippling performance.