3 ms·
> going to make an impact in AI/LLMs This seems to be made for mass parallelism. Question: Would this scale to 100 million of collaborating 4G/5G smartphones?
by synctext 4y ago
> going to make an impact in AI/LLMs
This seems to be made for mass parallelism.
Question: Would this scale to 100 million of collaborating 4G/5G smartphones? We have operational federated learning code and decentralised learning code (trivial stochastic gradient descent). Application: simple learn-to-Rank based on ClickLogs like its 2005 [1]. Then you have a true decentralised Google.
Would love to link RWKV to other pure decentralised tech. In the past we have build the first self-compiling Android app and first Android-to-Android P2P overlay network. Without any helper peers for carrier-grade NAT puncturing. My university systems lab lacks the size to keep up with the recent pace of innovation.
[1] https://grouplens.org/beyond2005/full/pouwelse.pdf https://grouplens.org/beyond2005/full/pouwelse.pdf