6 ms·
Is this actually true? Can’t you do online training in real-time, at least in principle? As audio comes in, for a micro batch of current calls on the local node
by theptip 3y ago
Is this actually true? Can’t you do online training in real-time, at least in principle? As audio comes in, for a micro batch of current calls on the local node, do STT, next token prediction, and calculate your loss. Transmit the loss update back to the centralized model.
Google posted about Federated Learning years ago: https://ai.googleblog.com/2017/04/federated-learning-collaborative.html https://ai.googleblog.com/2017/04/federated-learning-collabo..., not sure how widely it has caught on though.