3 ms·
Disclaimer: I’m definitely not an expert in this area and my understanding of the paper may be off. I wonder if Jeff Dean (and google) have tried a neural netw
by tadkar 8y ago
Disclaimer: I’m definitely not an expert in this area and my understanding of the paper may be off.
I wonder if Jeff Dean (and google) have tried a neural network version of this. The core idea here seems similar to “learned index structures”
https://research.google.com/pubs/pub46518.html https://research.google.com/pubs/pub46518.html
- Ninn 8y agoI dont think this works well as an adaptive workload/case, training the network cant be done online and is a rather heavy task, as such it works well when you have a well defined pattern you can detect/train against. Although kudos to the authors, i really like the intuition of this approach!
- tadkar 8y agoI think backprop can be made to work online and the cache gets instant feedback on its predictions, so I see no reason why this couldn’t be made to work. In some ways their conditional probability estimates are one form of classifier. It would be really interesting also to see how this idea plays with specialized NN training hardware like the TPU, it would certainly make the computation easier.