4 ms·
I’ve seen a lot of efforts to add a notion of associative memory into neural networks. Have any exciting applications of such architectures been publicised?
by aparsons 5y ago
I’ve seen a lot of efforts to add a notion of associative memory into neural networks. Have any exciting applications of such architectures been publicised?
- orange3xchicken 5y agoRelevant paper from Misha Belkin's group https://arxiv.org/abs/1909.12362 https://arxiv.org/abs/1909.12362
- truth_ 5y agoJust some days ago researchers from Peking U and Microsoft published a paper[0] saying they can access "knowledge neurons" in pretrained embeddings that will enable "fact editing"[1]. [0]: https://arxiv.org/pdf/2104.08696.pdf https://arxiv.org/pdf/2104.08696.pdf [1]: https://medium.com/syncedreview/microsoft-peking-u-researchers-identify-knowledge-neurons-in-pretrained-transformers-enabling-bfbe4c4a7491 https://medium.com/syncedreview/microsoft-peking-u-researche...
- ilaksh 5y agoI thought that Transformers were a type of associative memory.
- SneakyTornado29 5y agohttps://arxiv.org/search/cs?searchtype=author&query=Hochreiter%2C+S https://arxiv.org/search/cs?searchtype=author&query=Hochreit...