4 ms·
Implementing Poincaré Embeddings (2017)
- Darkphibre 7y agoI really like how they describe the adventure of replicating results, rather than just taking the paper at face value.
- theSage 7y agowe had a similar adventure implementing the next thing which was lorentz embeddings. Some equations were wrong in the paper which AFAIK have not been fixed in subsequent revisions. @dchatterjee172 found a lot of the inconsistencies in the work. https://github.com/theSage21/lorentz-embeddings https://github.com/theSage21/lorentz-embeddings
- boltzmannbrain 7y agoEquations wrong in the original Poincare embeddings paper https://arxiv.org/abs/1705.08039 https://arxiv.org/abs/1705.08039 ? Do you recall which? And thanks for sharing your Lorentz implementation!
- theSage 7y agowe never implemented the poincare paper since by then Facebook had published it's own code, but for the lorentz paper there were a few which were wrong. I'll update the repo to point to those in a bit
- Irishsteve 7y agoBummer that they could not replicate the results
- heyplanet 7y agoThere is an actual application of this on the frontpage right now: https://news.ycombinator.com/item?id=20574182 https://news.ycombinator.com/item?id=20574182 Coincidence?
- Der_Einzige 7y agoWhy isn't this being used heavily in other NLP frameworks? All the newest Language Models seem to be throwing more compute at transformer models instead of moving away from Euclidean Space.
- agentofoblivion 7y agoSo its been ~2 years. Have the problems been sorted out? Have original authors published their implementation? Would enjoy an update on these efforts.