5 ms·
Language-Agnostic Sentence Representations
- giancarlostoro 8y agoLooks interesting, not sure why they went with Creative Commons as a license though. It's "Attribution-NonCommercial 4.0 International" for those curious.
- anewhnaccount2 8y agoProbably to encourage people to re-implement as a learning exercise(!)
- mehrdadn 8y agoI can't speak for this project, but I know I did similarly for one of my projects simply because I wanted to encourage research use and discourage commercial use. If people wanted to use it I thought it'd turn out better that they reimplement it themselves. I'm thinking maybe it's similar here.
- research8764 8y agoYeah, that's a special wrinkle because industrial labs are such a big part of the "academic" research ecosystem right now. Can Google use this code to give comparative results in a follow-up paper? If so, how do they separate their research activity from commercial activity (esp. given business benefits such as recruiting)?
- vukka 8y agoCan somebody explain like I'm 5 what I might use this for?
- deleted 8y ago[deleted]
- IanCal 8y agoThe Facebook usecase is machine translation. Instead of learning translations between each language pair (which scales horribly), just learn to and from a common representation. I expect you could also use this for classification that works over many languages.
- neuronexmachina 8y agoI think one example would be if you wanted to train a text classification system in one language, but also allow it to be useful for classifying text in languages it wasn't trained on. If the language can be mapped to this representation, it's a valid input.
- deleted 8y ago[deleted]
- minimaxir 8y agoThis is the repo for the FB post submitted a couple days ago: https://news.ycombinator.com/item?id=18970112 https://news.ycombinator.com/item?id=18970112
- Shorel 8y agoIt seems to me they opened the source for the encoder but the decoder is not included. This means we can use it to index sentences in any language and calculate the semantic distance between them, but we can't use it to implement an alternative to Google Translator.
- B1FF_PSUVM 8y agoThe 'conlang' crowd are difficult - a verbless language: https://en.wikipedia.org/wiki/Kēlen https://en.wikipedia.org/wiki/Kēlen
- zapzupnz 8y agoI'm fascinated by the concept of a verbless language, but don't want to go to the effort of learning a conlang to experience it. But taking English and removing the verbs, substituting similar structures as in Kelen, wouldn't be all that instructive; I'd spend more time aghast at how seemingly incomprehensible the English is rather than the effect of the change to the language. Difficult one. (That said, if someone did decide to make some sort of Kelenglish, I'd love to see it thrown into this framework!)