3 ms·

The results are just incredible. The depth of the project is very deep. Case in point, chess+clock yields hourglasker (hourglass & Lasker). Lasker was a German

The results are just incredible. The depth of the project is very deep. Case in point, chess+clock yields hourglasker (hourglass & Lasker). Lasker was a German chess champion, well known in chess circles but the average person would have no idea who he is. I wonder if this is using wikipedia or dbpedia to walk a graph and find words to stick together. That's the only way I could think of doing this.

gwern 8y ago
Nope, the paper says it's just using the FastText word embedding: https://nips2018creativity.github.io/doc/entendrepreneur.pdf https://nips2018creativity.github.io/doc/entendrepreneur.pdf which is just a particularly well-done word2vec: https://arxiv.org/pdf/1712.09405.pdf https://arxiv.org/pdf/1712.09405.pdf 'Lasker' and 'chess' no doubt co-occur quite strongly in their Internet corpus.
- ggggtez 8y ago
  On the other hand, it comes up with "Beagle" and "Labrador" as synonyms of "cat". Color me unimpressed. This seems like something that has been done before, and the fact the paper has no references indicates to me that the author maybe didn't do background research. While [0] is different, I could have sworn I've seen a paper which discussed creating puns in this fashion. [0] http://www.aclweb.org/anthology/W05-1614 http://www.aclweb.org/anthology/W05-1614
  - gwern 8y ago
    Maybe you saw https://llamasandmystegosaurus.blogspot.com/2017/05/alpha.html https://llamasandmystegosaurus.blogspot.com/2017/05/alpha.ht... a year or two ago which does something similar in generating rhyming definitions, also using a word2vec approach.
  - Jack000 8y ago
    fasttext and word2vec only encode contextual similarity, they're not meant to generate synonyms.
    - ggggtez 8y ago
      So, you agree with me then. You can't say "What do you call a sleepy cat? A /grumbea-gle/ (grumpy-beagle)!" It's a portmanteau, sure, but it is not really even close to the input. Using word2vec here is probably wrong, or should have different pruning for word variance. It's a flaw of the technique and choices of the author.
  - gwern 8y ago
    > On the other hand, it comes up with "Beagle" and "Labrador" as synonyms of "cat". Color me unimpressed. 'It doesn't matter whether a cat has floppy ears or yellow fur so long as it catches mice.'
    - ConceptJunkie 8y ago
      Perhaps it's thinking in Ron Swanson terms: "Any dog under fifty pounds is a cat and cats are useless."
yesenadam 8y ago
>Lasker was a German chess champion That doesn't quite do him justice - Emanuel Lasker was world champion for 27 (!) years, 1894-1921, a record not likely ever to be surpassed. And a mathematician (e.g. see https://en.wikipedia.org/wiki/Laskerian_ring https://en.wikipedia.org/wiki/Laskerian_ring ) and fine writer. In fact I learnt to play from Lasker's Manual of Chess. It's very poetic in places, e.g. On the chessboard, lies and hypocrisy do not survive long. The creative combination lays bare the presumption of a lie; the merciless fact, culminating in the checkmate, contradicts the hypocrite. edit: I guess you knew that if you were trying chess + clock hehe.
ConceptJunkie 8y ago
That's really cool, but as I described above, my experience was different. The phoneme matching is really impressive but the word selection functionality seems pretty weak. I had better luck with "large" and "cat" which gave me "colossalot", as in "colossal ocelot", which is a real winner. However, I don't want to dismiss the hard work that went into this tool, despite my criticisms. It's very, very cool.

gwern 8y ago

Nope, the paper says it's just using the FastText word embedding: https://nips2018creativity.github.io/doc/entendrepreneur.pdf https://nips2018creativity.github.io/doc/entendrepreneur.pdf which is just a particularly well-done word2vec: https://arxiv.org/pdf/1712.09405.pdf https://arxiv.org/pdf/1712.09405.pdf 'Lasker' and 'chess' no doubt co-occur quite strongly in their Internet corpus.

ggggtez 8y ago
On the other hand, it comes up with "Beagle" and "Labrador" as synonyms of "cat". Color me unimpressed. This seems like something that has been done before, and the fact the paper has no references indicates to me that the author maybe didn't do background research. While [0] is different, I could have sworn I've seen a paper which discussed creating puns in this fashion. [0] http://www.aclweb.org/anthology/W05-1614 http://www.aclweb.org/anthology/W05-1614
- gwern 8y ago
  Maybe you saw https://llamasandmystegosaurus.blogspot.com/2017/05/alpha.html https://llamasandmystegosaurus.blogspot.com/2017/05/alpha.ht... a year or two ago which does something similar in generating rhyming definitions, also using a word2vec approach.
- Jack000 8y ago
  fasttext and word2vec only encode contextual similarity, they're not meant to generate synonyms.
  - ggggtez 8y ago
    So, you agree with me then. You can't say "What do you call a sleepy cat? A /grumbea-gle/ (grumpy-beagle)!" It's a portmanteau, sure, but it is not really even close to the input. Using word2vec here is probably wrong, or should have different pruning for word variance. It's a flaw of the technique and choices of the author.
- gwern 8y ago
  > On the other hand, it comes up with "Beagle" and "Labrador" as synonyms of "cat". Color me unimpressed. 'It doesn't matter whether a cat has floppy ears or yellow fur so long as it catches mice.'
  - ConceptJunkie 8y ago
    Perhaps it's thinking in Ron Swanson terms: "Any dog under fifty pounds is a cat and cats are useless."

yesenadam 8y ago

>Lasker was a German chess champion That doesn't quite do him justice - Emanuel Lasker was world champion for 27 (!) years, 1894-1921, a record not likely ever to be surpassed. And a mathematician (e.g. see https://en.wikipedia.org/wiki/Laskerian_ring https://en.wikipedia.org/wiki/Laskerian_ring ) and fine writer. In fact I learnt to play from Lasker's Manual of Chess. It's very poetic in places, e.g. On the chessboard, lies and hypocrisy do not survive long. The creative combination lays bare the presumption of a lie; the merciless fact, culminating in the checkmate, contradicts the hypocrite. edit: I guess you knew that if you were trying chess + clock hehe.

ConceptJunkie 8y ago

That's really cool, but as I described above, my experience was different. The phoneme matching is really impressive but the word selection functionality seems pretty weak. I had better luck with "large" and "cat" which gave me "colossalot", as in "colossal ocelot", which is a real winner. However, I don't want to dismiss the hard work that went into this tool, despite my criticisms. It's very, very cool.