3 ms·
Have you seen the tables in Appendix E (starts p. 16) of the Transformer-XL paper? I think they're pretty good. https://arxiv.org/pdf/1901.02860.pdf https://ar
by AlexCoventry 7y ago
Have you seen the tables in Appendix E (starts p. 16) of the Transformer-XL paper? I think they're pretty good.
https://arxiv.org/pdf/1901.02860.pdf https://arxiv.org/pdf/1901.02860.pdf
- account73466 7y agoGlad to find they used something from my research. Don't want to disclose more, was flagged too much.
- username90 7y agoQuote from that paper: > The Battle of Austerlitz was the decisive French victory against Napoleon It didn't even catch that Napoleon was the leader of the French as described in the source snippet. And this was when it just generated text of similar size as the input. Based on just that paper I highly doubt that this method will generalize to creating entire books.
- account73466 7y ago"he was still in conflict with Emperor Napoleon, the French Republic’s king"
- username90 7y agoMy point was that the text lacked coherence, that quote only makes it worse. If it can't even keep coherence for a single page how would it manage for a hundred?
- account73466 7y agoby improving metrics over time see, e.g., https://gluebenchmark.com/leaderboard/ https://gluebenchmark.com/leaderboard/
- account73466 7y agoOh fuck, I am banned here from getting points. Time to avoid selling my own profile to whoever sniff on HN users.
- dang 7y agoYou're not banned here.