8 ms·
We’re no where near a “good book” (we can’t even do a good 3 paragraphs reliably), nor a “meaningful video.” You’re confusing a 1000 monkeys (transformers) wit
by azinman2 7y ago
We’re no where near a “good book” (we can’t even do a good 3 paragraphs reliably), nor a “meaningful video.”
You’re confusing a 1000 monkeys (transformers) with 1 human intelligence (AGI). That giant leap hasn’t been met.
- account73466 7y agoI guess you are not from the field. Edit: I was right, he is an engineer and not a researcher who is active in the field.
- deleted 7y ago[deleted]
- dang 7y agoPlease don't make personal dismissals. That's not in the spirit of this site, and we already had to ask you about this: https://news.ycombinator.com/item?id=21615955 https://news.ycombinator.com/item?id=21615955. Instead, if you know more, share some of what you know. Then we all can learn something. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- azinman2 7y agoEspecially since I do have a background in AI and machine learning.
- account73466 7y agoYour publications track didn't suggest it. Edit: you flag me while I am stating that his publications are not ML/AI, go and check it yourself.
- username90 7y agoCare to link the papers that makes you so sure that we will soon be able to generate whole coherent books? As far as we know you could just be an enthusiastic college student who knows nothing.
- account73466 7y agoHe started with "You’re confusing" which is pretty personal. He said "We’re no where near" which is fine if he is an engineer, he is probably "no where near" in contrast to people doing research in that field. I stated the obvious, he is not active in the field.
- username90 7y agoYou talk as if you have information to share, why don't you share it?
- account73466 7y agoIf you think A and I think B, I am allowed to say B without proving it to you. You can say that my claim is unsupported but by insulting me in a parallel thread you learn nothing. Be open-minded and assume that what you see in open is not everything primarily due to different compute capabilities available to different actors.
- username90 7y agoI'd listen if you had anything to back up your claims, but as is the things you say go against everything I've seen and heard. Being open-minded just means that you listen to evidence, it isn't about listening to anonymous people on the internet making fantastical claims with zero evidence. Also the other comment wasn't meant to insult you, just to show you how ridiculous you look when you come here telling people who have done actual research on the topic that they lack credentials to discuss this when you demand that we listen to you when you got nothing at all. I am not lying when I say that I'd be very interested to read any evidence you have, but since you can't show it then I must conclude that you probably don't have any.
- account73466 7y agoAbove, AlexCoventry mentioned a paper. If you would like to find more, go to Google Scholar and find all papers which cite that paper. This would be just a part of the whole story since bigger datasets and models are not in open. The progress rate in this field is incredible.
- deleted 7y ago[deleted]
- AlexCoventry 7y agoHave you seen the tables in Appendix E (starts p. 16) of the Transformer-XL paper? I think they're pretty good. https://arxiv.org/pdf/1901.02860.pdf https://arxiv.org/pdf/1901.02860.pdf
- account73466 7y agoGlad to find they used something from my research. Don't want to disclose more, was flagged too much.
- username90 7y agoQuote from that paper: > The Battle of Austerlitz was the decisive French victory against Napoleon It didn't even catch that Napoleon was the leader of the French as described in the source snippet. And this was when it just generated text of similar size as the input. Based on just that paper I highly doubt that this method will generalize to creating entire books.
- account73466 7y ago"he was still in conflict with Emperor Napoleon, the French Republic’s king"
- username90 7y agoMy point was that the text lacked coherence, that quote only makes it worse. If it can't even keep coherence for a single page how would it manage for a hundred?
- account73466 7y agoby improving metrics over time see, e.g., https://gluebenchmark.com/leaderboard/ https://gluebenchmark.com/leaderboard/
- account73466 7y ago