3 ms·
Ran the PDF through https://labs.kagi.com/ai/sum https://labs.kagi.com/ai/sum "This paper presents the Transformer, a model architecture that relies entirely o
by cloudking 4y ago
Ran the PDF through https://labs.kagi.com/ai/sum https://labs.kagi.com/ai/sum
"This paper presents the Transformer, a model architecture that relies entirely on an attention mechanism to draw global dependencies between input and output. Experiments on two machine translation tasks show that the Transformer is superior in quality while being more parallelizable and requiring significantly less time to train. On the WMT 2014 English-to-German translation task, the Transformer model achieved a BLEU score of 28.4, improving over the existing best results by over 2 BLEU. On the WMT 2014 English-to-French translation task, the Transformer model achieved a BLEU score of 41.8 after training for 3.5 days on eight GPUs, a small fraction of the training costs of the best models from the literature. The Transformer was also successfully applied to English constituency parsing both with large and limited training data. The Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution."
How accurate is the summary?
- stoniejohnson 4y agoI read the middle paragraph before the first/last sentence, and thought it was a great summary for what it's worth.
- totetsu 4y agoWhat even is a summary.. I'm beginning to wonder. meaning itself is disintegrating.. Where is knowledge? call me a heretic but I say "In Us or nowhere."
- visarga 4y ago> Where is knowledge? That's a very good question. I think GPT-3 shows knowledge is not in the brain, or in the neural network, but in the language itself. A human without language is not very smart.
- totetsu 4y agoyou might find this episode of radio interesting https://radiolab.org/episodes/91725-words https://radiolab.org/episodes/91725-words