3 ms·
A useful HN feature would be small space to put in a summary, like the abstract: Convolutional neural networks (CNNs) have so far been the de-facto model for v
by omarhaneef 5y ago
A useful HN feature would be small space to put in a summary, like the abstract:
Convolutional neural networks (CNNs) have so far been the de-facto model for visual data. Recent work has shown that (Vision) Transformer models (ViT) can achieve comparable or even superior performance on image classification tasks. This raises a central question: how are Vision Transformers solving these tasks?
Are they acting like convolutional networks, or learning entirely different visual representations? Analyzing the internal representation structure of ViTs and CNNs on image classification benchmarks, we find striking differences between the two architectures, such as ViT having more uniform representations across all layers.
We explore how these differences arise, finding crucial roles played by self-attention, which enables early aggregation of global information, and ViT residual connections, which strongly propagate features from lower to higher layers. We study the ramifications for spatial localization, demonstrating ViTs successfully preserve input spatial information, with noticeable effects from different classification methods. Finally, we study the effect of (pretraining) dataset scale on intermediate features and transfer learning, and conclude with a discussion on connections to new architectures such as the MLP-Mixer.
- p_j_w 5y agoThis would be handy, but at the same time, I think I like that not doing so encourages people to click the link and read more of the article than they might otherwise.
- codetrotter 5y ago> A useful HN feature would be small space to put in a summary, like the abstract Interestingly, HN does actually save accompanying text when you submit a link also. It just doesn’t show the text on the website. https://news.ycombinator.com/item?id=28180298 https://news.ycombinator.com/item?id=28180298 Personally I like it the way that it is. I think showing an accompanying text for links would allow too much for anyone posting a link to “force” everyone to read their comment on it. Leaving it so that comments must be posted separately in order to be visible in the thread makes it so that useful accompanying comments can float to the top, whereas a useless comment from the submitter sinks to the bottom while still allowing the submitted link to be voted on individually.
- omarhaneef 5y agoI guess this is really in response to all the other responses as well, but I thought the idea would be: to help people decide if they want to click the link. So the title may not be sufficiently informative to let people know if they can understand the article, are interested in it, if it is at the right technical level and so on. I think you're right that it will be abused in many instances and might not be worth it.
- detaro 5y agoThere is little point in duplicating the first thing you see on the page on HN too.
- 6gvONxR4sf7o 5y agoIs the idea to not make people click the links before discussing?