55 ms·
You could even argue that ML does classical vision in addition to other stuff. CNNs learn gabor filters. The AlexNet paper even shows this [0] Or if you look
by godelski 1y ago
You could even argue that ML does classical vision in addition to other stuff.
CNNs learn gabor filters. The AlexNet paper even shows this [0]
Or if you look at the work ViT built itself on, they show attention heads will also learn these fillers. [1] That's actually a big part of how ViTs work, the heads integrate this type of information
[0] https://papers.nips.cc/paper_files/paper/2012/hash/c399862d3b9d6b76c8436e924a68c45b-Abstract.html https://papers.nips.cc/paper_files/paper/2012/hash/c399862d3...
[1] https://arxiv.org/abs/1911.03584 https://arxiv.org/abs/1911.03584