nemjack

4 ms·

1. 1.▲
   The Argument for Emergent Language Models(superspeeg.substack.com)

   1 points by nemjack 10mo ago|0 comments
2. 2.▲
   by nemjack 1y ago

   For sure, we can't process images the same way that we process sound, but the author argues for processing images and text the same, and text is fundamentally a visual medium of communication. The author makes a good point about how VL
3. 3.▲
   by nemjack 1y ago

   I don't think you're quite right. The author is arguing that images and text should not be processed differently at any point. Current early fusion approaches are close, but they still treat modalities different at the level of to
4. 4.▲
   by nemjack 1y ago

   Concepts within modalities are potentially consistent, but the point the author is making is that the same "concept" vector may lead to inconsistent percepts across modalities (e.g. a conflicting image and caption).
5. 5.▲
   by nemjack 1y ago

   This is a great analogy, I totally agree!