4 ms·
I'd guess they showed that query because LLMs are a lot better at answering translation/migration type stuff without hallucinating too much.
by Matl 2y ago
I'd guess they showed that query because LLMs are a lot better at answering translation/migration type stuff without hallucinating too much.
- dontlikeyoueith 2y agoThat's because the attention mechanism was designed for Seq2Seq models (i.e. translation in its most general form). Any other use of it is a case of "I have a hammer, so that's a nail".