3 ms·
Yes - for example adding memory to the attention mechanism (similar to RETRO or Memorizing Transformers paper)
by typon 4y ago
Yes - for example adding memory to the attention mechanism (similar to RETRO or Memorizing Transformers paper)
loading thread…