12 ms·

Oh hi fire

• fire 4y ago
  hey man, hope things have been going well for you on the main topic, have you heard about RWKV ( rnn based gpt style network )? the project's actively working on implementing "infinite" context length support, which would probably pair very well with a project like yours