3 ms·
I'm pretty sure you could make it work if you expanded the context to hundred or so messages.
by loa_in_ 2y ago
I'm pretty sure you could make it work if you expanded the context to hundred or so messages.
- Sohcahtoa82 2y agoWith the 7B parameter models, sure. Not with GPT-2 though. The context window is only 1024 tokens. Even with only 10 messages, if they're long messages, it will exceed the context window.