3 ms·
Is the context only 1024 tokens? it seem it will cut off more and more (which is weird) after I have longer conversation.
by m3kw9 3y ago
Is the context only 1024 tokens? it seem it will cut off more and more (which is weird) after I have longer conversation.
- joodfish 3y agoit looks like the Llamafile team is taking questions in their live Q&A tomorrow (thursday) at 1700 UTC - https://www.youtube.com/live/dwhBvUN-MD8?feature=shared https://www.youtube.com/live/dwhBvUN-MD8?feature=shared