4 ms·
A medium prompt = 1 million tokens?
by jgalt212 3mo ago
A medium prompt = 1 million tokens?
- RugnirViking 3mo agoHow many times have you had a model start compacting already before getting back to you? Most have 1 million context window. It's happened to me occasionally
- jgalt212 3mo agoI don't use agents. I like to code and AI with a REPL.