2 ms·
A medium prompt = 1 million tokens?
by jgalt212 25d ago
A medium prompt = 1 million tokens?
- RugnirViking 24d agoHow many times have you had a model start compacting already before getting back to you? Most have 1 million context window. It's happened to me occasionally
- jgalt212 24d agoI don't use agents. I like to code and AI with a REPL.