4 ms·
Presumably every step has to also read the tokens from the previous steps, so it gets more expensive over time. If you run it on a single task for an hour I wou
by pants2 2y ago
Presumably every step has to also read the tokens from the previous steps, so it gets more expensive over time. If you run it on a single task for an hour I would not be surprised if it consumed hundreds of dollars of tokens.
- vineyardmike 2y agoI’m curious how many tokens this used, and what the actual effective maximum duration it has due to the context window.