4 ms·
Surely input tokens are also involved, and not necessarily only for the initial prompt if there are feedback loops or agent interactions.
by FartyMcFarter 27d ago
Surely input tokens are also involved, and not necessarily only for the initial prompt if there are feedback loops or agent interactions.