4 ms·
If this is mostly because of the size of the system prompt, then perhaps in long horizon tasks the "tax" will be less obvious.
by lexicalmathical 15d ago
If this is mostly because of the size of the system prompt, then perhaps in long horizon tasks the "tax" will be less obvious.