4 ms·
You are trying to control a system that is inherently chaotic. You can probably get some where by indeed running a task 1000 times and looking for outliers in
by threeseed 1y ago
You are trying to control a system that is inherently chaotic.
You can probably get some where by indeed running a task 1000 times and looking for outliers in the execution time or token count. But that is of minimal use and anything more advanced than that is akin to water divining.
- kordlessagain 1y agoThe system is only nondeterministic (and a model of nondeterminism at that) when it's emitting tokens. It (the system) becomes completely deterministic when it calls a tool and a result is returned from the tool. This is little different than how I wrote this. Now it is deterministic, when I hit reply.