2 ms·
LLMS still can’t troubleshoot. I have been thinking about how to solve it and I think an entirely new architecture is needed. Quants got replaced by quant bots
by tim-tday 9mo ago
LLMS still can’t troubleshoot. I have been thinking about how to solve it and I think an entirely new architecture is needed. Quants got replaced by quant bots the same way human calculators got replaced by electronic adding machines.
I haven’t met an AI who can think clearly in a systems setting. I’m guessing it might be a decade or two.
As an example, ask an LLM to do some 10th grade math. Inspect the thinking process. It can regurgitate the process and the rules but cannot perform them.
Same with troubleshooting.
- xeckr 9mo ago>As an example, ask an LLM to do some 10th grade math. Inspect the thinking process. It can regurgitate the process and the rules but cannot perform them. It seems to me that the solution is just RL to get the language model to delegate the actual calculation to the appropriate tool.
- hmokiguess 9mo agoI'm not sure your explanation is correct. The quant bots are also decision systems who attempt to predict in non-deterministic environments. The reason they got replaced isn't because the problem became deterministic (like a calculator). It's because the error rate and the cost got to an acceptable place when compared with the cost of a human quant.