3 ms·
I feel that the optimal solution is hybrid, not polarized. That is, we use deterministic approach as much as we can, but leverage LLMs to handle the remaining c
by hintymad 1y ago
I feel that the optimal solution is hybrid, not polarized. That is, we use deterministic approach as much as we can, but leverage LLMs to handle the remaining complex part that is hard to spec out or describe deterministically
- nowittyusername 1y agoI agree. You want to use as little LLM as possible in your workflows.
- jngiam1 1y agoYes - in particular, I think one interesting angle is use the LLM to generate deterministic approaches (code). And then, if the code works, save it for future use and it becomes deterministic moving forward.
- hintymad 1y agoYes, and the other way around: use the deterministic methods to generate the best possible input to LLM.
- seunosewa 1y agoCan you give an example so we can visualise this?
- hintymad 1y agoFor instance, in an AIOps project we still perform a number of time series algorithms and then feed the results along with the original time series data to LLM. LLM will produce much more relevant and in-depth analysis than using the raw data along as input.