3 ms·
> The same is true with LLM solutions that don't work 100% of the time. In my experience, about one of ten LLM suggestions during code review is important and
by thesz 2mo ago
> The same is true with LLM solutions that don't work 100% of the time.
In my experience, about one of ten LLM suggestions during code review is important and valid. Nine of ten are either unimportant or not valid. Yet, I have to read them and rule them out.
Also in my experience, having my colleagues do root cause analysis (RCA) with LLM brings to me invalid RCAs which I have to rule out, instead of working on finding true RCA.
I saw part of documentary about Charlie Abrahams, son of Jim Abrahams. Charlie had epileptic seizures as a child, hundredths a day. In the documentary, Charlie's doctor said that no drug in his experience worked as fast as ketogenic diet (seizures stopped in three days) and as reliably as ketogenic diet (works on more than 80% of people). When he was asked why he did not applied ketogenic diet, he said there still were drug options to try.
"Medicines do not work 100% of time," my bald cranium.
- yunwal 2mo ago> Nine of ten are either unimportant or not valid. Yet, I have to read them and rule them out You don't have to do this? Maybe someone is making you, but it's literally possible to just stop using LLMs for purposes where they fail reliably. I'm also not sure what the point of the keto story is. Are you saying the Polio Vaccine does not work?
- thesz 2mo ago> I'm also not sure what the point of the keto story is. If this drug does not work, there are plenty of others that are not fully 100% working. This was a mindset of a doctor. In case of baby with epilepsy it may cost her a life. The situation was much like we have with LLMs. "It does not work" - "You are using an inferior thing, here are more advanced." What is the cost of these not fully 100% working things?
- yunwal 2mo agook i'm gonna be honest I still don't really understand what you're saying so I'm gonna bow out of this conversation