3 ms·
I've tried LLMs for a few exploratory programming projects. It kinda feels magical the first time you import a dependency you don't know and you get the LLM ou
by woolion 2y ago
I've tried LLMs for a few exploratory programming projects.
It kinda feels magical the first time you import a dependency you don't know and you get the LLM output what you want to do without you even having the time to think about it.
However, I also think that for any minute I've gained with it I've lost at least one because of hallucinated solutions.
Even for fairly popular things (Terraform+AWS) I continuously got plausible-looking answers. After reading carefully the docs, the use case was not supported at all, so I just went with the 30 seconds (inefficient) solution I had thought of from the start. But I lost more than one hour.
Same story with the Ren'py framework. The issue is that the docs are far from covering everything, and Google sucks, sometimes giving you a decade-old answer to a problem that has a fairly good answer in more recent versions. So it's really difficult to decide how to most efficiently look for an answer between search and LLM. Both can be a stupid waste of time.