4 ms·
You happened to use an LLM for something that is most prominent in its training data. Do something off its beaten path and correcting all the hallucinations wi
by tempodox 2y ago
You happened to use an LLM for something that is most prominent in its training data. Do something off its beaten path and correcting all the hallucinations will be more work than just plain old learning it.
- banku_brougham 2y agoyep, this is what have found so far.
- whimsicalism 2y agonot true in my experience - of course you have to work within its capabilities but i find it to be a capable partner across large segments of tasks
- ants_everywhere 2y agoThis is my experience too. Even with pretty common problems in popular languages like Python. The code generated by ChatGPT 4o is full of bugs. If you give it feedback it just thrashes instead of trying to locate and correct the underlying problems. Even if you ask it to think about and correct the underlying problems, it still generates buggy code, often with the same problems it was pretty decent at reasoning about.
- red-iron-pine 2y agoive found it works for small scripts that are simple, and have easily accessible code or examples. i was testing a data transform function and needed to pull a couple of different types of data, so i had it give me a simple script to get stuff out of alpha_vantage, yahoo finance, quandl, and a few kaggle datasets, and those generally worked out of the box, or close to. a few of those actually have code on their site for the API, but OpenAI made it faster. i would have gotten there eventually, but it saved me a couple of hours. anything more complicated and it gets messy. its like a genie who grants you exactly what you ask for in the most literal sense, and only has a 90% idea what you're talking about to begin with.