3 ms·
I’ve spent the day working in C++ with a popular, well known framework. Both ChatGPT and Claude have been horrible. They hallucinate APIs, they remove things th
by actsasbuffoon 2y ago
I’ve spent the day working in C++ with a popular, well known framework. Both ChatGPT and Claude have been horrible. They hallucinate APIs, they remove things that were already working for no apparent reason, they severely struggle with basic logic.
Even a big leap in model quality would still be dog shit at these kinds of tasks. I am vastly better at programming than even the best LLMs out there right now. The only real advantages they have over me are that they type a lot more quickly than I do, and their hourly rate is lower.
I’m not saying this is complete BS. I confess I feel a twinge of panic every time I see a headline like this. But years of working with these models and seeing how terrible they are for many tasks makes me skeptical that we’re suddenly about to get AGI.