3 ms·
I'm far from an AI booster, but I notice that the "AI-powered coding" goal posts keep moving as soon as something is accomplished. Ten years ago, if you showed
by ryandrake 3y ago
I'm far from an AI booster, but I notice that the "AI-powered coding" goal posts keep moving as soon as something is accomplished. Ten years ago, if you showed someone a text box where you could type "Write me a C++ Hello World program" and it actually would do it, it would have been considered wizardry. Then, it became "Well, sure... it can only write Hello World--what good is that?" Now, it's "Well, sure... it can do basic slider controls, who needs such a toy app?" What's next? "Oh, the full first person shooter game it conjured up from a prompt is generic and uncreative. Who would want to play that?"
- rafaelmn 3y agoI mean who cares about hypothetical benchmarks - when I try to apply these tools they fail more often than not. The only tool I can say I'm reliably using is Copilot context aware completions work very nicely and it's easy to get used to when it will be usefull and when it wont so it improves productivity. Copilot chat interface is terrible - I gues it tries to be stingy about the context tokens it's always so much hassle to get it to do anything useful - takes more explaining than doing a google search and read. ChatGPT is hallucinating so much, mostly in times you want it to hallucinate the least. I've tried using Midjurney and DALLE to generate placeholder art and memes - it's worse than ChatGPT. I've built stuff on top of the API and it's very inconsistent and falls apart at totally random unexpected places (not to mention undeterministic). I want these tools to work, but they are just so inconsistent and introduce so strange failure cases I'm not used to that it's just more trouble than worth over existing workflows.
- roflyear 3y agoI agree - largely. ChatGPT cannot program for me (it fails on anything that is a bit more complicated than very-common problems). It cannot write a good algo for me (unless the algo is a very standard one, if so, why do I need it to write it?). It gives incorrect information, a lot of the time. The docs it is trained on are outdated, many times methods, etc.. it suggests no longer exist, or the API endpoint has been deprecated. It doesn't seem to have a "sense of time" meaning it seems just as likely to suggest data from 10 years ago as data from 1 year ago. But there are some times, where something is behaving very strangely, and ChatGPT helps me work through it. Examples are complex SQL queries, quickly combining existing queries, oddities in CSS, etc.. It may not give super-accurate answers, but at least it gives something that I can work with or work on. I think this makes it a valuable tool, but it's not going to replace developers. Well, sure. Some people will just use ChatGPT rather than hire a programmer - I've worked with business owners who learned to code rather than hire programmers. I don't expect different results in either of these cases, the code will be very flawed, have huge security issues, and not be maintainable.
- rchaud 3y agoI don't think the goalposts have changed. Websites (not webapps) are one of the easiest things to automate because the patterns used are ultra-predictable. All the way back in 2017, there was a semi-vaporware startup called theGrid.io that was going to automate that using prompts. It went dark in 2020: https://news.ycombinator.com/item?id=22399357 https://news.ycombinator.com/item?id=22399357 GPT 3.5 should be able to handle this functionality easily on the basis of these demos yet a full-fledged product that does this has yet to make an appearance. Squarespace, Wordpress page builders should be all over this, yet they're not. Neither are any "disruptors" like Webflow. Maybe they know something that Hello World prototyper does not?
- solomonb 3y agoI think its totally reasonable to move the goalpost when it turns out the original goalpost didn't actually get you anything more then a 'gee-whiz' demo. If those old goalposts actually helped solve engineering and product needs then there would be huge praise for the achievements.