4 ms·
> The big difference with LLM AIs is they never graduate to an experienced staffer, they are always the idiot savant that is really dang smart but also clueless
by Alex3917 2y ago
> The big difference with LLM AIs is they never graduate to an experienced staffer, they are always the idiot savant that is really dang smart but also clueless and needs to be observed.
Basically this. They already have vastly better-than-human ability at finding syntax errors within code, which on its own is quite useful; think of how many people have probably dropped out of CS as a major after staying up all night and failing to find a missing semicolon.
- lionkor 2y agoI don't know of a single person who got so stuck on syntax errors that they quit
- FroshKiller 2y agoAdded to which we already have tools that are great at finding syntax errors. They're called compilers.
- Philpax 2y agoCompilers can detect errors in the grammar, but they cannot infer what your desired intent was. Even the best compilers in the diagnostics business (rustc, etc) aren't mind-readers. A LLM isn't perfect, but it's much more capable of figuring out what you wanted to do and what went wrong than a compiler is.
- lionkor 2y agonone of that is a syntax issue, though, that's semantics
- bsenftner 2y agoTry being a TA to freshmen CS majors; a good 1/3 change majors because they can't handle the syntax strictness coupled with their generally untrained logical mind. They convince themselves it is "too hard" and their buddies over in the business school are having a heck of a lot of fun throwing parties...
- cesaref 2y agoSounds like CS is not for them, and they find something else to do which is more applicable to their skills and interest. This is good. I don't think you should see a high drop out rate from a course as necessarily indicating a problem.
- Philpax 2y agoLosing potentially good talent because they don't know how or where to look for mistakes yet is foolhardy. I'm happy for them to throw in the towel if the field is truly not for them, but I would wager that a not-insignificant portion of that crowd would be able to meaningfully progress once they get past the immediate hurdles in front of them.
- jprete 2y agoGiving them an LLM to help with syntax errors, at this stage of the tech, is deeply unhelpful to their development. The foundation of a computer science education is a rigorous understanding of what the steps of an algorithm mean. If the students don't develop that, then I don't think they're doing computer science anymore.
- deleted 2y ago[deleted]
- Philpax 2y agoThe use of a LLM in this case is to show them where the problem is so that they can continue on. They can't develop an understanding of the algorithm they're studying if they can't get their program to compile at all.
- Alex3917 2y ago> Giving them an LLM to help with syntax errors, at this stage of the tech, is deeply unhelpful to their development. I mean if the alternative is quitting entirely because they can't see that they've mixed tabs with spaces, then yes, it's very very helpful to their development.
- bilsbie 2y agoHi. Now you do. I dropped out of cs half because I didn’t enjoy the coding because they dropped us into c++ and I found the error messages so confusing. I discovered python five years later and discovered I loved coding. ( the other half of the reason is we spent two weeks designing an atm machine at a very abstract level and I thought the whole profession would be that boring.)
- deleted 2y ago[deleted]
- fire_lake 2y agoSyntax checking is not an “AI” problem - use any compiler or linter.
- rsynnott 2y ago… One odd thing I’ve noticed about the people who are very enthusiastic about the use of LLMs in programming is that they appear to be unaware of any _other_ programming tools. Like, this is a solved problem, more or less; code-aware editors have been a thing since the 90s (maybe before?)
- torginus 2y agotrue.. in the past few days I used my time off to work on my hobby video game - writing the game logic required me to consider problems that, are quite self-contained and domain specific, and probably globally unique (if not particularly complex). I started out in Cursor, but I quickly realized Claude's erudite knowledge of AWS would not help me here, but what I needed was to refactor the code quickly and often, so that I'd finally find the perfect structure. For that, IDE tools were much more appropriate than AI wizardry.
- Alex3917 2y ago> code-aware editors have been a thing since the 90s These will do things like highlight places where you're trying to call a method that isn't defined on the object, but they don't understand the intent of what you're trying to do. The latter is actually important in terms of being able to point you toward the correct solution.
- dgfitz 2y agoI know a lot of people who dropped out of CS in college. Not a single one dropped out because of a semicolon syntax issue.
- CalRobert 2y agoI spent 8 hours trying to fix a bug once because notepad used smart quotation marks (really showing my age here - and now I'm pretty annoyed that the instructor was telling us to use notepad, but it was 2001 and I didn't know any better).
- dgfitz 2y agoI did something like that once too, a long time ago. And because of that I see syntax errors of such I’ll within seconds now, having learned once the hard way.
- CalRobert 2y agoI also know how important the right tools are. I should’ve been using vi.
- dgfitz 2y agoIt amuses me to no end: in college I was a total emacs person, and now I’m a total vi person. There might be dozens of us! I think both editors have their flaws, I just know the native vi keybindings better at the moment.
- CalRobert 2y agoEither of them would've made the problem obvious! This was about a million years ago. I had just installed a pirated copy of Windows XP (FCKGW-RHQQ2...) and was in the first quarter of my physics degree, taking a class in C. Different times....
- raincole 2y ago> think of how many people have probably dropped out of CS as a major after staying up all night and failing to find a missing semicolon. ... like a dozen? And in 100% cases it's their teacher's fault.
- layer8 2y agoThey are still worse at finding syntax errors than the actual parser. And at best they could be equally good. So what’s the point?