5 ms·
Using AI to teach how to code, remember you still need to think for yourself
- gnabgib 3y agoMight the article's `<title>` block be better than this (presumably; length constrained) edit: Think for yourself if you want AI to teach you how to code
- deleted 3y ago[deleted]
- vinceguidry 3y agoA friend of mine was trying to tell me how much different Ruby 3 was from Ruby 2, he's never even worked with Ruby, and I said that it's not nearly as big as the difference between Python 2 and 3. He sent me this hilariously wrong transcript where the bot tried to claim that Ruby 3 changed the class keyword to something else. Not a single one of the bullet points was anywhere even close to being true.
- simonw 3y agoDo you know which bot he was using? That's the kind of question I would expect to see wild differences between LLMs - ChatGPT 3.5 v.s. ChatGPT 4 for example I would expect to produce very different levels of quality. That said, it's a bad idea to try to use the output of ANY LLM as a primary source in this kind of conversation. Distrust and verify!
- Zambyte 3y ago> That said, it's a bad idea to try to use the output of ANY LLM as a primary source in this kind of conversation. Distrust and verify! People used to say the same thing about the web. It seems like people are unfortunately very bad at being skeptical right now.
- paulryanrogers 3y agoPeople who said the web was untrustworthy were being reductive. IME late 90s high school, they taught us the Internet is like any source, you have to rely on data or at least expert sources and cite them.
- wolverine876 3y ago> IME late 90s high school, they taught us the Internet is like any source, you have to rely on data or at least expert sources and cite them. Do you see people doing that now? I don't. People overwhelmingly believe, repeat, or just blithely fabricate nonsense - the latter really is amazing to see. In a recent HN thread someone confidently wrote a few paragraphs explaining some physiology. That sat up there for maybe a day, and it was easy to believe. Then a researcher in the field explained it, and the first person was very wrong (the researcher was very polite).
- hnfong 3y agoThe important point IMHO isn't about being skeptical, but having the ability to verify the claims, or if not, at least having a good heuristic to detect bullshit (eg. by checking whether it contradicts with something you already know). Just being skeptical without some way to allow good information to flow through the filter makes one close-minded.
- CuriouslyC 3y agoIt helps if you ask the bot to note reputable people in the field and reference original sources for anything significantly outside of common knowledge. That gets you leads for further information and also reduces hallucination somewhat too.
- CharlesW 3y agoI have a friend who also relishes sharing these kinds of antidotes, and seems to have decided that AI-augmented coding is a bridge too far. Personally, I worry that this is a cut-off-your-nose-to-spite-your-face response, and that he'll be unhirable sooner than he expects.
- vinceguidry 3y agoI wouldn't have any of these anecdotes if this friend didn't keep pushing horrible 'bot-takes' on me. My issue isn't with what GPT tools are actually useful or not useful for, they're just tools, but with idiots who think typing in a query to save 5 minutes of Googling and actually reading results to get a quick overview of a topic, especially on a topic that I have some familiarity with. He seems to think the bot is smarter and more useful than actual human knowledge. Oh and the other problem I have with it is that you have to wade through endless pages of gpt-trash when you do try to use a search engine to get an answer to a question now.
- CharlesW 3y ago> Oh and the other problem I have with it is that you have to wade through endless pages of gpt-trash when you do try to use a search engine to get an answer to a question now. True, and most people don't realize how bad it's going to get. We're still in the honeymoon period where most content on the internet is human-created, but machine-generated content will be the vast majority of online content by the end of the decade.
- maroonblazer 3y agoIt's also worth pointing out that if an LLM gives you code that works, but you can't understand why it works, asking it to explain what each line is doing is remarkably effective.
- logicprog 3y agoBut if you don't already understand the code and the concepts, you have no way of knowing if it's actually giving you accurate information or just hallucinating or confabulating. That's my fundamental problem with the entire idea of using llms to Aid with this kind of stuff, it's not easy to check it carefully enough unless you already know enough about the topic that you could have just done what you asked it to do faster if you type fast enough, especially considering the amount of time you'll probably have to spend arguing with it and refining the prompt and clarifying and thinking through the logic in detail anyway.
- Verdex 3y agoMy ongoing hypothesis is that LLMs are leveraging inherit structure in natural language to cheat. Apparently if you embed a large enough corpus you can do algebra with the semantic value of words. King - Queen gives you a vector that when applied to Man gives you Woman. Great our language has structure. This makes sense because people are going to want to communicate in a way that mirrors the structure of the problems that we often encounter. Kind of an information theory frequent messages should be short kind of thing. Then we see all these people trying to crack prompt engineering. And we see some people raving about how they're using LLMs to do so much amazing work and others keep getting back nonsense garbage. My conclusion is that some people are just more synced with the social ziegiest, which is also embedded into LLMs. By talking to the LLM the right way, they're dumping in additional structure about the problem they want to solve. Which means I expect non-experts (or experts who don't sufficiently internalize the jargon) to get noticably worse results just because they don't know how to talk "right". Not only will non-experts be unable to interpret results. But they also can't formulate questions or requests that the LLM will be able to give good results to in the first place. [I would love to see some one run a study on this.] Also, not every problem we face has a structure amendable to natural language. Or they're too niche to have a sufficiently large corpus of natural language and jargon for LLMs to consume. It would be really interesting to see if we can sort problems in this way. But I suspect disappointment from people trying to use LLMs on certain problems even if they are experts who can talk the talk.
- johnea 3y ago[flagged]
- fknnoob 3y agoAs if I could get copy pasted code to not error without a few thoughts of my own.
- cwkoss 3y agoCoding with AI has been amazing. I am a pretty 'mid' software developer generally, have been working as a PM for the last 3 years so have gotten rusty. Got laid off in December. In about 60 hours of work, I've built a MVP React webapp that is hosted on githubpages, uses firebase for a serverless backend, and integrates with OpenAI APIs to turn user requests into structured JSON that serves as a starting point for the users without having to code the complex logic manually. Just used ChatGPT4 to figure out how to get a domain working with my githubpages hosting (turns out I skipped a step when I read the docs - and DNS issues can be confusing). Each of those steps had me running into frustrating bugs that I could have spun my wheels on for hours - with ChatGPT4, it didn't always identify the fix immediately, but I was able to debug so much faster, usually resolving the issue in about 30 minutes. More than the time savings, I really appreaciate the effect it has on morale for me: I hate being stuck on a problem and not knowing what to try next. It feels like I have a senior engineer who I can slack a question and get a thoughtful response inhumanly fast at any time of day (even when coding at 2AM). ChatGPT 4 has been a lot more helpful to me that Copilot, but I might just not know how to get the most out of copilot yet. Copilot is really nice for jumping past writing boilerplate, but ChatGPT 4 can synthesize entire solutions that span multiple files, which I haven't had success getting from copilot. What's even cooler is that I had never even touched React before 3 weeks ago, and now feel like I'm moderately fluent in the general design principles. If I was doing self-directed study of React starting from the docs, I probably would still be playing with toy hello world problems, but instead I've gotten the project I was hoping to build to a viable prototype. One source of delight is using AI to synthesize dictionary data. I have a bunch of ingredients that users choose from and being able to "autocomplete" a solid initial draft for new dict entries feels like magic. --- If you want to see what I built, or are in the Seattle area and want to try out AI-powered natural skincare formulation, here's my shameless plug: https://skincremental.com/ https://skincremental.com/ The core is all working and good enough, but probably have another week to get it to where I think it'll be ready to start doing some marketing.
- deleted 3y ago[deleted]
- cwkoss 3y agoAnyone have good tips for getting more out of copilot?
- deleted 3y ago[deleted]
- jacques_chester 3y agoI've been grinding Leetcode lately and I've discovered that AI can oftentimes give a better explanation of a solution than Leetcode does. I can also followup questions without scanning through forum posts in hope someone was as confused as I was. I'm not asking LLMs to write code for me in this scenario -- I need to get by in interviews without AI assistance. But as a personal tutor it is turning out to be helpful.
- HPsquared 3y agoFor language learning (as in, natural languages), I've found LLMs work very well in a similar "tutor" role. Asking about the grammar in a sentence, for example, or how concepts relate to each other. Somehow it works really well.
- wolverine876 3y agoHow do you know the AI explanation is accurate? 'Plausible' and 'accurate' can be very different - the GPTs are built for plausibility, to say what everyone else is saying (statistically).
- jacques_chester 3y agoI cross-reference with the Leetcode editorial and some staring hard at code.
- scarecrw 3y agoI work with students learning to code, some of whom use AI in various ways. I can definitely see AI becoming a valuable tool for them in the future, but most students are currently ill-equipped to take advantage of it. The most common error I observe from students is not providing sufficient information to get useful results. They'll omit what language or libraries they're intending to use, or restrictions on the set of language features they are or are not familiar with. Because of this, they'll get confident, often correct, responses, which are entirely unhelpful for the work they're doing. The other issue they'll run into is over- or underestimating the capabilities of tools like ChatGPT. The first time they run into a problem which it isn't immediately able to solve they often give up on using AI as a tool entirely. I do think AI has value for learners, primarily in an "explainer" role. Allowing students to take a piece of code and ask "what does this do" to get a plain English explanation is extremely powerful. It also can act as a substitute for documentation, as new learners are often disinclined to parse through official documentation, which is rarely beginner-friendly.
- th0ma5 3y agoThe mechanisms in improving LLM code output do not correlate to better understanding of systems or even LLMs for that matter. For language I think you're more correct in your view for sure.
- spaceman_2020 3y agoI've been using AI for a LOT of work, from coding to image generation. Some thoughts: 1. Midjourney v6 is absolutely fantastic for creating editorial images and brand images. Better than A-tier. Some of the output you can get from it beats the top agency talent I've worked with. You will have to prompt multiple times and it's not magic, but given the cost and time of quality photography and graphic work, it's very cheap and efficient. 2. ALL text generation is B or C-tier at best. It's fine if you want filler content, but I would never trust any AI tool to actually write on my behalf. 3. BUT, this cookie cutter writing style is perfect for most dull corporate speak - press releases, corny tweets, boring videos. It's also perfect for customer support. I expect practically all corporate social media accounts, press releases, etc. to be written by AI. 4. Coding is good until you run into performance or security issues. That said, you can get a MASSIVE productivity boost. It's also great for prototypes and stuff that doesn't need to immediately scale or be heavily performant. 5. Video is a long, long way off from anything close to production At present, Midjourney is far ahead of the pack when it comes to image generation. If you haven't seen it yourself, please sign up for a basic subscription and check out their /explore tab. Even if you see it as an art feed, it's incredible work. For coding, the best I've seen is a combination of a custom GPT like Grimoire on the chatGPT store, plus an IDE with a built-in AI prompt, like Cursor.
- dartos 3y agoMaybe I work in stacks not present in the training set, but the code I get from chatgpt is awful. Often convoluted, rarely easy to read. Sometimes it’s not even valid. Copilot is pretty good at predicting what I was about to type thought. It’s great for configs or repeating data structures
- spaceman_2020 3y agoRaw chatGPT is indeed getting pretty poor at coding, even GPT-4. Grimoire has been excellent for me. But then again, my stack likely has more training data than anything out there (Javascript)
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- squigglydonut 3y agoNah hand-coded will become a bespoke practice. Machine code will be cheaper and efficient but worse quality
- dukeyukey 3y agoIf it's cheaper, more efficient, can be maintained with AI and (most importantly) it works, where does quality come into it?
- squigglydonut 3y agoWhat does quality mean to you?