3 ms·
I don't think so for several reasons: 1. That's fairly obvious to people that have used it. I mean I guess there are a lot of people that have never used ChatG
by IshKebab 2y ago
I don't think so for several reasons:
1. That's fairly obvious to people that have used it. I mean I guess there are a lot of people that have never used ChatGPT and think it doesn't bullshit, but those people aren't behind the AI boom.
2. There are loads of applications where 100% accuracy isn't required (even if it would be nice!). Obvious example is GitHub Copilot. It saves me a ton of time overall even if I often have to fix its mistakes and bullshit.
3. I imagine like half of the AI research community is working on fixing this. And they don't need to get it to 0% bullshit, just less bullshit than humans (which tbf is sometimes a low bar!)
- staticman2 2y ago>And they don't need to get it to 0% bullshit, just less bullshit than humans Less bullshit than humans is a terrible goal. If you take the real estate industry examples, you want less bullshit than a really good real estate reference book, not less bullshit than random people on reddit.
- IshKebab 2y agoI didn't say which humans. Humans wrote that real estate reference book.
- staticman2 2y ago>I didn't say which humans. "which tbf is sometimes a low bar!"
- IshKebab 2y agoYes, sometimes. I'm not sure what your point is.
- ethagknight 2y agoI dont dispute the incredible capability, I'm simply concerned that true value creation that is being wildly overblown. Your 2nd example is a handy one to pick through. What % of your time is spent writing code compared to other work tasks? How much of that time did Copilot save? How much time do you have to spend fixing and validating (be honest, as if your quarterly bonus depends on it)? Whats your hourly rate? Whats the real cost of the high quality, cutting edge LLM (not the VC subsidized 'price'). And then.. does that mean you get to go to lunch early or didnt have to stay late? (no savings to your company). Or did it knock out a week's worth of work? What prevents Copilot from taking over your role completely ( I doubt it is anywhere close to that, you likely do a lot more than type out code, still requires the correct input and output validation, understanding goals with nuance and uncertainty) So then in real dollars, it's a useful, potentially very expensive tool. which is great. Is it $48B great (for google)? Maybe! But thats a big bet! I admit I do not understand the concept of researchers programming their models to be more accurate as questions progress from easy to esoteric, from 2+2=4 to "Should I avoid drinking corn syrup?" (ahem advertisers would like a word!) "which religion is better, A or B?" I dont see a way for AI to be unbiased and clean, and therefore trustworthy and useful at face value.
- IshKebab 2y ago> What % of your time is spent writing code compared to other work tasks? Probably 50%? > How much of that time did Copilot save? Unfortunately I can't use it at work, but I use it in my free time and I'd say it increases productivity by something like 10-50% depending on the task. 10% is more common of course, but given how expensive developer time is a Copilot subscription is worth it if it increases my programming productivity by like 0.5% which it easily exceeds. > And then.. does that mean you get to go to lunch early or didnt have to stay late? (no savings to your company). Or did it knock out a week's worth of work? My company would reap most of the benefit because they are paying me hourly. > What prevents Copilot from taking over your role completely ( I doubt it is anywhere close to that, Yeah basically it's nowhere near smart enough. Needs several orders of magnitude more intelligence before it could fully replace me. At that point I think society will have bigger problems because it will have replaced 90% of white collar jobs in general; not just programming. > I dont see a way for AI to be unbiased and clean, and therefore trustworthy and useful at face value. This also eliminates humans.
- ethagknight 2y agoAll great points, thanks. > Needs several orders of magnitude more intelligence before it could fully replace me. I think this is true for many applications of AI, where everyone assumes everyone elses job is screwed, but the expert looks under the hood and says 'well isn't that cute. delete it and start over.'