4 ms·
No, that’s not the line for AI skeptics. As far as I am concerned LLM offer little more than a cool tech demo. They suffer from the same failing that results
by Retric 4y ago
No, that’s not the line for AI skeptics.
As far as I am concerned LLM offer little more than a cool tech demo. They suffer from the same failing that results in AI art often suffering from basic flaws like extra arms. Better fakes aren’t closer to the actual solution they’re simply optimized for a different metric.
What seems revolutionary today is going to feel as useless as 3D TV’s once the novelty wares off.
- mdale 4y agoHmm have they not corrected the arm issue ? Won't the technology evolve to tackle it's shortcomings as it always has ? I don't think we complain about digital projection vs film the same way we did 20 years ago ?
- Retric 4y agoDifferent technology often wins even if it looks like old technology. The early EV’s as in 1900’s where using fundamentally flawed battery chemistry. Simply improving lead acid batteries wasn’t going to work. Similarly GPT45 is likely to have similar fundamental differences from current LLM’s.
- AnthonyMouse 4y agoA thing doesn't have to be perfect to be useful. For the same prompt it can generate an arbitrary number of images. Some of them will be useless garbage, but that doesn't matter if you can spend 30 seconds to throw those out and then keep the good one that would have taken someone half a day to produce by hand.
- Retric 4y agoI am specifically objecting to LLM’s rather than art because the output just isn’t useful to me. With art you can discard the output with a glance try again so it’s not a waste of time. With text however you’re stuck carefully checking for errors and there is going to be many many errs. Now most students might not care because the grading is generally lenient, but having say a PHD thesis, resume, or professional work riddled with subtle errors is a more serious problem. I personally just don’t see any real value in low quality output. The time I waste correcting it is longer than just doing it myself and maintaining your reputation is important so doing a poor job on unimportant things isn’t a good long term strategy. If you’re stuck at the level of “fiver” get good is just so much more valuable than get fast.
- tempestn 4y agoTangentially, I enjoy occasionally watching 3d movies at home and am disappointed that new TVs don't come with 3d when they pretty easily could. The glasses-free stuff that's coming is cool though. More substantively, LLMs are useful today, so even if they somehow don't improve at all, they're going to be impactful. In just the few months that we've had chatGPT it's saved me countless hours in work and even personal tasks, and I can see various ways it's going to be useful in the future. As one of the sibling replies says, it doesn't have to be perfect to be useful, and this is a tool with incredibly broad usefulness. (Admittedly unlike 3D TVs...)
- Retric 4y agoI agree 3D TV’s aren’t completely useless, which is how I view current LLM’s. There’s vary narrow utility in exactly the right context.
- newswasboring 4y agoWhat would an LLM look like which in your opinion went beyond a cool tech demo? Do you have a specific example/vision you can say? I'm asking because people's standards are quite different when it comes to evaluating emerging/new technologies.
- Retric 4y agoI don’t think LLM as a technology can get there, but I would happily be proven wrong. The issue is simply they quality of the output. I’ve tried several times and the output looks reasonable while being riddled with subtle errors. Unfortunately, being forced to look for subtle errors is more time consuming than simply doing it manually. One possibility might be improving the quality of the training data rather than aiming for such a huge bulk of amateur works. Unfortunately, there might not be enough quality writing to get an LLM to work.
- spaceman_2020 4y agoGPT-4 has helped a rank noob like me build an app that's far beyond my capabilities. Maybe the code isn't perfect, but all I wanted was to take something live, and it's accelerated that process by months. To me, it already feels far beyond a cool tech demo.
- Retric 4y agoThat’s exactly the kind of task they excel at, they can also help someone write school essays. My objection is the end quality seems stuck at that level. They’re great at crossing the just barely acceptable level but make it harder to reach excellence by for example having many subtle bugs. Which I suspect comes from their training set. Their training sets are simply dominated by amateur efforts.
- spaceman_2020 4y agoHow can you assert that the end quality is stuck at the same level when we literally had a massive leap in quality within 4 months? chatGPT with 3.5 was released in November 2022. 4 in March 2023. Massive leap in quality between the two relases.
- pmoriarty 4y agoNot just school essays. They're already outcompeting professional writers[1], to list just one of countless examples where people are finding them useful. [1] - https://www.reddit.com/r/freelanceWriters/comments/12ff5mw/it_happened_to_me_today/ https://www.reddit.com/r/freelanceWriters/comments/12ff5mw/i...
- Retric 4y agoAI has already replaced a lot of writers when quality is irrelevant. The AP started doing so in 2014: https://www.ap.org/discover/artificial-intelligence https://www.ap.org/discover/artificial-intelligence “Today he emailed saying that although he knows AI’s work isn’t nearly as good as mine, he can’t ignore the profit margin.”
- 4y ago