4 ms·
Hundreds of comments. Some say LLMs are the future. Others say they don't work today and they won't work tomorrow. Videogame speed running has this problem s
by Verdex 1y ago
Hundreds of comments. Some say LLMs are the future. Others say they don't work today and they won't work tomorrow.
Videogame speed running has this problem solved. Livestream your 10x engineer LLM usage, a git commit annotated with it's prompt per change. Then everyone will see the result.
This doesn't seem like an area of debate. No complicated diagrams required. Just run the experiment and show the result.
- dbalatero 1y agoI'd honestly love to see this. People always say "you just need to learn to prompt better" without providing any context as to what "better" looks like. (And, presumes that my prompt isn't good enough, which maybe it is maybe it isn't.) The easy way out of that is "well every scenario is different" - great, show me a bunch of scenarios on a speed run video across many problems, so I can learn by watching.
- theshrike79 1y agoIt's because you get to the No True Scotsman -thing pretty fast. If I use LLMs to code, say a Telegram bot that summarise the family calendars and current weather to a channel - someone will come in saying "but LLMs are shit because they can't handle this very esoteric hardware assembler I use EVERY DAY!!1"
- lomase 1y agoBut... do you know anybody who will give me 50k a year to write telegram bots for them?
- theshrike79 1y agoIt's not like every single problem you face at work is breaking new ground and exploring unknown reaches of computer science. If so, please hire me. You will be writing CRUD operations and slapping together web apps on every level of experience. Even in (mobile) gaming there you're repeating the same structures as every game before. Not a 100% of the time, but way more than 50%.
- dbalatero 1y agoI'd like to think I could dismiss those responses and still learn something from a collection of samples.
- weddpros 1y agoAI Coding is becoming an edge, and sharing your edge isn't the wisest thing to do, even more so when doubt is so prevalent!
- mrkeen 1y agoIt's not your edge anymore. It's AI's. And how is TFA any different?
- Verdex 1y agoExtremely doubtful. This thread has hundreds of comments where people are screaming that everyone needs to learn AI coding. If it was such an edge would they not otherwise keep quiet?
- wiseowise 1y agoBecause there are forces that are trying to kill the momentum. Imagine that there was a serum that gives you superhuman strength only under specific conditions that you’re supposed to discover. Then there’s half room who screams that it should be banned, because it is cheating/fake/doesn’t work. And there’s another half room that swears by it, because they know how to utilize it properly. You know it works and you don’t want to give up your secret sauce or make another half of the room stronger.
- quikoa 1y agoThere are many billions of dollars at stake to try and gain momentum. That's just the direct investment from the AI companies. The entire tech sector wants it to succeed so they can save on salary from expensive engineers.
- wiseowise 1y agoParaphrasing the article: I don’t care, it makes me productive and allows me to enjoy work again and deliver business value.
- M4v3R 1y agoI literally do this about twice a week on Twitch. I’m working on some hobby projects, and one constraint I’ve put on myself is to use LLMs for pretty much everything, regardless of whether it saves me time or not. The reason is twofold: I want to learn how to use them efficiently, and I want to constantly test the waters to see where the limits of their capabilities are. On my stream, you can see LLMs fail spectacularly one time and do hours of work in minutes another time. I’m not alone in this - there are tons of other examples of people showing how they use LLMs online; you just need to search for them.
- Verdex 1y agoThanks. I'll give them a watch.
- chinchilla2020 1y agoAgreed. The article provides zero measurement, zero examples, zero numbers. It's pure conjecture with no data or experiment to back it up. Unfortunately conjecture rises to the top on hackernews. A well built study on LLM effectiveness would fall off the front page quickly.
- blendaddict 1y agoThe Primeagen did this. He locked himself in for 7 weeks and tried to build a game by only using cursor. The videos are more entertainment style but this is the closest thing i know of https://www.youtube.com/watch?v=6x3weFV9YI4 https://www.youtube.com/watch?v=6x3weFV9YI4