6 ms·
On the flip side, I am having a great time charging enterprises exorbitant hourly rates to come in and help them fix their crappy crud programms. But I still d
by theK 4y ago
On the flip side, I am having a great time charging enterprises exorbitant hourly rates to come in and help them fix their crappy crud programms.
But I still don’t know if I am thrilled by the prospect of being called in to make their monkeypatched, GPT generated project work.
- hnfong 4y ago"Hey GPT-X: Can you refactor the codebase in gpt@monkeypatched-crap.git for me? Preferably in the style of gpt@crappycrud.git that I worked on last year."
- theK 4y agoToken cap will probably be the biggest problem here. After validation. After getting the changes to disk, documented, actually compiling, etc… But the biggest problem is that transferring the nuance that is external to the code base is typically really tiresome and lengthy grunt work and again token cap.
- anonzzzies 4y agoThey went from 4K to 32k in a few months. Wait a few years.
- Jensson 4y agoGPT-3 is 3 years old, not a few months.
- anonzzzies 4y agoSure but the token jump to 32k is new isn’t it? Even 8k to 32k is significant and that was this year.
- Jensson 4y agoYeah, but the jump to 32k didn't take a few months, it was years in the making. Otherwise you could extrapolate with "yesterday we had 4k, today we have 32k, tomorrow we will have 256k", that isn't how we do it. If we follow the same exponential pace 256k would have to wait 3 years, and even that is unlikely.
- osigurdson 4y agoI think it is better to assume that we are at the beginning of the s-curve, not the end.
- osigurdson 4y agoWow. I never expected to be downvoted for such a comment. Downvotes please elucidate as to why we are in the asymptomatic phase with LLMs.
- hnfong 4y ago"Luddites" refusing to accept that we might be onto something that is going to change humanity forever... The sad thing is that real luddites would go out and actively sabotage AI development because they think it's a real threat. Yet these people just makes bold and false claims in online forums and continue to move the goalposts once they're proven wrong. Sad. Pathetic. (and obviously, I don't mind being downvoted. Whatever! :)
- anonzzzies 4y agoSeems very man of these here for some reason, trying to find whatever reasons and ways (gonna be licensing mostly) to spread FUD.
- theK 4y agoFew years, yes. I’m with you “the change is coming” but we still need to transfer millions of tokens in and out to cater for context and out of repo intricacies.
- anon7725 4y agoLarge enterprises will just pay to fine tune over their documents/code/etc.
- riku_iki 4y agowe don't know what that jump means, did they increased model proportionally, or slapped some projection layer with quality degradation?..
- anonzzzies 4y ago> their monkeypatched You mean, like almost every outsourcing company pops over? So the type of code that infests companies who hired some sweatshop to do ‘some simple crud’? What’s the difference? Can you see the difference? Besides the gpt code will be far better commented as comments come for almost free with gpt while humans hate writing them.
- theK 4y agoI think you can trust the code of both those worlds exactly the same, not at all. I’ve seen GPT 3 and 4 hallucinate the most amazing commentary about their own output. Maybe we will get dependable, out of process, guidance at some point about how factual the model thinks it is on an output per output basis but until that point you should trust every LOC and comment exactly the same as code gifted to you by an adversary. My modest 2¢
- pms 4y agoExactly... and then the question becomes: why do I interact with an adversary?
- amrocha 4y agoI'm working on an outsourced codebase right now and boy, I wish they hadn't commented their code at all