4 ms·

Not sure about the "when" part since current models can't write anything useful. Adapted snippets from popular plain old Google search results is all I've gotte

by d_tr 2y ago

Not sure about the "when" part since current models can't write anything useful. Adapted snippets from popular plain old Google search results is all I've gotten, often with glaring errors. But I often get answers faster this way, compared to doing a plain search, so they've been useful for me.

johannes1234321 2y ago
We can argue about "useful" but trivial CRUD applications can be done by ChatGPT with just little prompt engineering skills. At some complexity it has trouble with size of the context, but there is lots of trivial CRUD programming out there, where efficiency can be massively increased.
ben_w 2y ago
I get generally useful stuff, but 150 line scripts that are 95% right in a language that isn't my day job, that kind of thing. Useful, but not useful enough to do my job for me, as most of the hard work is fitting into an existing large codebase with its own style, architecture, private libraries etc., or where I'm making a UI fit a design doc that the AI can't really see despite having some textual representation of the design as well as the UI code. Fortunately for me, 128k token context windows aren't enough to fit a 120 kloc project, and the haystack demos don't fully reflect the needs. But 5 years ago, the best we had was GPT-2 / AI Dungeon, so I'm just going to keep saving and plan around not being able to get a next job — even if I'm being fooled by a Clever Hans, I'd still get early retirement.
coffeebeqn 2y ago
The main problem is that each answer is a randomized new one. There’s no logical through-line and the more entries you create with it the more nonsensical the system becomes. It’s like a junior developer with amnesia It looks to work fine on a one-off single script thing. Which is marginally useful sometimes. I did create my company single page html site with it because I didn’t really care about it and just needed it for a bank to believe I’m selling services.

by d_tr 2y ago

johannes1234321 2y ago

We can argue about "useful" but trivial CRUD applications can be done by ChatGPT with just little prompt engineering skills. At some complexity it has trouble with size of the context, but there is lots of trivial CRUD programming out there, where efficiency can be massively increased.

ben_w 2y ago

I get generally useful stuff, but 150 line scripts that are 95% right in a language that isn't my day job, that kind of thing. Useful, but not useful enough to do my job for me, as most of the hard work is fitting into an existing large codebase with its own style, architecture, private libraries etc., or where I'm making a UI fit a design doc that the AI can't really see despite having some textual representation of the design as well as the UI code. Fortunately for me, 128k token context windows aren't enough to fit a 120 kloc project, and the haystack demos don't fully reflect the needs. But 5 years ago, the best we had was GPT-2 / AI Dungeon, so I'm just going to keep saving and plan around not being able to get a next job — even if I'm being fooled by a Clever Hans, I'd still get early retirement.

coffeebeqn 2y ago

The main problem is that each answer is a randomized new one. There’s no logical through-line and the more entries you create with it the more nonsensical the system becomes. It’s like a junior developer with amnesia It looks to work fine on a one-off single script thing. Which is marginally useful sometimes. I did create my company single page html site with it because I didn’t really care about it and just needed it for a bank to believe I’m selling services.