4 ms·

> If you are a software engineer, this will output your productivity ten fold on the upcoming years. Is this really true? I may be missing something (I probabl

by msm_ 4y ago

> If you are a software engineer, this will output your productivity ten fold on the upcoming years. Is this really true? I may be missing something (I probably am), but I didn't find much use for AI tools in my itsec/programming work. It's a nice tool to have, but I don't write that much boilerplate. I've tried to use it as a better Google, but it kept replying with made up nonsense (things I have problem with are usually niche technologies OpenAI is not good at - I expect it will get better in the future). So I find it dubious it will "10x my productivity" in the "upcoming years". Decades, maybe. But maybe the future really is now, and I'm just being an old-timer who can't adapt.

CuriouslyC 4y ago
There is already software to basically run unit tests on LLM output and re-run the prompt until it passes. As the models get better and the tooling improves, a lot of programming will become specifying constraints on the program you want, and letting the AI explore the latent space until it finds a solution, which you then evaluate before providing more detailed constraints until it does everything you want.
- rimliu 4y ago
  Where do you get those unit tests though?
  - frabcus 4y ago
    You get it to write them. Maybe in cucumber so you can check them / edit them by reading the English. Maybe you use a competitors model to write the tests as then less likely to make same error in code and tests, or write them twice and get best of three to spot errors.
SanderNL 4y ago
A lot of people are messing around with React and web-dev in general where you can fuzz component logic until it kind of looks OK. I can see that working out. If you want to do anything new or - god forbid - know of a better way to do things than what 90% of the population is doing (htmx?). Good luck.
ilaksh 4y ago
What exactly are you working on and which "AI tool" did you try? I will bet you $20 that GPT-4 (which can take 80kb of API docs or examples in the 32k model and is a very good programmer) if given reference info in your domain and a good prompt to think through the problem and solution step-by-step will be able to do very well. So the future is anyone with that model access (the 8k tokens could have 20kb of docs which is still useful) who wants to really try.

by msm_ 4y ago

CuriouslyC 4y ago

There is already software to basically run unit tests on LLM output and re-run the prompt until it passes. As the models get better and the tooling improves, a lot of programming will become specifying constraints on the program you want, and letting the AI explore the latent space until it finds a solution, which you then evaluate before providing more detailed constraints until it does everything you want.

rimliu 4y ago
Where do you get those unit tests though?
- frabcus 4y ago
  You get it to write them. Maybe in cucumber so you can check them / edit them by reading the English. Maybe you use a competitors model to write the tests as then less likely to make same error in code and tests, or write them twice and get best of three to spot errors.

SanderNL 4y ago

A lot of people are messing around with React and web-dev in general where you can fuzz component logic until it kind of looks OK. I can see that working out. If you want to do anything new or - god forbid - know of a better way to do things than what 90% of the population is doing (htmx?). Good luck.

ilaksh 4y ago

What exactly are you working on and which "AI tool" did you try? I will bet you $20 that GPT-4 (which can take 80kb of API docs or examples in the 32k model and is a very good programmer) if given reference info in your domain and a good prompt to think through the problem and solution step-by-step will be able to do very well. So the future is anyone with that model access (the 8k tokens could have 20kb of docs which is still useful) who wants to really try.