3 ms·

I tried throwing below programming problems at ChatGPT 1. Write a static file server in Go 2. Write Go code to convert Color image to B/W For both I got resu

I tried throwing below programming problems at ChatGPT 1. Write a static file server in Go 2. Write Go code to convert Color image to B/W For both I got results. I know both are simple but still it's fascinating that AIs can write code. I have written more about it here https://rohanrd.xyz/posts/surprising-capability-of-ai-code-generation/ https://rohanrd.xyz/posts/surprising-capability-of-ai-code-g...

twalla 4y ago
I wrote a similar prompt but for a discord bot that would take a youtube url and some timestamps and return a gif. Afterwards I asked it to add an option to "deep fry" the gif. Not only did it produce the correct code it also understood what I meant when referring to deep fried gifs. I was definitely impressed.
bradjohnson 4y ago
I threw a leetcode easy description into ChatGPT and submitted the solution without any editing. It passed all the test cases and got in the 95th percentile for efficiency of C++ submissions. I haven't tried anything more advanced, but to go from simple requirements to solution without any clarification or even method signatures (It guessed the correct method signature down to the name and input params) was pretty dang impressive to me.
- AnonymousPlanet 4y ago
  Chances are, you gave it a problem that was actually in its training set.
  - bradjohnson 4y ago
    It's still impressive to me even if it was in its training set. The data used for training is not stored verbatim in the OpenAI model. It would still need to parse the context anew and solve the problem given its understanding of the boundaries of what I've written.
- Dopameaner 4y ago
  On contrast, I did it for projecteuler and told it needs to be extremely efficient or math. Didnt give me an appropriate result.
i_hate_pigeons 4y ago
I have tried given a simple test suite and asking for an implementation that fulfills it, then asking to modify its impl and the test suite with a new requirement and it did it

twalla 4y ago

I wrote a similar prompt but for a discord bot that would take a youtube url and some timestamps and return a gif. Afterwards I asked it to add an option to "deep fry" the gif. Not only did it produce the correct code it also understood what I meant when referring to deep fried gifs. I was definitely impressed.

bradjohnson 4y ago

I threw a leetcode easy description into ChatGPT and submitted the solution without any editing. It passed all the test cases and got in the 95th percentile for efficiency of C++ submissions. I haven't tried anything more advanced, but to go from simple requirements to solution without any clarification or even method signatures (It guessed the correct method signature down to the name and input params) was pretty dang impressive to me.

AnonymousPlanet 4y ago
Chances are, you gave it a problem that was actually in its training set.
- bradjohnson 4y ago
  It's still impressive to me even if it was in its training set. The data used for training is not stored verbatim in the OpenAI model. It would still need to parse the context anew and solve the problem given its understanding of the boundaries of what I've written.
Dopameaner 4y ago
On contrast, I did it for projecteuler and told it needs to be extremely efficient or math. Didnt give me an appropriate result.

i_hate_pigeons 4y ago

I have tried given a simple test suite and asking for an implementation that fulfills it, then asking to modify its impl and the test suite with a new requirement and it did it