3 ms·

This is significantly worse than ChatGPT with GPT-4 for coding. I had an example from last week where I wanted to write a script to delete excess AWS AMIs based

by mdeeks 3y ago

This is significantly worse than ChatGPT with GPT-4 for coding. I had an example from last week where I wanted to write a script to delete excess AWS AMIs based on some tags of ours. Then modified it to bucket them by a tag value and keep the last ten of each bucket. Then parallelize it so it is fast (we had 50k of them, oops). ChatGPT was able to completely write this perfectly. Absolutely mind blowing. Saved me probably 1-2 hours of looking things up and fiddling with it. Bard failed multiple times in multiple places. It only found AMIs that exactly, down to the second, were two weeks old. The filter json looks wrong ('Key' isn't valid AFAIK). It didn't bucket them and just kept the newest 10. In either case both of these are mind blowing. If ChatGPT didn't exist, Bard would still be very helpful at getting me started. ChatGPT did it all without me making any changes though. ChatGPT log: https://gist.github.com/mdeeks/de297f1bc8cbd00fe2db01e6232aa20b https://gist.github.com/mdeeks/de297f1bc8cbd00fe2db01e6232aa... Bard log: https://gist.github.com/mdeeks/1404e09da8879b94469166927ddff66e https://gist.github.com/mdeeks/1404e09da8879b94469166927ddff...

gremlinsinc 3y ago
Have you tried phind.com? Besides Codeium (vscode extension) this is my goto for code questions. They have some magic sauce, always better than bing, sometimes I go back to gpt4 just to say hey, and for times where i want to save a thread...
- mdeeks 3y ago
  With their default model it did extremely badly with my question to build this script. It wasn't even close to right. When I changed it to "Use Best Model" it gave a very good response but I'm pretty certain it was just piped to OpenAI GPT-4. My prompt: Write a python script for me that deletes AMIs from AWS that I own which have the tags role=bento-remote and bento_image_type=profile. It should bucket the AMIs by another tag called profile. It should delete images older than 14 days but always keep the 10 most recent even if they are older than 14 days. It should print the name of the AMI it is about to delete. It should run the deletes in parallel so it is fast.
  - FieryTransition 3y ago
    My hunch is that they combine it with some kind of web crawl and index for source reference, I've used both gpt4 and phind, and find phind better for tasks like api exploration and questions for typical sample programs and error messages for that reason.

by mdeeks 3y ago

gremlinsinc 3y ago

Have you tried phind.com? Besides Codeium (vscode extension) this is my goto for code questions. They have some magic sauce, always better than bing, sometimes I go back to gpt4 just to say hey, and for times where i want to save a thread...

mdeeks 3y ago
With their default model it did extremely badly with my question to build this script. It wasn't even close to right. When I changed it to "Use Best Model" it gave a very good response but I'm pretty certain it was just piped to OpenAI GPT-4. My prompt: Write a python script for me that deletes AMIs from AWS that I own which have the tags role=bento-remote and bento_image_type=profile. It should bucket the AMIs by another tag called profile. It should delete images older than 14 days but always keep the 10 most recent even if they are older than 14 days. It should print the name of the AMI it is about to delete. It should run the deletes in parallel so it is fast.
- FieryTransition 3y ago
  My hunch is that they combine it with some kind of web crawl and index for source reference, I've used both gpt4 and phind, and find phind better for tasks like api exploration and questions for typical sample programs and error messages for that reason.