2 ms·

I'm curious to see how this works, in practice. I notice poorer performance just with plugins enabled. Making the context hyper specific seems to be the best wa

by nomel 3y ago

I'm curious to see how this works, in practice. I notice poorer performance just with plugins enabled. Making the context hyper specific seems to be the best way to get it to perform (understandably), and this is a large, fairly diverse, prompt. > and do not say anything else. Is a bit frustrating. I assume the ambiguity here will really harm the conversation, if a refusal is hit. It suggests my suspicion that it's best to resubmit/start over, on refusal . > namespace dalle { This looks like it's being passed to the Dalle system. If so, burning up tokens like this is interesting. I would naively assume this could be be handled in Dalle, but maybe there's a performance gain if ChatGPT is made aware of the Dalle prompt?

bugglebeetle 3y ago
The data analysis plug-in falls over for even basic CSV file parsing. I tried it a couple times and it was a nonstop cavalcade of “sorry, I had an error.” It’s far easier to get it to write the Python, R, etc code for whatever analysis task you want accomplished.
- simonw 3y ago
  Interesting - my experience has been the opposite of that, I've found that ChatGPT Code Interpreter / Advanced Data Analysis is wildly effective at parsing anything I give it. Not just CSV either - I've uploaded random binary files and told it to figure out what they are and it often gets there after churning through a few iterations.
  - bugglebeetle 3y ago
    My experience was trying to get it to generate some charts from some fairly basic CSV inputs. It failed numerous times and would change the chart formatting when it was asked for a revision (e.g. from horizontal to vertical), even though that was not what was being requested. I hate doing matplotlib stuff, so I was hoping this could be more automated, but prompting it to create and tweak the corresponding code to do this seems to be far more efficient. It did seem to do OK when prompted with both the CSV file and some code for chart creation, but that kind of defeats the purpose of the plug-in, IMO.
- emptysongglass 3y ago
  Not being able to fetch packages from PyPi is not great either. And for some reason it doesn't have pytest?
  - spdustin 3y ago
    You can upload wheels...just ask ChatGPT to manually install them. And note that Advanced Data Analysis pods are running Python 3.8
spdustin 3y ago
The reason I track all those system prompts is due to the way they affect attention when using custom instructions. Having a system message that's already 2,700+ tokens before adding custom instructions is a tough hill to climb.

by nomel 3y ago

bugglebeetle 3y ago

The data analysis plug-in falls over for even basic CSV file parsing. I tried it a couple times and it was a nonstop cavalcade of “sorry, I had an error.” It’s far easier to get it to write the Python, R, etc code for whatever analysis task you want accomplished.

simonw 3y ago
Interesting - my experience has been the opposite of that, I've found that ChatGPT Code Interpreter / Advanced Data Analysis is wildly effective at parsing anything I give it. Not just CSV either - I've uploaded random binary files and told it to figure out what they are and it often gets there after churning through a few iterations.
- bugglebeetle 3y ago
  My experience was trying to get it to generate some charts from some fairly basic CSV inputs. It failed numerous times and would change the chart formatting when it was asked for a revision (e.g. from horizontal to vertical), even though that was not what was being requested. I hate doing matplotlib stuff, so I was hoping this could be more automated, but prompting it to create and tweak the corresponding code to do this seems to be far more efficient. It did seem to do OK when prompted with both the CSV file and some code for chart creation, but that kind of defeats the purpose of the plug-in, IMO.
emptysongglass 3y ago
Not being able to fetch packages from PyPi is not great either. And for some reason it doesn't have pytest?
- spdustin 3y ago
  You can upload wheels...just ask ChatGPT to manually install them. And note that Advanced Data Analysis pods are running Python 3.8

spdustin 3y ago

The reason I track all those system prompts is due to the way they affect attention when using custom instructions. Having a system message that's already 2,700+ tokens before adding custom instructions is a tough hill to climb.