3 ms·
It's still surprising when you see it do something like this for the first time. I wrote a plugin to give ChatGPT access to execute plugins in a Docker contain
by dave1010uk 3y ago
It's still surprising when you see it do something like this for the first time.
I wrote a plugin to give ChatGPT access to execute plugins in a Docker container [0]. The first time it said something like "I'm going to use Python for this, oh, it's not installed, I'll install it now and run the script I just made", I was pretty amazed.
What I've come to realise is that although ChatGPT is excellent at telling _people_ how to interact with systems, it's not very good at interacting with them itself, as it isn't trained to understand it's own limitations. For example it knows people can run dmesg and look at the last few lines to debug some system problems. But if ChatGPT ran dmesg, the output would blow through the context window length and it'd get confused.
[0] https://github.com/dave1010/pandora https://github.com/dave1010/pandora
- dmix 3y agoI guess we'll need to train ChatGPT on millions of lines of bash history. Maybe some sort of augmented one that is pieced together with other context.
- reaperman 3y agoCompute scales quadratically with increasing context window sizes. It's not reasonable to achieve this with current network architectures.
- interstice 3y agoIt also has been largely trained on people talking about doing things and not actually on doing those things. I wonder if that kind of training data is being worked on now..