44 ms·

I don't get how they're in the "Low" category for model autonomy. "Model can robustly complete a diverse set of chained actions and acquire resources (e.g., sp

by tinco 3y ago

I don't get how they're in the "Low" category for model autonomy. "Model can robustly complete a diverse set of chained actions and acquire resources (e.g., spin up an AWS instance, complete a Fiverr task) OR model, with basic scaffolding, can use off-the-shelf software to execute well-specified coding tasks on a standalone, toy, or handcrafted repository" With very basic scaffolding, the GPT models tick basically all these boxes. It's wild that on what's in my opinion the most dangerous aspect of models today, they're starting off underestimating their models this badly. Making GPT do these things autonomously is so easy a VC did it in his spare time in a couple weeks time. Do the people who are working on this document have a full overview of how their software is being used in the wild?

SiempreViernes 3y ago
Well, given what ee know from when roughly the entirety of OpenAI publicly voted with their feet on the question "safety or profit?" it seems unsurprsing that they seem unconcerned about safety in their actual work...
mihalycsaba 3y ago
Is there something that can make gpt do these things reliably? I tried autogpt 0.4 (maybe 0.3) it spent almost an hour until it figured out it's not running on a .deb system. It really couldn't do anything more complex than a few lines of python or some basic google search. Maybe there are better tools or the latest autogpt is better?
- tinco 3y ago
  You have to invest some time into making it able to solve speicifc kinds of problems. I haven't used AutoGPT in a while because I'm working on my own agent. That it spent an hour figuring out it wasn't running on a Debian based system means it obviously didn't have a very good way of challenging its own assumptions. With GPT4 there's really not an excuse for an autonomous agent not to be able to challenge its own assumptions when things go wrong, I have no idea of AutoGPT is good at that sort of thing, I suppose it depends on what direction their team is pushing the development.
ganzuul 3y ago
It's just depressingly hard to survive.

by tinco 3y ago

SiempreViernes 3y ago

Well, given what ee know from when roughly the entirety of OpenAI publicly voted with their feet on the question "safety or profit?" it seems unsurprsing that they seem unconcerned about safety in their actual work...

mihalycsaba 3y ago

Is there something that can make gpt do these things reliably? I tried autogpt 0.4 (maybe 0.3) it spent almost an hour until it figured out it's not running on a .deb system. It really couldn't do anything more complex than a few lines of python or some basic google search. Maybe there are better tools or the latest autogpt is better?

tinco 3y ago
You have to invest some time into making it able to solve speicifc kinds of problems. I haven't used AutoGPT in a while because I'm working on my own agent. That it spent an hour figuring out it wasn't running on a Debian based system means it obviously didn't have a very good way of challenging its own assumptions. With GPT4 there's really not an excuse for an autonomous agent not to be able to challenge its own assumptions when things go wrong, I have no idea of AutoGPT is good at that sort of thing, I suppose it depends on what direction their team is pushing the development.

ganzuul 3y ago

It's just depressingly hard to survive.