4 ms·

Is it conceivable that ChatGPT could review itself and produce a superior revision to a human?

by thelittleone 4y ago

bckr 4y ago
Exciting thought!
- antibasilisk 4y ago
  *alarming
falcor84 4y ago
That's one of the definitions of the Singularity. Assuming it doesn't quickly hit diminishing returns, at that point in time, you would get a so-called "fast takeoff" of superintelligence.
pixl97 4y ago
ChatGPT, unlikely. But with that said, we're already using AI optimizers to make better versions of AI chips like the H100, so take that with what you will. Current GPT context is too low for this, I believe. We'll have to have something a little closer to AGI for this, and I'm unsure if a cyclic working memory (come up with an output, review the output, review that output, output) will get us to AGI itself. We still need selection functions that bind AI to the real world and not the dream state it lives in. Maybe just hooking it to compilers and allowing it to run test functions will get it a lot farther in self learning, but again, no one seems to know at this point.
- thelittleone 4y ago
  Genuinely curious as to why ChatGPT could not so I asked it. Note the final bullet point. I posit, that if it is possible, it will happen (regardless of ethics), because the risk of not doing it (when your adversary will) outweighs the risk of doing it. "You say an instance of the GPT cannot experiment with new architectures, but could it if a) it was modified by the developers and b) it was given access to sufficient computational resources?" Response: "In theory, if a GPT model were to be modified by developers to include capabilities for analyzing, designing, and testing new architectures, and if it were given access to sufficient computational resources, it could potentially experiment with new architectures. This would involve incorporating additional machine learning and deep learning algorithms and methods, such as reinforcement learning, evolutionary algorithms, or neural architecture search, which can be used to explore new model designs. However, there are a few caveats to consider: - Developing such a system would require significant expertise in AI research, as well as an understanding of the specific problems that need to be addressed. - The GPT model is a complex system, and adding the ability to self-improve or create new architectures could make the model even more complex and challenging to manage. - The computational resources required to develop, test, and implement new architectures are substantial, and optimizing resource allocation would be a critical concern. - Ensuring the safety and ethical use of such a self-improving AI system would be an essential consideration, as it could potentially lead to unintended consequences or malicious use. Although it is theoretically possible to create a GPT-like model with the ability to experiment with new architectures, it would require significant advancements in AI research, development, and ethical considerations.

Is it conceivable that ChatGPT could review itself and produce a superior revision to a human?

bckr 4y ago

Exciting thought!

antibasilisk 4y ago
*alarming

falcor84 4y ago

That's one of the definitions of the Singularity. Assuming it doesn't quickly hit diminishing returns, at that point in time, you would get a so-called "fast takeoff" of superintelligence.

pixl97 4y ago

ChatGPT, unlikely. But with that said, we're already using AI optimizers to make better versions of AI chips like the H100, so take that with what you will. Current GPT context is too low for this, I believe. We'll have to have something a little closer to AGI for this, and I'm unsure if a cyclic working memory (come up with an output, review the output, review that output, output) will get us to AGI itself. We still need selection functions that bind AI to the real world and not the dream state it lives in. Maybe just hooking it to compilers and allowing it to run test functions will get it a lot farther in self learning, but again, no one seems to know at this point.

thelittleone 4y ago
Genuinely curious as to why ChatGPT could not so I asked it. Note the final bullet point. I posit, that if it is possible, it will happen (regardless of ethics), because the risk of not doing it (when your adversary will) outweighs the risk of doing it. "You say an instance of the GPT cannot experiment with new architectures, but could it if a) it was modified by the developers and b) it was given access to sufficient computational resources?" Response: "In theory, if a GPT model were to be modified by developers to include capabilities for analyzing, designing, and testing new architectures, and if it were given access to sufficient computational resources, it could potentially experiment with new architectures. This would involve incorporating additional machine learning and deep learning algorithms and methods, such as reinforcement learning, evolutionary algorithms, or neural architecture search, which can be used to explore new model designs. However, there are a few caveats to consider: - Developing such a system would require significant expertise in AI research, as well as an understanding of the specific problems that need to be addressed. - The GPT model is a complex system, and adding the ability to self-improve or create new architectures could make the model even more complex and challenging to manage. - The computational resources required to develop, test, and implement new architectures are substantial, and optimizing resource allocation would be a critical concern. - Ensuring the safety and ethical use of such a self-improving AI system would be an essential consideration, as it could potentially lead to unintended consequences or malicious use. Although it is theoretically possible to create a GPT-like model with the ability to experiment with new architectures, it would require significant advancements in AI research, development, and ethical considerations.