4 ms·
Someone will be able to run something like this locally one day. That same person may go to great lengths to ignite those sparks. As a developer, I can already
by DustinBrett 4y ago
Someone will be able to run something like this locally one day. That same person may go to great lengths to ignite those sparks.
As a developer, I can already imagine taking this thing and putting some logic around it to go into loops and give it ways to get the information it needs to move forward. This seems very inevitable now.
- Dzugaru 4y agoIt was already trained like this, RLHF [0] is a loop that has ways to feed it the information to "move forward" - update its weights. It was fine-tuned like this. It certainly did ignite something - maybe sparks of AGI, maybe just sparks of pretending to be more liked by humans (hence Human Feedback in RLHF). My guess is that loops by itself (Reflexion [1], etc.) won't change much. ChatGPT massive logs - maybe. [0] https://huggingface.co/blog/rlhf https://huggingface.co/blog/rlhf [1] https://arxiv.org/abs/2303.11366 https://arxiv.org/abs/2303.11366