2 ms·
A good and quick video summary of the paper[1], which surprised me as to the extent to which LLMs like GPT-4 have advanced: 'Sparks of AGI' - Bombshell GPT-4 P
by creamyhorror 4y ago
A good and quick video summary of the paper[1], which surprised me as to the extent to which LLMs like GPT-4 have advanced:
'Sparks of AGI' - Bombshell GPT-4 Paper: https://news.ycombinator.com/item?id=35301376 https://news.ycombinator.com/item?id=35301376
The paper shows that GPT-4 can use tools and assemble results into an answer, solve Leetcode mediums (and a few hards) and even an IMO 2022 problem, generate full code for a video game based on a high-level description, and display a theory of mind (modeling what others are thinking). This is pretty amazing (and frankly frightening) progress, questions of consciousness aside (which seems unlikely).
I imagine directly connecting these LLMs with a logico-mathematically-specialised neural network (or enabling two-way communication with the latter using symbolic language) would open up the range of their problem-solving capabilities, which currently stumble on certain technical procedures and forward/backward planning. Think of how math coprocessors were added to early microcomputer CPUs.
Then, giving an LLM motivations without sufficient aligning for safety could really be opening up Pandora's Box. A neural network might not be wired up to robotic devices that it could use to manipulate things in the real world, but it communicates with humans. Such an LLM might try to persuade humans to do things according to its (programmed or otherwise) motivations, things that we might not really want.
[1] Sparks of Artificial General Intelligence: Early experiments with GPT-4. https://arxiv.org/pdf/2303.12712.pdf https://arxiv.org/pdf/2303.12712.pdf