3 ms·
Look at OpenAssistant (https://github.com/LAION-AI/Open-Assistant); https://github.com/LAION-AI/Open-Assistant); they are trying to give a chatbot the ability t
by theptip 4y ago
Look at OpenAssistant (https://github.com/LAION-AI/Open-Assistant); https://github.com/LAION-AI/Open-Assistant); they are trying to give a chatbot the ability to trigger actions in other systems. I fleshed out a scenario in more detail here: https://news.ycombinator.com/item?id=34808674 https://news.ycombinator.com/item?id=34808674.
But in brief, the short-term evolution of LLMs is going to involve something like letting it `eval()` some code to take an action as part of a response to a prompt.
A recent paper, Toolformer: https://pub.towardsai.net/exploring-toolformer-meta-ai-new-transformer-learned-to-use-tools-to-produce-better-answers-1b8c042e9c46 https://pub.towardsai.net/exploring-toolformer-meta-ai-new-t... which is training on a small set of hand-chosen tools, rather than `eval(<arbitrary code>)`, but hopefully it's clear that it's a very small step from the former to the latter.
- williamcotton 4y agoI’ve been getting very good results from eval on JS written by GPT. It is surprising apt at learning when to query a source like wolframalpha or wikipedia and when to write an inline function. You can stop it from being recursive by passing it through a model that is not trained to write JavaScript but is trained to output JSON.