5 ms·
Toolformer: Language models can teach themselves to use tools
- nadermx 4y agoI think this is probably the sort of way AGI will work.
- valine 4y agoA multimodal LLM using tools definitely feels like the closest we’ve ever been to AGI.
- oliverbennett 4y agoIf we’re at a place a LLM can make and use tools I’m excited about the limits of its ability to create tools... specifically to create new tools. For me that kind of entailment is one of the more exciting pillars of general intelligence and unique among humans (I think?).
- PartiallyTyped 4y agoThe next step could be pairing multiple LLMs with code synthesisers. The LLM could describe the target API, a second LLM would build said API, and resolve the query. I think at that point we will be very close to an AGI.
- deleted 4y ago[deleted]
- FleurBouquet 4y agoTo me what we are seeing is what a failure the field of the philosophy of artificial intelligence has been to prepare us linguistically to have discussions about all this. Even when we have real AGI, some people will argue we don't because it can't cook a hamburger. Then even if we make a robot AI arm to cook a hamburger, people will complain the arm can't play the guitar.
- frozencell 4y agoWhat will the people complain about at the end?
- est 4y agosee https://news.ycombinator.com/item?id=34757265 https://news.ycombinator.com/item?id=34757265
- azhenley 4y agoThanks. I submitted this two days ago so it must have been put in the second chance queue.
- lee101 4y ago[flagged]
- zwaps 4y agoLee, please, less blatant the ads. Thank ye
- kwhitefoot 4y agoWhat does: "100 requests a month free tier. $0.01 USD per request" mean? IS it free or not?
- amrb 4y agoYou can build stuff like this today, there is also the ability to use bash, python and requests lib under docs for utility. https://langchain.readthedocs.io/en/latest/modules/agents/getting_started.html https://langchain.readthedocs.io/en/latest/modules/agents/ge...
- gandalfgeek 4y agoWhat they're describing in the paper goes much further than LangChain. Toolformer is integrating API calls into the training and inference of an LLM. Short video explainer here: https://youtu.be/ZCdqfIuT81A https://youtu.be/ZCdqfIuT81A
- lovelearning 4y agoThey used GPT-J, an open-source LLM, for this. Anyone can use this technique privately to integrate with their proprietary / private APIs too.
- flangola7 4y agoCould this be applied to physical tools, such as audio sensors or motorized manipulater arms?
- PaulHoule 4y agoI think of those cases where people ask GPT-3 to write a Python program. For instance one person had the problem that they'd ask GPT-3 to answer a question like "How many prime numbers are there between 14 and 321?" and get an almost right answer. A better route to a right answer in that case is to have it write a Python program and run it because the only way to answer that right is to count them all and Python is good for that.
- simonh 4y agoCurrent LLMs can’t reason like that. If their training text contained a question and response similar to the one they are asked, those will have been encoded in their network weightings, and they will produce an answer of a similar form but randomly varying in the details. This is why they produced answers to maths questions in the right form, but wrong in detail. It’s why when asked when and where a famous person was born, they will often respond with an answer that looks highly plausible, but wrong in the details. What this mechanism might do though is enable it to identify this as a question best answered by one of it’s available APIs. That API might be to an LLM trained to write code to solve maths problems, so that will write the code, run it and generate a response, then pass that back through the API. So this way you could build a hierarchy of problem solvers, some of them procedural, some of them domain specific LLMs, or problem solvers that themselves use LLMs as components to help solve that problem domain. Interesting times.
- euroderf 4y agoIf cats had opposable thumbs, we'd all be dead. Toolformer is in that vein.
- meghan_rain 4y agocute