3 ms·

There's something I don't get about all these models... Why aren't these using external tools, like a calculator, when they "know" they're doing something a too

There's something I don't get about all these models... Why aren't these using external tools, like a calculator, when they "know" they're doing something a tool would solve perfectly? Humans do it all the time now. Engineers aren't designing microchips using pen and papers, doing all the computation in their head. Instead they're using tools (software / calculators) Apparently the model can tell what a multiplication is and when it is called. So why isn't it using a calculator to give correct results to basic maths questions? In the rot13 case, I can ask it "how can I automate the rot13 of text" (you don't even need to use correct english) and it'll explain me what I need to write at a bash prompt. Would it be complicated to then have the model actually run the command at a bash prompt, in a sandbox? It's really mindboggling: humans uses tool (like ChatGPT btw) all the time. Why do these systems use none except their own model?

visarga 4y ago
They are, but not chatGPT, at least not yet. In one paper they create a so called <work> token, such as <work>22+44</work> and get 66 inserted after the work block automatically. It can also run Python commands and write functions and use them. For example they ask what is the current BTC price and the model writes code to load the price from a web API. When it gets an error message it can try to fix the code. Language models would benefit from having a <search> token as well. Some models have demonstrated amazing things - with a large search index you can get good performance on many tasks with a 20x smaller model. No need to burn all the trivia in the weights of the network. Just use a search engine to help it.
disambiguation 4y ago
funny enough i asked it what tool i could use to solve rot13 encryption and it directed me to rot13.com and even explained how to use the site
dragonwriter 4y ago
> Why aren't these using external tools, like a calculator, when they "know" they're doing something a tool would solve perfectly? There are models that do this; in fact, ChatGPT appears to, underneath, be one of them, because tricks to reveal its internal prompt indicate that it has at least a browsing integratiom that is disabled via the prompt. But ISTR seeing other models used configured to use Python in the hosting Jupyter instance for some things, like math.

visarga 4y ago

They are, but not chatGPT, at least not yet. In one paper they create a so called <work> token, such as <work>22+44</work> and get 66 inserted after the work block automatically. It can also run Python commands and write functions and use them. For example they ask what is the current BTC price and the model writes code to load the price from a web API. When it gets an error message it can try to fix the code. Language models would benefit from having a <search> token as well. Some models have demonstrated amazing things - with a large search index you can get good performance on many tasks with a 20x smaller model. No need to burn all the trivia in the weights of the network. Just use a search engine to help it.

disambiguation 4y ago

funny enough i asked it what tool i could use to solve rot13 encryption and it directed me to rot13.com and even explained how to use the site

dragonwriter 4y ago

> Why aren't these using external tools, like a calculator, when they "know" they're doing something a tool would solve perfectly? There are models that do this; in fact, ChatGPT appears to, underneath, be one of them, because tricks to reveal its internal prompt indicate that it has at least a browsing integratiom that is disabled via the prompt. But ISTR seeing other models used configured to use Python in the hosting Jupyter instance for some things, like math.