3 ms·
"We" are never going to stop trying to use LLMs for math. They are obviously mimicking a smart person. What do you do with smart persons? You query them with ba
by jstummbillig 3y ago
"We" are never going to stop trying to use LLMs for math. They are obviously mimicking a smart person. What do you do with smart persons? You query them with bad and lazy questions (often without being too honest about that to yourself), and hope/expect helpful answers.
Because that is how it works. The limiting factor so far has been the smart persons time and patience. Now, no longer.
People moderating their LLMs usage is never happening, from here on out until the end of civilisation. Any LLM service that is designing for that is done. You need to make lazy questions efficient. People do not care about how complicated your sql query is and they will never care. People will not give up on energy, meat, cars, as long as they feel they are giving something up.
People will never think twice to not make your LLM think twice.
If it seems useful and convenient, people will use it. If it's not giving good answers to lazy questions out of the box, they will go to the thing that does.
- hammock 3y ago>"We" are never going to stop trying to use LLMs for math. They are obviously mimicking a smart person. A lot of words to make a big deal out of nothing. All that is needed is some new abstracted layer that identifies a math question and then proxies it over to the wolfram plugin. That’s it We don’t have crazy debates over whether a polygon should be rendered by the cpu or a gpu. We solved this problem
- zeusk 3y agoSo a Mixture of Experts model; but then isn't ChatGPT using that already? Why're the models so bad at math despite being trained on academic papers and books clearly - or why do they hallucinate and make up non-existing citations?
- edgyquant 3y agoBecause they don’t actually reason about things they just map words based on probability. If they’ve seen a math problem enough they may get it right due to probability, but using that knowledge to solve a new problem isn’t likely.
- klausa 3y agoI have bad news about how "solved" CPU/GPU rendering split is.