3 ms·
I was surprised to see the omission of a prompt technique called program-aided prompting. Paper: https://arxiv.org/abs/2211.10435 https://arxiv.org/abs/2211.10
by gandalfgeek 4y ago
I was surprised to see the omission of a prompt technique called program-aided prompting.
Paper: https://arxiv.org/abs/2211.10435 https://arxiv.org/abs/2211.10435
GitHub: https://github.com/reasoning-machines/pal https://github.com/reasoning-machines/pal
tl;dr -- LLMs are bad at basic arithmetic and logic (as their opening examples with math word problems show), but they do much better if instead of asking them for the answer, you ask for code to compute the answer. Then evaluate or run the code to get the answer.
- ElFitz 4y agoSeems like something fit for a GPT-3 / Wolfram partnership! See https://news.ycombinator.com/item?id=34422122 https://news.ycombinator.com/item?id=34422122 and https://news.ycombinator.com/item?id=34422627 https://news.ycombinator.com/item?id=34422627
- charcircuit 4y agoIt doesn't make sense to be on that page because it's not a technique to make GPT better answer a prompt. What you are suggesting is an abstraction layer higher. Figuring out what your prompt should do is different from trying to make a prompt more reliable.