4 ms·
>The limitations to GPT3 codex and AlphaCode seems to be they're relatively weak at selection This really does seem like the key here--the knowledge apparently
by briga 5y ago
>The limitations to GPT3 codex and AlphaCode seems to be they're relatively weak at selection
This really does seem like the key here--the knowledge apparently is all in the language model, we just haven't found the best ways to extract that knowledge in a consistent and coherent manner. Right now it's just: generate a bunch of examples and cherry pick the good ones.
- hnfong 5y agoThe way you put it sounds so like the P?=NP problem: If it's easy to tell whether a solution is valid, is it also easy to generate it?