2 ms·
It scales fine if done correctly. Even with the weights the extra context allows it to move to the correct space. Much the same as humans there are terms that
by EagnaIonat 6mo ago
It scales fine if done correctly.
Even with the weights the extra context allows it to move to the correct space.
Much the same as humans there are terms that are meaningless without knowing the context.
- kang 6mo agoWould it be possible to make GPT3 from GPT2 just by prompting? It doesn't work/scale
- EagnaIonat 6mo agoBit of a straw-man there.