4 ms·
I believe more tokens = more iterations and compute since the algorithm is run against every token. A goal of prompt optimisation seems to be to increase the to
by irthomasthomas 3y ago
I believe more tokens = more iterations and compute since the algorithm is run against every token. A goal of prompt optimisation seems to be to increase the token count without polluting the context. Although in that case they would also use all caps. Perhaps the secret sauce of GPT-4 is simply .toupper?