3 ms·
Speed-wise, on a single stream, I have no need for it to generate text faster than I can read. However, for scripts that try to use hundreds/thousands of invoc
by londons_explore 3y ago
Speed-wise, on a single stream, I have no need for it to generate text faster than I can read.
However, for scripts that try to use hundreds/thousands of invocations to solve some problem (eg. "write me a whole book"), the parallelism will be great (but obviously the script has to be written with that in mind).