3 ms·
Is that gif in your github in realtime? Is the speed limited due to the number of tokens per second that an LLM can produce or is this because of the pair progr
by cinntaile 3y ago
Is that gif in your github in realtime? Is the speed limited due to the number of tokens per second that an LLM can produce or is this because of the pair programming aspect where you try to simulate a real interaction between 2 "agents"?