3 ms·
Maybe there’s something I don’t understand, but it seems to me that it would just be a streaming-next-token input instead of a batch input.
by binary132 2y ago
Maybe there’s something I don’t understand, but it seems to me that it would just be a streaming-next-token input instead of a batch input.