3 ms·
Why is character streaming important if Bard seems to be faster generating a complete answer than ChatGPT?
by ewoodrich 3y ago
Why is character streaming important if Bard seems to be faster generating a complete answer than ChatGPT?
- whoisjuan 3y agoThat's because simple questions in Bard only generate like 200 tokens per answer. The latency is more noticeable for longer answers.