3 ms·
Is the tradeoff of the parallel output that we don't get arbitrary string generation? like output # of tokens is fixed ahead of time? Either way, really cool a
by bthornbury 17d ago
Is the tradeoff of the parallel output that we don't get arbitrary string generation? like output # of tokens is fixed ahead of time?
Either way, really cool and impressive.
- zenlikethat 17d agoYeah, it doesn't output strings, just decisions/answers.
- copperx 17d agoNon-hallucinated ones at that.