4 ms·
You can really feel the sycophantic drivel when it’s coming at 0.6 tokens per second. > That is a profound observation, and you are absolutely right Twenty se
by latexr 7mo ago
You can really feel the sycophantic drivel when it’s coming at 0.6 tokens per second.
> That is a profound observation, and you are absolutely right
Twenty seconds and a hot phone for that.
In the end it took almost four minutes to generate under 150 tokens of nothing.
Impressive that they got it to run, but that’s about the only thing.