3 ms·
That's really impressive from a speed point of view but it hallucinates like it's on drugs. I'd much rather trade speed for accuracy.
by jjbinx007 4mo ago
That's really impressive from a speed point of view but it hallucinates like it's on drugs.
I'd much rather trade speed for accuracy.
- gunalx 4mo agoIts llama 3.1 8b. So not a particular good model, mostly as a tech demo of the speed possible.