3 ms·
Does it mean if it was embedded on a Talaas chip, it could generate ~50,000+ tokens per second?
by smusamashah 8mo ago
Does it mean if it was embedded on a Talaas chip, it could generate ~50,000+ tokens per second?
- Havoc 8mo agoThink pretty much anything is going to get a enormous speed boost if the model isn’t undergoing mem latency but is just inherently baked into the circuits asic style