3 ms·
Well even if it doesn’t get ‘more intelligent’, just faster so we eventually have 10000+ tokens/s (so you can have realtime inference for visual, speech and tex
by anonzzzies 3y ago
Well even if it doesn’t get ‘more intelligent’, just faster so we eventually have 10000+ tokens/s (so you can have realtime inference for visual, speech and text) and with a 10m context window, we definitely have something worthwhile and useful for almost everything. Won’t be the downfall of humanity, but will help everyone everywhere optimise work and life.