3 ms·
Even a tiny Intel/AMD GPU makes a massive difference, as it makes prompt processing nearly instant vs being barely faster than generation.
by brucethemoose2 3y ago
Even a tiny Intel/AMD GPU makes a massive difference, as it makes prompt processing nearly instant vs being barely faster than generation.