2 ms·
All I wanna know is how many tokens per second on 100B MoE?? Have we cracked 100 yet. When we crack 100 tok/s at 2M context for <$10K I’ll buy one.
by aetherspawn 1mo ago
All I wanna know is how many tokens per second on 100B MoE??
Have we cracked 100 yet.
When we crack 100 tok/s at 2M context for <$10K I’ll buy one.