2 ms·
assume each prediction use 1000 tokens (including both input prompt and output text), then 100k tokens -> 100 predictions
by satorii 6y ago
assume each prediction use 1000 tokens (including both input prompt and output text), then 100k tokens -> 100 predictions