3 ms·
TPS is the Ghz of AI models. Both are related to the the propagation time of data.
by charcircuit 2y ago
TPS is the Ghz of AI models. Both are related to the the propagation time of data.
- idonotknowwhy 2y agoThen i guess vocab is the IPC. 10k mistral tokens are about 8k llama3 tokens