3 ms·
The tokens per second speed measurement is highly inflated nowadays because most of the tokens went into thinking. I wonder if there is a more realistic measure
by low_tech_punk 1mo ago
The tokens per second speed measurement is highly inflated nowadays because most of the tokens went into thinking. I wonder if there is a more realistic measurement for "effective speed", which accounts for thinking efficiency.
- ak_t 1mo agoMany benchmarks now measure the total cost or energy usage per completed task.
- deleted 1mo ago[deleted]