Am I just misunderstanding, or is the paper using "latency" when what they really mean is "throughput"? In other words, if I want 100 tokens of output, do I ha

Am I just misunderstanding, or is the paper using "latency" when what they really mean is "throughput"? In other words, if I want 100 tokens of output, do I have to wait 2990 seconds? If so, the terminology seems unnecessarily confusing.