4 ms·
It’s not meaningless at all: every query returns usage and I can calculate the cost. EDIT: this is like saying hourly rate or salary is meaningless. Different
by dools 3mo ago
It’s not meaningless at all: every query returns usage and I can calculate the cost.
EDIT: this is like saying hourly rate or salary is meaningless. Different people have different output. You have to evaluate performance.
EDIT2: just pray the LLM providers don’t start taking Patrick McKenzie’s advice and start charging based on “value delivered”