4 ms·
Yes, and you have to do it in a loop on every request. Not joking. It’s called “LLM as judge.”
by jdlshore 1y ago
Yes, and you have to do it in a loop on every request. Not joking. It’s called “LLM as judge.”
- collingreen 1y agoWhat an amazing business to convince people to use. Making people pay to use LLMs to supervise the LLMs they pay for in order to get decent results is diabolically genius. At the risk of offending some folks it feels like the genius of the Mormon church making its "customers" pay the church AND work for it for free AND market it for free in person AND shame anyone who wants to leave. Why have cost centers if you don't have to! It's a business model I wasn't smart or audacious enough to even come up with.
- jgalt212 1y agoIt's a bit like paying more for AWS logging services than for the AWS services that provide the services your customers actually consume.