4 ms·
Also "accuracy" as a measure of model's performance used to mean something objective in the traditional ML world. Now with LLMs it is what human evaluators fee
by albert_e 2y ago
Also "accuracy" as a measure of model's performance used to mean something objective in the traditional ML world.
Now with LLMs it is what human evaluators feel about the LLM output?
- yorwba 2y agoTraditional ML is no stranger to measuring accuracy in terms of agreement with human evaluators.
- albert_e 2y agoA customer churn model or revenue forecast did have hard objective data (ground truth) to compare against - isn't it?
- ptrrrrrrppr 2y agoyou seem to think all classical ML models were supervised, which isn't true. and we have metrics for unsupervised approaches as well