3 ms·
That out of sample performance is a mirage. Yes it’s impressive. Yes it’s got amazing zero shot performance in domains. But there’s a pattern of failure in pr
by intended 3y ago
That out of sample performance is a mirage.
Yes it’s impressive. Yes it’s got amazing zero shot performance in domains.
But there’s a pattern of failure in production which describe a limit, that shouldn’t exist if the emergent properties were stable.
You can build this right now and test it.
Build a sequence of agents to work on a domain you are not an expert in.
Let them loose. See what happens.
Do the same thing on a domain you have expertise in.
Assume the number of errors you find, the number of modifications you have to make are stable for other domains.
- ethbr1 3y agoI'd phrase characterizing the reliability of out-of-sample performance a priori as impossible, but not necessarily automatically failing. There may be a subtle correlation between properties needed to answer a specific out-of-sample request and in-sample features. Unfortunately, prior to training/testing and without recognizing that correlation in the data set, I believe it's impossible to guarantee the model will include it. (Corrections welcome)
- intended 3y agoIn essence: “You cant know in advance how far the model can approximate semantic patterns” So claiming that out-of-sample performance is a mirage, would be a bridge too far?