2 ms·
My point is more that they won’t need new training data to extrapolate to new problems, especially if that new problem is just a new syntax or API. Put the whol
by Chance-Device 3mo ago
My point is more that they won’t need new training data to extrapolate to new problems, especially if that new problem is just a new syntax or API. Put the whole shebang into the context. Done. Yes, you need super long context for this, or just pretty good search over it, but I think this is likely to become a solved problem.
- MattPalmer1086 3mo agoAgreed if its just a new API using a current language using common patterns, that is mostly just having a big context. However, the ability to reason generally on novel problems is AGI and we aren't there yet. Eventually in the absence of AGI, we will have to train models on them, and that will require data.