4 ms·
Modern LLMs are fairly good at that as well.
by rudhdb773b 6mo ago
Modern LLMs are fairly good at that as well.
- qsera 6mo agoBut that is bolted on and is not a core behavior.
- ACCount37 6mo agoDoes it matter? Evolution is the brain's very own "pre-training". Hundreds of millions of years of priors hardwired. We can do that for AIs too - pre-train on pure low Kolmogorov complexity synthetics. The AI then "knows things" before it sees any real data. Advantageous sometimes. Hard to pick compute efficient synthetics though.
- qsera 6mo agoI think It matters for the question that I was responding to.