3 ms·
> By the end of training, the model produces names like "kamon", "karai", "anna", and "anton". None of them are copies from the dataset. All 4 are in the datas
by O4epegb 7mo ago
> By the end of training, the model produces names like "kamon", "karai", "anna", and "anton". None of them are copies from the dataset.
All 4 are in the dataset, btw
- mym1990 7mo agoThis is likely because the blog is AI generated and keys off this point from Karpathy: "As a preview, by the end of the script our model will generate (“hallucinate”!) new, plausible-sounding names.", so the LLM just repackaged that into something that is obviously wrong, which is kind of ironic.