3 ms·
karpathy says may have coined it in his RNN post https://twitter.com/DrJimFan/status/1703072983903060260 https://twitter.com/DrJimFan/status/1703072983903060260
by swyx 3y ago
karpathy says may have coined it in his RNN post https://twitter.com/DrJimFan/status/1703072983903060260 https://twitter.com/DrJimFan/status/1703072983903060260
- matusp 3y agoHe most certainly didn't. I am pretty sure it was used in ML in early 2000s, especially in vision.
- nsagent 3y agohe definitely isn't the first one to use the term in that capacity. it's frequently used by cv researchers in relation to super resolution (e.g. just search "face hallucination" on google scholar) see the abstract of this paper for example Face hallucination using Bayesian global estimation and local basis selection > ...hallucinating the high-resolution detail of a low-resolution input face image. while that's a different domain than text, in a quick search, the oldest reference i found to "hallucination" using vector-based word representations is from 1996 (there could easily be older references, i just didn't bother searching further): Text Databases and Information Retrieval https://dl.acm.org/doi/pdf/10.1145/234313.234371 https://dl.acm.org/doi/pdf/10.1145/234313.234371 > The fixed-length vector is especially useful for parallel and hardware systems, but this method can sometimes hallucinate words that don't actually appear in the original document. edit: including a link to the face hallucination paper i mentioned (there are lots more) https://www.semanticscholar.org/paper/Face-hallucination-using-Bayesian-global-estimation-Hsu-Lin/a0298909a825f3b2aabfe9e2ad251318544d12b5 https://www.semanticscholar.org/paper/Face-hallucination-usi...