KhoomeiK

19 ms·

61.
by KhoomeiK 3y ago
I was super obsessed with biological taxonomy in middle school—something about the trees and hierarchies was really satisfying. Would've loved this game back then but now it's just frustrating.
62.
by KhoomeiK 3y ago
I always felt like the Tractatus was similar in form to Sanskrit sutra texts—especially those with hierarchical structure e.g. Panini's Astadhyayi [1]. In the Astadhyayi, a sutra can serve as the anuvritti (context) for a subsequent se
63.
Language trees support a hybrid model for the origin of Indo-European languages(science.org)
1 points by KhoomeiK 3y ago|0 comments
64.
by KhoomeiK 4y ago
Further improvements in efficiency need not come from alternative architectures. They'll likely also come from novel training objectives, optimizers, data augmentations, etc.
65.
by KhoomeiK 4y ago
Wiktionary says 馬鹿 is "probably originally a transcription of Sanskrit मोह (moha, “folly”), used as a slang term among monks".
66.
by KhoomeiK 4y ago
Yeah this is more or less a re-release of the second work I linked, except for a broader audience and more targeted at linguistics / cognitive science researchers.
67.
by KhoomeiK 4y ago
Several papers have explored emergent linguistic structure in LMs. Here's some early introductory work in this space. Despite having explicit syntax parses etc as input, models seem to learn something like syntax. https://ar
68.
by KhoomeiK 4y ago
Sure, feel free to email me as well. Email is listed on the personal website linked in my profile.
69.
by KhoomeiK 4y ago
Sure, feel free to email me as well. Email is listed on the personal website linked in my profile.
70.
by KhoomeiK 4y ago
Email is on my personal website linked in my profile
71.
by KhoomeiK 4y ago
Hey, feel free to reach out if you’d like to join an NLP project to gain more experience that I’m working on. Will provide mentorship and potentially coauthorship on the publication.
72.
by KhoomeiK 4y ago
ICLR review discussion here: https://openreview.net/forum?id=WbxHAzkeQcn Somewhat relevant work: https://aclanthology.org/2020.emnlp-main.731/
73.
by KhoomeiK 4y ago
No, it’s regularly used as shorthand for South Asians and/or Latinos. It certainly can have derogatory undertones though, just like “Mexican” isn’t inherently racist but often has negative connotations. This has been statistically inve
74.
by KhoomeiK 4y ago
A few ongoing threads on twitter: https://twitter.com/harishkgarg/status/1616614633519058945 https://twitter.com/Saboo_Shubham_/status/161666814074173440... https://twitter.co
75.
ChatGPT Pro launches for $42/month, free when demand is low(techau.com.au)
2 points by KhoomeiK 4y ago|2 comments
76.
by KhoomeiK 4y ago
A more theoretical but increasingly popular approach to identifying behavior like this is interchange intervention: https://ai.stanford.edu/blog/causal-abstraction/
77.
by KhoomeiK 4y ago
I love how historical linguistics, archaeogenetics, and anthropology posts make it to the front page of HN every once in a while. Is this interest all because of Sapiens? Or did Sapiens do well in the ~HN/Silicon Valley community becau
78.
by KhoomeiK 4y ago
> "It seemed to me the universe is in a process of coming alive. Consciousness is blossoming and propagating to colonize the universe, and life on Earth is one of many bright spots in the cosmic birth of consciousness." I had m
79.
by KhoomeiK 4y ago
Recent paper showing how LMs "struggle with less popular factual knowledge, and that scaling fails to appreciably improve memorization of factual knowledge in the tail". In other words, simply scaling LLMs will not result in repla
80.
by KhoomeiK 4y ago
Here's a short paper that I spent several hours grokking as my first intro to Homotopy Type Theory, and which eventually sent me down a journey learning algebra, topology, and logic in order to fully understand HoTT: https:/&#x2F
81.
by KhoomeiK 4y ago
Thanks! I'm still working through Rajpopat's thesis, but at a high level, it doesn't particularly "revolutionize" our understanding of the Astadhyayi. It's just further proof of Panini's ingenuity and the
82.
by KhoomeiK 4y ago
Shameless plug for my talk on the influence of the classical Indian tradition on Western Linguistics & Natural Language Processing: https://www.youtube.com/watch?v=NPl17qiaARM
83.
by KhoomeiK 4y ago
Shameless plug for my talk on the influence of the classical Indian tradition on Western Linguistics & Natural Language Processing: https://www.youtube.com/watch?v=NPl17qiaARM
84.
by KhoomeiK 4y ago
Interesting implications for "neuro-symbolic" computation and the so-called classical-neural synthesis many are looking for in deep learning, and Cognitive Science more broadly. Does this mean that minds don't ever naturally
85.
by KhoomeiK 4y ago
Location: Silicon Valley / San Francisco Bay Area (CA), Pittsburgh (PA) Remote: Open to it Willing to relocate: Open to it Technologies: Python, PyTorch, TensorFlow, Keras, HuggingFace, SpaCy, NLTK, NumPy, Pandas, Sci-kit Le
86.
by KhoomeiK 4y ago
Not an expert but the proof is in fact entirely constructive and witnesses to the existential statement are constructible. https://math.stackexchange.com/questions/448527/are-the-g%C3...
87.
by KhoomeiK 4y ago
I almost upvoted and then noticed it links to the AI Alignment Forum. Even a broken clock...
88.
by KhoomeiK 4y ago
> Now we have a fairly concrete idea of what a potential AGI might look like - an RL agent that uses a large transformer. People have thought Deep RL would lead to AGI since practically the beginning of the deep learning revolution, and
89.
The Koide Formula(en.wikipedia.org)
2 points by KhoomeiK 4y ago|0 comments
90.
Father Tongue hypothesis(en.wikipedia.org)
3 points by KhoomeiK 4y ago|0 comments

More ›