3 ms·
A sign of system-level optimization starting to overshadow raw/brute-force scaling of foundational models. My view is that foundational models are indeed statis
by bigcat12345678 3mo ago
A sign of system-level optimization starting to overshadow raw/brute-force scaling of foundational models. My view is that foundational models are indeed statistic parrots, just like humans (humans are worse parrots, but human brain's context window is so small that they often do not recognize how broken was human-intermediated intelligence swarm, but such small context window might be a fundamental feature of so-called intelligence).
LLMs to me are better intelligence than humans in 3 aspects:
1. LLMs can somehow entirely do perspective taking, humans cannot even think self in next 10 minutes after making a decision
2. LLMs can somehow be asked to arbitrarily elevate and lower abstraction level (can be seen as a special form of perspective taking)
3. LLMs "think" instantly
All these innate capabilities should be combined with system level optimization to achieve the last 10% to be beyond human intelligence.
- hankbond 3mo ago> 2. LLMs can somehow be asked to arbitrarily elevate and lower abstraction level (can be seen as a special form of perspective taking) yes but from my experience abstracting (at least upward) is something all models really struggle with. I would argue that the best models are quite away from human intelligence, let alone 10%.
- bigcat12345678 3mo agoI guess it's a band of written abstract knowledge embedded in LLMs. Beyond that LLMs certainly falls hard than humans. But in the band of LLMs, human cannot match
- urbsgpw 3mo ago[dead]