2 ms·
> We don't build airplanes by mimicking birds. We don't build airplanes by having them flap wings, but we do build planes which are considerably more aerodynam
by XorNot 1y ago
> We don't build airplanes by mimicking birds.
We don't build airplanes by having them flap wings, but we do build planes which are considerably more aerodynamically efficient then a bird. i.e. we considerably exceed the underlying performance metric governed by the physics.
Which is my point: an AI need not work anything like a human, but it seems obvious that model training taking months of time to incorporate new information fundamentally cannot be close to AGI since even far simpler creatures can learn and retain information on much shorter timescales.
I'd give the notion more credence if we plausibly had say, a model with a context window which could hold a day of information, and then do could train overnight on that such that it would incorporate that context window into the next day of activity.
- naasking 1y agoThe infrastructure is almost there now. LLMs are already training small domain specific models. Small language models have already shown excellent performance in specific domains, particularly logic and math. All that's needed is an extensible mixture of experts router so that these small models can be plugged into the larger model and selected when the query is appropriate. This isn't far off.