3 ms·
Imagine a model trained only on an Earth-centered universe, that there are four elements (earth, air, fire, and water), or one trained only that the world is fl
by sokoloff 10mo ago
Imagine a model trained only on an Earth-centered universe, that there are four elements (earth, air, fire, and water), or one trained only that the world is flat. Would the capabilities of the resulting model equal those of models trained on a more robust set of scientific data?
Architecture and training data both matter.
- AlotOfReading 10mo agoPretty much all the Greek philosophers grew up in a world where the classical element model was widely accepted, yet they had reasoning skills that led them to develop theories of atomism, and measure the circumference of the earth. It'd be difficult to argue they were less capable than modern people who grew up learning the ideas they originated either. It doesn't seem impossible that models might also be able to learn reasoning beyond the limits of their training set.
- pixl97 10mo agoI mean they came up with it then very slowly, they would quickly have to learn everything modern if they wanted to compete... Kind of a version of you don't have to run faster than the bear, you just have to run faster than the person beside you.
- Retric 10mo agoGreek philosophers came up with vastly more wildly incorrect theories than correct ones. When you only celebrate success simply coming up with more ideas makes things look better, but when you look at the full body of work you find logic based on incorrect assumptions results in nonsense.