4 ms·
If you were a really good academic, you could come up with a theory that predicts the performance of a model you haven't actually tested. Physics is full of thi
by EnigmaFlare 2y ago
If you were a really good academic, you could come up with a theory that predicts the performance of a model you haven't actually tested. Physics is full of this - theories that predict something novel followed by other people doing expensive experiments to test them. The guy who published the theory gets the credit. That's probably what we want from academic AI researchers - theories that we can eventually use to design models, rather than just haphazardly building something and wondering how good it will be.
- light_hue_1 2y agoThat theory sounds great. There's no such thing at the moment and maybe never. Lots of smart people have tried. Just because that's what people want, doesn't mean we can produce it. I often talk to funding agencies about things like this. "We don't want to fund boring research, only what will give us the ultimate theory of how everything works". That's not how science or progress work.
- aleph_minus_one 2y ago> That theory sounds great. There's no such thing at the moment and maybe never. Lots of smart people have tried. In my opinion the problem rather is that considering the current AI gold rush, people are rather eager to throw newly implemented models around instead of thinking really deeply how an insanely better model could look like.