3 ms·
It seems hard to get a baseline, though. We experience the universe continuously, and so we see examples constantly with various levels of applicability. Mostly
by bee_rider 2y ago
It seems hard to get a baseline, though. We experience the universe continuously, and so we see examples constantly with various levels of applicability. Mostly we manage to leverage similar experiences (we roll a ball and have some expectation based on decades of rolling balls, how a ball ought to roll). Lots of things in the physical world fit these sort of analogies pretty well.
I actually think a good source of really novel experiences is videogames, because they have (often poorly programmed) mechanics that aren’t constrained by the real world. And discussion around that stuff is full of errors—hold down and b to catch more Pokemon!—I don’t think we generalize in truly novel situations very well at all.
Because AI’s don’t have thousands of hours of marble rolling and rock skipping, how can we evaluate their ability to study fields and waves?
- ben_w 2y agoWith humans, we approximate this with school grades. School grades correlate, imperfectly but they do correlate, with IQ test scores — that's actually where IQ tests came from. IQ tests (and school grades) are imperfect, but again they still correlate somewhat with general success in life. Unfortunately, school grades aren't quite right as a measure for AI intelligence despite being interesting measures for AI capabilities, as AI are effectively studying much longer than any human when you adjust for raw processing speed — a human simply cannot read English Wikipedia in their lifetime, it's too long, but that's just a small part of the training set for a good LLM. > Because AI’s don’t have thousands of hours of marble rolling and rock skipping, They can if you put it on their curriculum. > how can we evaluate their ability to study fields and waves? Same way as a human with the same subjective experience.