4 ms·
“ You can image-bash together faces from examples and get something mostly-right simply through pattern copying. … You cannot do the same with hands, because re
by fwlr 4y ago
“ You can image-bash together faces from examples and get something mostly-right simply through pattern copying. … You cannot do the same with hands, because rendering them plausibly requires at least intuition and approximation of inverse kinematics”
Not sure I agree. I think hands probably just require ~1 OOM more image-bashing than faces, and training sets had ~1 OOM less samples of hands than faces. E.g. faces need 1 trillion cumulative Tflops while hands need 10 trillion cumulative Tflops, and because there were more faces than hands in the training set, by the time we reached 1T on faces we had reached 0.1T on hands. (numbers made up)
Appeals to needing understanding of deeper or underlying principles like chess rules or inverse kinematics compel me to bring up the bitter lesson http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html