3 ms·
> My Tiger repelling rock^^^^^^leopard detection model works great on all animal pictures ... until you feed it a sofa I'm sorry, how is this different than no
by godelski 5y ago
> My Tiger repelling rock^^^^^^leopard detection model works great on all animal pictures ... until you feed it a sofa
I'm sorry, how is this different than normal software engineering? There's dozens of unit/integration testing memes poking fun at specifically this (which is a mostly solvable problem in ML btw, when you use out of distribution data. Give your model a 3rd end state that represents "neither").
> id did none of that, what this model did is learn all the frames of video and their chronological order according to the input.
A better explanation is that the network knows what frame to generate given the current frame (and n previous frames) and the current user input. If it was memorizing then it'd have to generate an extremely large number of scenarios (it would exponentially grow as any given frame has k possible actions from your current frame to the next frame). If Sendex can run the game for arbitrary length and take arbitrary actions then it is a far more reasonable explanation that the model is generating the frames rather than memorizing. Apply Occam's Razor.
Edit: Sentdex said the model was ~173MB, so that is not large enough to memorize the gameplay.
- motohagiography 5y agoMaybe I'm misinterpreting, but if you've ever seen a cat freak out about a cucumber (an entire video genre, apparently), ostensibly real intelligences make similar errors. Beyond rote memorization, it looks like it could be explained by saying the model appears to have a found a concept of consonance and dissonance that is bounded within the field of its inputs, and a networked grammar for interacting with the up/down/left/right inputs. Some people might find that technically trivial, but as a layman I am impressed. The "magic" part is that the response of the network appears to be so complex relative to its inputs, but given the input is so limited from a controller, it's easy to attribute more meaning to it when it is working with a finitely bounded simulated model. Generally I'd wonder, if the behaviour appears more complex than the stimuli, do we tend to attribute intent to it?