felippee

10 ms·

121.
by felippee 10y ago
The idea is not new indeed, Andy Clarks's review paper was very inspiring to us. But it has not been detailed to a point of implementation/scaling. PVM is an attempt to implement it in a "connectionist" way, but frankly
122.
by felippee 10y ago
Yes, the field has emerged out of MNIST/ImageNet and that is what those algorithms are optimised for. For modelling actual dynamics different design is necessary. It happens that the design that makes sense also seems to agree very wel
123.
by felippee 10y ago
Hi, I'm the blogger. I just want to add a very simple statement: In order to create a model of the world, the machine learning substrate has to have the capacity to cover the observed dynamics. Hard not to agree with this, almost sound
124.
by felippee 10y ago
To some extent it does fill in based on what it has seen before. Although there is a fair number of parameters in that model, it cannot memorise the entire clip. This is apparent, since the "dream" sequences cannot reproduce the e
125.
by felippee 10y ago
Just to note: although the models discussed in this blog can be arbitrary deep and rely on multilayer perceptrons, the principles of learning are completely different then in other contemporary deep learning: the error is injected at every
126.
by felippee 10y ago
There is a never ending confusion caused by the term "AI" to begin with. Term coined by John McCarthy to raise money in the 60's is really good at driving imagination, yet at the same time causes hype and over-expecations. Th