3 ms·
AI in my mind has always been hammering down this single path of: build network, train it with x data for y iterations, and then feed live data and evaluate out
by bob1029 9y ago
AI in my mind has always been hammering down this single path of: build network, train it with x data for y iterations, and then feed live data and evaluate outputs. This approach to me seems like a glorified digital signal processing system. I think there are countless applications for this approach and I think AI is an appropriate umbrella term, but there is so much potential beyond this - Artificial General Intelligence/Strong AI/etc. I think neglect for time is a major reason we haven't seen breakthrough progress in this area.
Today, how do we handle time-series data (e.g. audio, video, sensors) in an AI? The first thing most people would do is look at an RNN technique such as LSTM which enables a memory over arbitrary time-frames. But even in this case, the definition of time is deceptive. We aren't talking about actual, continuous time. All of the approaches I have ever seen are based upon the idea that the network is discretely "clocked" by its inputs (or a need to evaluate a set of inputs). What happens if you were to zero-out all input and arbitrarily cycle one of these networks a million times? From the perspective of the network, how much actual time has elapsed? How much real-world interaction and understanding is possible without a strong sense of time? I think the time domain has been a major elusive factor for a true general intelligence.
What if you were to base the entire architecture of an AI in the time domain - That is to say, by using a real-time simulation loop which emulates the continuous passage of time? This would require that all artificial neurons and even the network structure itself be designed with the constraint that real time will pass continuously, and it must continue to operate nominally even in the absence of stimuli. In my mind this is a much closer approximation of a biological brain and looks a lot more like the domain a general intelligence would have to operate in. Continuous time domain enables all sorts of crazy stuff like virtual brain waves at various sinusoidal frequencies, day/night signaling, etc. I have found no prior art in this area, but would look forward to reviewing something I might have missed. I've already got a few ideas for how I would prototype something like this...