3 ms·
There's a good point to be made about continuous functions, but the author hasn't made it, because he/she doesn't know the difference between continuous functio
by jmmcd 10y ago
There's a good point to be made about continuous functions, but the author hasn't made it, because he/she doesn't know the difference between continuous functions and time-series.
> What is a continuous function (or continuous data)? It is a sequence where each item is related to the one before and one after determined by a process.
So, to paraphrase the article: My reply should actually stop here with one sentence.
- fnl 10y agoI agree that the author's interpretation of a continuous function is -umm- lacking, but I think it is thought provoking if you try to read it as what he probably meant, a continuous topological mapping from the character sequence to some function of the semantics of the text. Assuming that mapping does not exist would imply that we'd need more than a LSTM to build a proper language model some day. Yet, LSTMs are probably as close to a perfect model as we can currently get... So maybe this line of thought can help somebody imagine the "missing piece"?