I agree that the author's interpretation of a continuous function is -umm- lacking, but I think it is thought provoking if you try to read it as what he probabl

I agree that the author's interpretation of a continuous function is -umm- lacking, but I think it is thought provoking if you try to read it as what he probably meant, a continuous topological mapping from the character sequence to some function of the semantics of the text. Assuming that mapping does not exist would imply that we'd need more than a LSTM to build a proper language model some day. Yet, LSTMs are probably as close to a perfect model as we can currently get... So maybe this line of thought can help somebody imagine the "missing piece"?