I agree - You could frame LLMs this way. Tokens over "time" where time just happens to be represented by discrete, sequential memory. Each token could encode a

I agree - You could frame LLMs this way. Tokens over "time" where time just happens to be represented by discrete, sequential memory. Each token could encode a specific amplitude for the signal. You could literally just have tokens [0,1,...,MAX_AMPLITUDE] and map your input signal to this range. In the most extreme case, you could have 2 tokens - zero and one. This is the scheme used in DSD audio. The only tradeoff is that you need way more samples per unit time to represent the same amount of information, but there are probably some elegant perf hacks for having only 2 states to represent per sample. There are probably a lot of variations on the theme where you can "resample" the input sequences to different token rate vs bits per token arrangements.