3 ms·The context window is 16 characters. Talking about tokens per second is meaningless.by genxy 4mo agoThe context window is 16 characters. Talking about tokens per second is meaningless.dominotw 4mo agoits not meaningless. there could be usecases like spell correction.genxy 4mo agoIt is only interesting as an academic exercise in EDA design. Just like microGPT. For something with an n^2 complexity and advertising perf is clickbait.