2 ms·
Wow. This is absolutely wild. I didn't expect that. If we get to anywhere near this speed for the equivalent of the current models... I don't even know what to
by christophilus 3mo ago
Wow. This is absolutely wild. I didn't expect that.
If we get to anywhere near this speed for the equivalent of the current models... I don't even know what to think about that future.
- apitman 3mo agoSpeed is the metric I'm currently most interested in. The models are smart enough. Once speed significantly increases I think we're going to see some interesting downstream effects. The three things I currently spend the most time waiting on are LLM API requests, Rust compile times, and nix derivations. As AI latency approaches zero I think we're going to start taking a hard look at whether slow-compiling languages are adding enough value over Golang, Typescript, or even dynamic languages to be worth the slowdown.
- blovescoffee 3mo agowhat do you mean "if"? of course we will, and the models will be smarter as well
- jaggederest 3mo agoYeah. A model smarter than Fable by, say, 50 human IQ point equivalents, running in some kind of autoregressive process continously on whatever goals you put into the loop, on baked silicon, would be maybe my low end for the potential in the relatively near future.