3 ms·
>I'm not convinced, mostly because things like crypto, which I believe went into ASICs, were based on very slowly moving and mostly understood algorithms. Yest
by teleforce 3mo ago
>I'm not convinced, mostly because things like crypto, which I believe went into ASICs, were based on very slowly moving and mostly understood algorithms.
Yesterday there's a news on a breakthrough for probabilistic computer with 1 million p-bits [1].
Since LLM is stochastic in nature, this type of new computer can be much better than ASIC for processing LLM data.
[1] Biggest Probabilistic Computer Turns Noise into Answers:
https://news.ycombinator.com/item?id=48971938 https://news.ycombinator.com/item?id=48971938
- nightski 3mo agoExcept LLMs are not stochastic in nature. Correct me if I am wrong, but it's just the final layer which outputs a distribution across the output tokens. In reality, the rest of the model is deterministic. This is not like a bayes model or something were it's distributions all the way down.