3 ms·
Their hardware is incredible. Why aren’t more investors lining up for this in this environment?
by lvl155 1y ago
Their hardware is incredible. Why aren’t more investors lining up for this in this environment?
- dmitrygr 1y agoContradictions do not exist. Whenever you think that you are facing a contradiction, check your premises. You will find that one of them is wrong.
- deleted 1y ago[deleted]
- thfuran 1y agoNeither do perfectly efficient, perfectly rational markets.
- sejje 1y agoA perfectly efficient market would be a bad premise, sure.
- orbifold 1y agoIn this case the hardware is a nightmare to program.
- dmitrygr 1y agoBingo
- arisAlexis 1y agoOr just bad marketing vs the Goliath (Nvidia)
- Invictus0 1y agoKurt Gödel would like a word
- no_flaks_given 1y agoThis model is super quantized and the quality isn't great, but that's necessary because just like everyone else except for Nvidia and AMD They shat the bed. They went for super crazy fast compute and not much memory, assuming that models would plateu at a fee billion parameters. Last year 70b parameters was considered huge, and a good place to standardize around. Today we have 1t parameter models and we know it still scales linearly with parameters. So next year we might have 10T parameter LLMs and these guys will still be playing catch up. All that matters for inference right now is how many HBM chips you can stack and that's it
- smallerize 1y agoCerebras doesn't normally quantize the models. Do you have more information about this?
- d3vr 1y agoIt's FP8 [0] [0]: https://xcancel.com/CerebrasSystems/status/1951350337186701506#m https://xcancel.com/CerebrasSystems/status/19513503371867015...