3 ms·
Ternary neural networks and possibly new innovations in attention are the end of trillion dollars NVIDIA.
by 29athrowaway 2y ago
Ternary neural networks and possibly new innovations in attention are the end of trillion dollars NVIDIA.
- galeos 2y agoThese are MLPerf training results. I think current ternary quantization research is focused more on speeding up inference?
- alisiddiq 2y agoNot necessarily, if the training is more efficient, you just throw more data at it for better models which was not possible before
- buildbot 2y agoWhy? Will Nvidia just fall over if ternary networks become realistic? Or will they build a ternary Rubin? I know which one I think is more likely.
- selimthegrim 2y agoRubin?
- buildbot 2y agohttps://arstechnica.com/information-technology/2024/06/nvidia-jumps-ahead-of-itself-and-reveals-next-gen-rubin-ai-chips-in-keynote-tease/ https://arstechnica.com/information-technology/2024/06/nvidi...