3 ms·
I also think 128 bit is overkill. But I wonder with this AI push, if 128 bit may help with processing and power ?
by jmclnx 2y ago
I also think 128 bit is overkill. But I wonder with this AI push, if 128 bit may help with processing and power ?
- yjftsjthsd-h 2y agoYou don't need 128 bits for memory addressing, but for just processing - yes, and in fact 128 bits is far less than we're using already! If you look at https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp you'll see this line: > AVX, AVX2 and AVX512 support for x86 architectures Guess what the 512 in AVX512 stands for?;) On GPUs I'm pretty sure the same thing is in play, but I'm less familiar. A quick search turns up ex. https://developer.nvidia.com/blog/implementing-high-precision-decimal-arithmetic-with-cuda-int128/ https://developer.nvidia.com/blog/implementing-high-precisio... which makes me think yes.