5 ms·
The most exciting part about ternary or binary weights is the inevitable hardware revolution for AI dedicated chips that's going to result from it.
by kromem 3y ago
The most exciting part about ternary or binary weights is the inevitable hardware revolution for AI dedicated chips that's going to result from it.
- imtringued 3y agoYour hardware already supports addition and subtraction and the tensor cores of NVIDIA GPUs are already fast enough to keep up. The only benefit is reducing memory capacity and bandwidth requirements.
- Matumio 3y agoYou mean we'll have hardware accelerated ternary instructions? https://www.intel.com/content/www/us/en/docs/intrinsics-guide/index.html#techs=AVX_512&text=ternary&expand=5438,5437 https://www.intel.com/content/www/us/en/docs/intrinsics-guid... (Okay probably those are not ready to be used as NN weights if the activations are not binary too, but... the gap to what CPUs already can do is getting smaller.)