3 ms·
Why stop at half-precision floats? Why not go all the way to 3-bit floats? And build a hardware accelerator out of them? Tom Murphy has you covered with: the Na
by btown 4y ago
Why stop at half-precision floats? Why not go all the way to 3-bit floats? And build a hardware accelerator out of them? Tom Murphy has you covered with: the NaN Gate.
https://www.youtube.com/watch?v=5TFDG-y-EHs https://www.youtube.com/watch?v=5TFDG-y-EHs
http://tom7.org/nand/nand.pdf http://tom7.org/nand/nand.pdf
- deleted 4y ago[deleted]
- astrange 4y agoOr 1-bit. https://towardsdatascience.com/binarized-neural-networks-an-overview-d065dc3c94ca https://towardsdatascience.com/binarized-neural-networks-an-...
- 082349872349872 4y agoI <3 binary3; it achieves the theoretical goal of knowing the value of everything (at least, pace Everett, as approximated by {0,1,∞}) while being blithely unconcerned with the cost of anything.
- UncleMeat 4y agoSadly, from the following year's sigbovik the validity of binary3 is disputed (http://sigbovik.org/2020/proceedings.pdf http://sigbovik.org/2020/proceedings.pdf, https://twitter.com/stephentyrone/status/848172687268687873 https://twitter.com/stephentyrone/status/848172687268687873)
- 082349872349872 4y agoAs much as I am saddened to learn binary3 is invalid, I am overjoyed to learn that sigbovik has its own (non-self-cite!) literature graph.