3 ms·
I wonder to what extent running a quality AI will require a lot of FLOPs as a baseline or specialized hardware to achieve low FLOPs. Human brains fire only pat
by tehjoker 6y ago
I wonder to what extent running a quality AI will require a lot of FLOPs as a baseline or specialized hardware to achieve low FLOPs.
Human brains fire only paths in use (and do everything in parallel), but a neural network needs to recalculate the weights on the whole network each training pass for example. Maybe there are some newer techniques that reduce that somewhat.
- wutbrodo 6y agoI don't think it's a given that the architectures that get us to AGI will be constrained in exactly the way current neural networks are.
- CodeGlitch 6y agoYes I could be like the difference between birds and planes, still using the laws of aerodynamics but in a different way. One of those scales, the other doesn't.