3 ms·
> The neural engine is small and inference only Why is it inference only? At least the operations are the same...just a bunch of linear algebra
by LeanderK 4y ago
> The neural engine is small and inference only
Why is it inference only? At least the operations are the same...just a bunch of linear algebra
- londons_explore 4y agoInference is often done fixed point, whereas training is (usually) floating point. Inference also prefers different IO patterns, because you don't need to keep the activations for every layer ready for backpropogation.