3 ms·
AI inference on existing model instances need not be very compute-intensive at all. The "training" (i.e. model fitting) phase is what requires a lot of compute
by zozbot234 5y ago
AI inference on existing model instances need not be very compute-intensive at all. The "training" (i.e. model fitting) phase is what requires a lot of compute resources.
- tyingq 5y agoThey are talking about customers spinning up Linux instances on their existing (mostly not Linux) mainframes, and special software to allow SIMD calls from Tensorflow to work, etc. I think that making a remote call out to a commodity box is probably easier in most cases.