3 ms·
It's a 2x boost for training since you can't use int8 for training and need fp16. INT8 is a 4x for inference, but most people aren't using GPUs for inference a
by Eridrus 10y ago
It's a 2x boost for training since you can't use int8 for training and need fp16.
INT8 is a 4x for inference, but most people aren't using GPUs for inference atm.
- scottlegrand 10y agoSome of us are... https://blogs.aws.amazon.com/bigdata/post/TxGEL8IJ0CAXTK/Generating-Recommendations-at-Amazon-Scale-with-Apache-Spark-and-Amazon-DSSTNE https://blogs.aws.amazon.com/bigdata/post/TxGEL8IJ0CAXTK/Gen...
- Eridrus 10y agoFair enough; when I said most people I meant companies who are not AmaGooFaceSoft and their international equivalents. Though I can't quite tell if you're doing GPU batch predictions and storing them or doing them in realtime with Spark Streaming. Unrelated question though: any chance you will do blog post/paper about how DSSTNE does automatic model parallelism and gets good sparse performance compared to cuSparse/etc?