4 ms·
Somebody please tell me how many ResNet50 inferences you can do per second on one of these chips Here is the standalone AVX-512 ResNet50 code (C99 .h and .c fi
by 37ef_ced3 6y ago
Somebody please tell me how many ResNet50 inferences you can do per second on one of these chips
Here is the standalone AVX-512 ResNet50 code (C99 .h and .c files):
https://nn-512.com/browse/ResNet50 https://nn-512.com/browse/ResNet50
Oops, AMD doesn't support AVX-512 yet. Even Zen 3? Incredible
- tanelpoder 6y agoYou mean on the CPU, right? This CPU doesn't support AVX-512: $ grep ^flags /proc/cpuinfo | egrep "avx|sse|popcnt" | sed 's/ /\n/g' | egrep "avx|sse|popcnt" | sort | uniq avx avx2 misalignsse popcnt sse sse2 sse4_1 sse4_2 sse4a ssse3 What compile/build options should I use?
- 37ef_ced3 6y agoNo AVX-512, forget it then
- xxpor 6y agoThey don't have avx512 instructions.
- wyldfire 6y agoWhoa, this code looks interesting. Must've been emitted by something higher-level? Something like PyTorch/TF/MLIR/TVM/Glow maybe? If that is the case, then maybe it could be emitted again while masking the instruction sets Ryzen doesn't support yet.