2 ms·
The 3.5x energy-efficiency gap between serial and SIMD code becomes even larger when A. you do byte-level processing instead of float words; B. you use embedd
by ashvardanian 3y ago
The 3.5x energy-efficiency gap between serial and SIMD code becomes even larger when
A. you do byte-level processing instead of float words;
B. you use embedded, IoT, and other low-energy devices.
A few years ago I've compared Nvidia Jetson Xavier (long before the Orin release), Intel-based MacBook Pro with Core i9, and AVX-512 capable CPUs on substring search benchmarks.
On Xavier one can quite easily disable/enable cores and reconfigure power usage. At peak I got to 4.2 GB/J which was an 8.3x improvement in inefficiency over LibC in substring search operations. The comparison table is still available in the older README: https://github.com/ashvardanian/StringZilla/tree/v2.0.2?tab=readme-ov-file#substring-search https://github.com/ashvardanian/StringZilla/tree/v2.0.2?tab=...