3 ms·
What sort of application shows a noticeable speedup if we manage to make bitset decoding, say, ten times faster?
by kazinator 8y ago
What sort of application shows a noticeable speedup if we manage to make bitset decoding, say, ten times faster?
- pierrebai 8y agoIn this case, Mr Lemire previously design with collaborators a fast JSON parser (GB/s) that required such bit detection. You can find previous papers in his blog.
- booblik 8y agoProf Lemire
- subprotocol 8y agoIt's used everywhere in analytics applications and particularly noticeable at scale. For specific example- We use roaring bitmaps (also from Lemire) in an inverted index to make count queries instant (depending on the query and encoding, top-n queries do 20B events per second per core in our application).
- davidgould 8y agoCould you elaborate on this a little? I'm aware of roaring bitmaps, but not understanding the problem and solution you are describing. Thanks!
- astrange 8y agoVideo playback has been moved to dedicated hardware, but it and other kinds of decompression would help. I actually didn't know ARM didn't have popcount.
- londons_explore 8y agoA good chunk of video playback is still in software. As well as application developers using silly formats (Hello GIF!), new video formats tend to start getting use before hardware is ready, and some DRM schemes can't or won't use hardware decoding.