4 ms·
The Shazam app on my wife’s iPhone can identify TV shows and movies very quickly, sometimes nearly instantly. Not sure how it does that.
by Wistar 21d ago
The Shazam app on my wife’s iPhone can identify TV shows and movies very quickly, sometimes nearly instantly. Not sure how it does that.
- beached_whale 21d agoIt is pretty neat and several resources online explaining it but it chunks the recoding and does a hash of the fft of each frame i think which reduces the data a lot. The server has a pre hashed database https://hackernoon.com/how-shazam-works-in-a-nutshell https://hackernoon.com/how-shazam-works-in-a-nutshell
- beached_whale 21d agoI forgot the part about finding the dominant frequency in each chunk
- dylan604 21d agoTV shows are completed and in the can well before air date. It is entirely plausible that the interested party in having the content identifiable by Shazam like services submit whatever needs to be submitted for new content
- 3eb7988a1663 21d agoI have also wondered about the possibility of media emitting some kind of hidden identifier. Can normal speakers emit noise outside of human hearing that could contain a unique id? Would not even need to be a lot of data that could be broadcast.
- corysama 21d agoThat's not necessary. If a service has access to the raw audio of a show, it can fingerprint each second of that audio in a way that can be matched in a tiny amount of computation even for a recording in a noisy environment. That can't recognize what you say. But, it can ID where you are in a specific show out of zillions of hours of shows.
- lazide 21d agoNotably, the caught the TV also recording and transmitting recorded audio and transcripts from the microphone.
- gharper 21d agoHonestly, it doesn’t even need to be outside the range of human hearing. A quick search for “audio steganography” should answer your question (and be a fun rabbit hole if you find that sort of topic interesting)
- fc417fc802 21d agoYes, it's possible. Some sports broadcasts do this. The ones I'm familiar with use a high pitched tone on the edge of human hearing but still audible to most people. Streaming services watermark the video as opposed to the audio as I understand it. But that's for tracing pirated content back to the originating user account. It's not particularly useful (also entirely unnecessary and overly complicated) if your goal is to ID a piece of content as opposed to an account.
- dylan604 20d agoLive broadcasts make it hard for Shazam type apps to ID something from a fingerprint, so they need something else to help.
- RobRivera 21d agoSignals analysis is pretty refined and not THAT compute intense.
- corysama 21d agoI know a guy who made a Shazam-like phone app that can listen to a few seconds of noisy audio and make a fingerprint that can be used to quickly ID those specific few seconds out of a pre-fingerprinted archive of an enormous amount of audio (zillions of hours of TV). Making the fingerprint requires a tiny amount of very smart code (in C with no dependencies). But, the fingerprint is not useful for understanding audio that's not in the archive.