5 ms·
How does Shazam work?
- dataviz1000 6mo agoAdd to my list of projects. Dinosaur game but with audible clucks to jump.
- cellular 6mo agoI did this for a science project in 1986 on an Apple ][c computer !
- gnabgib 6mo agoAgain? Oh I see.. SCP (this domain is sus) From CameronMacLeod (2022) - and much more complete analysis (587 points, 2023, 155 comments) https://news.ycombinator.com/item?id=38531428 https://news.ycombinator.com/item?id=38531428 Or Slate (2009) (50 points, 16 comments) https://news.ycombinator.com/item?id=893353 https://news.ycombinator.com/item?id=893353
- cyral 6mo agoThe interactive parts of this post are very cool though
- BLKNSLVR 6mo agoForgive my ignorance, but what does SCP mean in this context? (my normal go-to of 'secure copy' doesn't fit). Thanks for the other links, the question in this title is one I've day-dreamily thought about on occasion, but never dug into. Will have a read of all three.
- Animats 6mo agoVaguely relevant pop-culture reference.[1] [1] https://scp-wiki.wikidot.com/glossary-of-terms https://scp-wiki.wikidot.com/glossary-of-terms
- BLKNSLVR 6mo agoI seem to have wandered into a parallel universe. I think it'll take me longer to understand WTF SCP is than it will to understand how Shazam works.
- deleted 6mo ago[deleted]
- eichin 6mo agoprobably the HN-specific "Second Chance Pool" for resurfacing links
- swyx 6mo agorelated comments from Shazamers - OG shazam paper https://www.ee.columbia.edu/~dpwe/papers/Wang03-shazam.pdf https://www.ee.columbia.edu/~dpwe/papers/Wang03-shazam.pdf (he has a talk on youtube btw look it up if really care) - https://news.ycombinator.com/item?id=18069968 https://news.ycombinator.com/item?id=18069968 shazam employee blogpost - https://news.ycombinator.com/item?id=38538996 https://news.ycombinator.com/item?id=38538996 shazam cofounder endorsed explainer - go algo repro https://news.ycombinator.com/item?id=41127726 https://news.ycombinator.com/item?id=41127726 as with all ML things... the code is much less % of the value than the data...
- Animats 6mo agoRecognizing a recording isn't hard to do, because, for the same recording, the chords follow each other with precisely repeatable timing. That's been around for well over a decade. Recognizing a different recording, say, a, cover version, of the same song, is much more work. Audible Magic claims to be able to recognize multiple performances of the same songs, and even parodies.[1] Using, of course, "AI technology" and much more compute. [1] https://www.audiblemagic.com/2024/02/07/identifying-cover-songs-live-performances-ai-clones-and-more/ https://www.audiblemagic.com/2024/02/07/identifying-cover-so...
- bitexploder 6mo ago20 years at least. I remember seeing how Gracenote worked back in the day when I was consulting for them.
- andai 6mo agoWhy is this harder than "delete timing information" ?
- Gigachad 6mo ago"Isn't hard to do" is doing some heavy lifting. Obviously on a society level it's simple tech we managed ages ago. But I would bet if you tasked individual devs at building it without looking up the answer, very few could do it.
- dackdel 6mo agovoodoo
- thakoppno 6mo agoPerhaps obviously this is the same technique that enables ACR on TVs. It occurs to me that Shazam has such a better reputation online because the intent and consent of the user is honored. It makes me wonder if there couldn’t be an implementation on TVs that is similar and actually is a net positive for consumers. Basically would customers actually like TV ACR if the data wasn’t just going to sell more ads?
- krustyburger 6mo agoSo the value-add would be the consumer would get to find out the name of the show or movie that’s playing, the same info that also pops up if they hit the pause button?
- thakoppno 6mo agoI was thinking more like interactive content. Do you remember when VH1 had a pop-up music video show? Shows could synchronize additional content that’d be visible when Shazam mode enabled.
- w-ll 6mo agoPop. Pop. Pop Up Video.
- flymasterv 6mo agoWe did this on Fire Phone for live sports and audio based X-Ray cast info. It was, like everything about that phone, a really fun tech demo.
- zevyoura 6mo agoI find Youtube's watch history helpful, having that across everything I watched on my device would be even better.
- wood_spirit 6mo agoReminds me of Roy Van Rijn’s prototype that got a cease and desist letter! Lots of community disappointment at the time! https://hn.algolia.com/?q=royvanrijn https://hn.algolia.com/?q=royvanrijn
- blackjackfoe 6mo agoNo "AI" required!
- G_o_D 6mo agoOut of curiosity is it possible to prevent shazam like app from detecting maybe by adding noise or any technique ?
- knodi123 6mo agoNot unless your noise is louder at certain dominant frequencies than the source. The article gives examples, but the algorithm basically throws away everything except frequency peaks, in order to make the lookups faster.
- Gigachad 6mo agoProducers/DJs manage this one by just not releasing their music or edits for ages if ever.
- krishna_dam 6mo agoSurprised to see how that got it worked with out all the "AI" bluff
- yawpitch 6mo agoThis has been explained so many times… a wizard imbued the kid with the powers of Solomon, Hercules, Atlas, Zeus, Achilles, and Mercury.
- flyuk 6mo agoNice article - enjoyed reading!
- larodi 6mo agoThere's an algo called dynamic time warping (DTW) and is very often overlooked. My wild guess would be is at play @Shazam.
- old_bayes 6mo agoAyyy I used DTW to track bots on a certain social media site. They tend to act in herds so DTW helps smooth out delayed, repeat actions.
- larodi 6mo agoIs a brilliant algo, and also works for multi-dim data. U can choose different distance functions - still works. Perhaps Dijkstra-shortest-path level significant for the robotic/ai era.
- SilverElfin 6mo agoI feel like it does not work well. Shazam struggles to recognize music in real life environments that have some background noise, even with a lot of time. It’s much worse than the built in music recognition Google’s phones have, for example.
- rmnclmnt 6mo agoMight be the best visual explainer of Shazam original audio fingerprinting algorithm from the 2003 paper (I guess they´ve switched to ML models at some point?)
- sandos 6mo agoWell, my latest guess is: not at all. It has been working "fine" for me generally for popular music. But then I was at a ice skating competition where there were some really nice synth:y music going on in the pauses, and I used Shazam on several of the songs, and I tried several times on each. It did not find a single one correctly. Either this was unreleased music or very small niched music or something, or Shazam totally failed?
- wrxd 6mo agoTangential. This is a cool website, so cool that I tried to subscribe to it in my RSS reader… and it didn’t work. If any of the authors read this message, please consider adding a RSS feed and you’ve got a subscriber!
- shriracha 6mo agoThank you! This has been on my list forever, finally added it today: https://perthirtysix.com/rss.xml https://perthirtysix.com/rss.xml
- deleted 6mo ago[deleted]
- dexihand 6mo agoCepstrum mentioned
- y1zhou 6mo ago> On the flipside, this "fingerprint" approach is also what makes Shazam work poorly if you just sing into it. You're likely to generate different hashes than the original song, even if you are a very good singer! This is why newer, machine-learning-based systems are built to handle humming and singing, by matching on melody rather than exact frequencies. So this is why singing/whistling a song to my phone never worked! I've always imagined the tech as some sort of wave pattern matching but the DFT is obviously more efficient for many scenarios. Cool article!