4 ms·
They say it supports millions of songs so I doubt that’s how they are doing this. They are likely using a sophisticated ML version of what old karaoke machines
by whiddershins 4y ago
They say it supports millions of songs so I doubt that’s how they are doing this.
They are likely using a sophisticated ML version of what old karaoke machines did, and removing the vocals in real-time.
- Wowfunhappy 4y agoEven if they're using ML, I don't imagine they'd do it on-device. They don't even do voice recognition on-device by default.
- Closi 4y ago> [Apple says it is] relying on an on-device machine learning algorithm that processes the music in real-time. The tech builds on Apple’s noise-cancellation expertise and other developments it’s made for FaceTime, the company said. Source: https://techcrunch.com/2022/12/06/apple-music-is-getting-a-new-karaoke-like-feature-apple-sing/?guccounter=1&guce_referrer=aHR0cHM6Ly93d3cuYmluZy5jb20v&guce_referrer_sig=AQAAAAEDs_9eWipE0_onnDd8TXeBzrsIRN7xJP2nkP0JfAx0_bvOIys4bJO18kyAct_f6BJsTGibaAA_70OYSg-QNgbQjTCurnO20qxLXwnKN3u-XauKPCB4d1MzfpTPzR3_NhaWjcEn883BRWtqJG0y4lTGurpk67gm-jI0_U_V-i0t https://techcrunch.com/2022/12/06/apple-music-is-getting-a-n...
- Wowfunhappy 4y agoAh, I stand corrected! I wonder why they took that approach...
- Closi 4y agoNot sure - although I would imagine that it would effectively double the storage and bandwidth/data requriement for Apple Music in general if they had to send two files with equal bitrate.
- notpushkin 4y agoI stand corrected as well! Wonder why they take this approach though, as it is clearly over-engineering (if I correctly understand that the goal is just to make vocals volume adjustable).
- dperfect 4y agoMaybe it's licensing? I can imagine copyright holders being squeamish about Apple processing, permanently storing, and serving heavily altered versions of their music. The difference is silly and pedantic, but by processing it in real-time during playback, one might argue it's just a filter effect like EQ.
- Closi 4y ago> Wonder why they take this approach though, as it is clearly over-engineering (if I correctly understand that the goal is just to make vocals volume adjustable). Depends what the other non-functional requirements were. i.e. if the NFRs were as follows: * Cannot increase bandwidth / mobile data usage. * Cannot impact music quality / bitrate. * Has to work offline. * Cannot increase on-device storage. * Has to be responsive. Then two audio streams might not work. Another advantage of doing it on-device is that it doesn't actually change any of the backend architecture too. It might be a lot of change to a lot of systems for a feature which only adds a small amount of functionality - i.e. architecting your entire backend and streaming around seperating audio tracks might not be the right focus.