17 ms·
Surround Sound in Headphones
- AndrewUnmuted 6y agoThis article mentions the Waves NX system, but I think it's important for those interested to know that the Waves NX system is rather half-baked. It is not extensible, nor open source in any respect. It's proprietary and generally unavailable in any useful contexts. I was also surprised to see no mention of the Web Audio API implementations of HRTF and multi-channel ambisonic decoding down to binaural in the browser. This may well be today's most sophisticated approach to spatial headphone-driven audio.
- kabdib 6y agoMy first experience with the Waves NX stuff was on a Dell laptop; I started some music, and suddenly the "camera on" LED lit up. I spent the next few minutes searching the laptop for malware. I don't remember how I determined that it was Waves NX wanting to compute my head position and not some bad guy remote controlling the camera. Can't speak for the sound quality of Waves NX, as I have it turned off.
- lioeters 6y ago> Web Audio API implementations of HRTF and multi-channel ambisonic decoding down to binaural Curious, here are some related links I could find. - MDN: Web audio spatialization basics https://developer.mozilla.org/en-US/docs/Web/API/Web_Audio_API/Web_audio_spatialization_basics https://developer.mozilla.org/en-US/docs/Web/API/Web_Audio_A... - Implementing Binaural (HRTF) Panner Node with Web Audio API (2015) Article - https://codeandsound.wordpress.com/2015/04/08/implementing-binaural-hrtf-panner-node-with-web-audio-api/ https://codeandsound.wordpress.com/2015/04/08/implementing-b... Code - https://github.com/tmwoz/hrtf-panner-js https://github.com/tmwoz/hrtf-panner-js - WebGL / Web Audio API interface for listening to the CIPIC HRTF database https://github.com/kai5z/hrtf-simulation https://github.com/kai5z/hrtf-simulation
- triplesec 6y agoWavesNX may have been a good idea, but it's badly-made, fights with drivers, resulting it being in an actively-antagonistic piece of Dell bloatware, unfortunately.
- m463 6y agoI think it would nice to have headphones that can detect orientation accurately and do positional audio. Probably a gimmick but maybe some of the VR headset technology will trickle down.
- divbzero 6y agoApple offer spatial audio [1] for AirPods Pro or AirPods Max paired with newer iOS and iPadOS devices. [1]: https://support.apple.com/en-us/HT211775 https://support.apple.com/en-us/HT211775
- pta2002 6y agoThe AirPods Pro can do that
- yummypaint 6y agoThe valve index headset does a great job with this. They use speakers a few cm away from each ear. The sound is one of the most immersive elements in my opinion. It doesn't get alot of attention because it's so well implemented that it's almost hard to notice.
- podiki 6y agoYes, it is amazing. I do see it mentioned in reviews, or at least from user reviews especially about first experiences. Speaking of, my first time in a virtual room with the Index was super convincing because of the sound, less so my poor 970 struggling to keep up. I could move around and hear the sound sources stay fixed in a physical (virtual space). Lean towards a speaker on the desk and it gets louder exactly as you move your head. Sound is definitely underrated for creating a physical presence!
- bonestamp2 6y agoIf you don't want to use Airpods Pro, the Smyth Realiser can do it with any over-ear headphones of your choice. It's been around for at least 10 years in various configurations and supports many source inputs: https://smyth-research.com/ https://smyth-research.com/
- The_rationalist 6y agoIt's been 14 years since the last state of the art 3D audio experience: https://www.youtube.com/watch?v=IUDTlvagjJA https://www.youtube.com/watch?v=IUDTlvagjJA has anybody done as good since then ? What's this Cetera algorithm ?
- fractionalhare 6y agoHoly shit that demo is amazing. Are there more demos like that? I was wearing AirPods Pro and nearly jumped out of my seat, I thought someone walked into my room. That’s better than anything I’ve ever heard using so-called “spatial audio”, and it’s just surround sound.
- bentcorner 6y agoI've found Dolby Atmos for Headphones to be pretty good. I play the video game Overwatch and it integrates atmos into it's sound processing pipeline and the sound is incredibly accurate. You can tell when people are behind/in front/above/below you very reliably.
- XorNot 6y agoI was using my old QC15s in the office...I had to stop about a quarter way in because it sounded for all the world like it was just in the room with me, and I couldn't convince my brain that only I was hearing this. How have we not done better since? How is this not just in every video game now?
- yummypaint 6y agoI always thought it would be cool if someone made a sound-based gui alternative using spatial audio. Would open up capabilities on devices too small for screens.
- lloeki 6y agoThis rendition of Amiga tracker music is fantastic as well. https://youtu.be/W1bgMX4UCjw https://youtu.be/W1bgMX4UCjw
- joemaller1 6y agodarn it, just tell me what to buy.
- bonestamp2 6y agoAirPods Pro are good, but they only support iPhones/iPads as a source (I assume they'll add Apple TV later). I've heard the Sony system is good, but audio has to be encoded in Sony's format. I used to own the Smyth Realiser 8 and it was awesome. The latest version is the 16. It's rather expensive, which is maybe why the source article didn't mention it, but you can feed it almost any surround sound source. It's probably the most versatile (and expensive) of the bunch: https://smyth-research.com/ https://smyth-research.com/
- CardenB 6y agoAirPods Pro are normal Bluetooth headphones and support anything as source. You can also use a lightning to 3.5mm cable to connect them to an auxiliary port.
- bombcar 6y agoI believe they’re saying that spatial audio is only supported on the iPhone/iPad.
- paulcole 6y agoAren’t you thinking of the AirPods Max?
- bonestamp2 6y agoYes, they work as stereo headphones from any bluetooth source. I was speaking in the context of surround sound in headphones... AirPods Pro's spatial audio feature only works with a few surround sound formats and only with an iPad and iPhone. Spatial Audio is not supported on Apple TV or any other bluetooth device (for now). To use a lighting to 3.5mm connection, I think you meant the AirPods Max, not the AirPods Pro. On that note, the AirPods Max have the same spatial audio support/restrictions as the AirPods Pro.
- motohagiography 6y agoHacked around with this Anaglyph tool in Audacity for some music I was working on: http://anaglyph.dalembert.upmc.fr/ http://anaglyph.dalembert.upmc.fr/ Results were good, and it felt dependent on the resonance of the sound, where more pure tones seemed difficult to isolate the direction of (just like in real life). There are a number of plugins like it, and I think even GarageBand has a spatial filter for it. Was thinking through what a more modern audio game might be like given these features, it's such a rich area.
- PragmaticPulp 6y agoIf you don’t mind tinkering with software, the open source HeSuVi software supports various HRTFs (as captured by recording their impulse response) to produce binaural audio from multichannel sources: https://sourceforge.net/projects/hesuvi/ https://sourceforge.net/projects/hesuvi/ Useful for trialing different solutions but it’s quirky.
- 00jimbo 6y agoi went to a qualcomm presentation at CES a decade ago where they demoed surround sound with basic cheap stereo cans and it was impressive as hell. i was always surprised it never seemed to take off as a general thing.
- lumost 6y agomy 2 cents is that it's really tough to market high quality audio despite a clear market willing to buy high quality audio. There are dozens of ostensibly high quality brands selling 500 dollar headphones with drastically different audio quality. The audiophile community would often have you believe that all such headphones are junk and a random small brand has the best headphones of all. At least tvs have color accuracy/size/price. Headphones are not measured with any clear metric of quality as far as I've seen..
- ryanmcbride 6y agoI see you've also come across the cult of Stax "Earspeakers"
- chii 6y agoI think there needs to be a standard "demo" reel of audio quality, similar to the way TVs/displays have the multi-color grid/gradient thing for showing clarity of the pixels. It's hard to compare when a person goes into one shop and hears an action movie, but in another one he hears a concert/symphony on a different speaker/headset.
- gooderist 6y agoShameless plug: My company also makes virtual surround sound software for headphones. But unlike other solutions (like Atmos and Airpods Pro) we generate your HRTF from a photo of your ear using machine learning. If you're interested in this stuff, please check us out too: https://embody.co/ https://embody.co/
- vulcan01 6y agoHey! I bought a Sony headphone some time ago (WH-H900N, if you're wondering) and it told me to take a photo of my ear as well. Now I know why :)
- gooderist 6y agoI've seen a couple companies (Sony, Creative Labs, etc) do the ear photo thing like us but from what I recall they only use the photo to match you against a library of HRTFs. Our approach generates a unique HRTF for each user. But yes, I would expect to see a whole lot more of this in the near future from all the headphone makers.
- thih9 6y agoI’m wondering to what extent do you modify the incoming streams. Is there a description of the process or a before-after sample?
- tracyhenry 6y agoHow much is your product better at identifying footsteps in PUBG than a traditional headset?
- gooderist 6y agoHi, we don't sell headsets. Our software works with any pair of headphones. Really the comparison is how well does our personalized HRTFs perform for you compared to the generic HRTF that comes with PUBG. And I think this is a question that is better answered with a demo than a forum reply. Please give Immerse a try, we have free trials for everything.
- maximilianburke 6y agoMany years ago I had an Aureal 8830 Vortex 2-based soundcard and its spatial audio was amazing especially given that it didn't require any special hardware, beyond the soundcard itself. It was really crushing when Creative Labs bought Aureal and buried the IP.
- wave100 6y agoAn old laptop of mine (a Compaq Presario) had some Aureal A3D demos pre-installed on it. The one I remember the best was a spatial audio thing that let you walk around a forest with beehives everywhere. It was really good.
- ryukafalz 6y agoHRTFs are awesome, but I really wish we could have an open standard here and not a dozen competing proprietary ones. It feels like you really just need a standard way to encode the position of multiple audio tracks in 3D space and let your implementation of choice do the spatialization for you. Anyway, fun fact: OpenAL Soft has an implementation of this. If any games you play use it (Minecraft notably does) you can get 3D audio by just setting 'hrtf = true' in your OpenAL config.
- colanderman 6y ago> a standard way to encode the position of multiple audio tracks in 3D space Isn't that the idea behind Ambisonics [1], which OpenAL Soft is based on? [1] https://en.wikipedia.org/wiki/Ambisonics https://en.wikipedia.org/wiki/Ambisonics
- nitrogen 6y agoAmbisonics is for encoding a full-sphere soundfield. The components have a fixed location. Positioning individual tracks is not quite the same thing, as they can start/stop/move, and they are not limited to spherical harmonics. Video games have done exactly this for ages, but the only storage and distribution formats for that type of positional audio are still proprietary (e.g. Atmos).
- colanderman 6y agoThey should correct me if I'm wrong, but I believe the GP's point was that there should be a standardized way for software to present spatial audio to the sound system, which can then render it according to the user's preferences. How the sound is generated (e.g. moving point sources; spatial reverb; pre-spatialized tracks) does not matter. Yes, using even third-order Ambisonics is not as precise as rendering all point sources (and non-point sources...) exactly through the HRTF. But it is an existing standard you can use today via OpenAL Soft.
- nitrogen 6y ago
- jancsika 6y agoObviously an outlier here, but I have as much desire to hear sounds behind my ears as I do to see images around my butt. Best case scenario I've ever had is that it's distracting as hell.
- m-p-3 6y agoIn some games like tactical first-person shooters, having the ability to pinpoint accurately and with precision the footsteps or gunfire can make the difference between a kill or be killed.
- simonlc 6y agoMost of them do better with 2 speaker output. It's competitive, having a realistic sound is usually worse than one that is easily distinguishable.
- stubish 6y agoIt is for immersion, and distracting when it is not done. Having audio location decoupled from the audio source is immersion breaking, and distracting. This is a no-brainer for VR and 3d applications, but more nuanced for video. For a movie, do you want the action happening on the screen in front of you, or immersive with a sense of it going on around you? I think this is where opinions start differing.
- ziml77 6y agoI find the way some of these surround virtualizations work to be odd. Like when I used Atmos, it sounded more like I was in a room surrounded by speakers instead of like I was actually immersed in the content. Maybe that's desirable for movies? It certainly didn't make sense to me for games.
- runawaybottle 6y agoIt’s kind of the only way to establish a ‘sound stage’ with headphones. https://amp.reddit.com/r/headphones/comments/aouajt/what_headphone_model_has_the_best_soundstage/ https://amp.reddit.com/r/headphones/comments/aouajt/what_hea...
- TimTheTinker 6y agoThat makes sense, since Atmos is a discrete set of channels designed for speakers in specific locations around the listener. The alternatives are: - record a real sound space using a binaural mic head, then simply use 2-channel output. Head tracking not supported, HRTF is physical not modeled/virtual. - build a 3D virtual sound space. Apply the HRTF in post-production with output to 2 headphone channels. Head tracking can't be supported, but there's a lot more flexibility. - encode a potentially large number of discrete channels and their positions in 3D space (including reverb and room dynamics) and let the listener's system apply the HRTF. Would support head tracking, but the audio format would be super complex, as would be the rendering software. Reverb calculations in particular could eat up a lot of CPU. - render in post-production to a discrete number of channels that will be placed in known positions around the listener. This supports theaters and home surround setups, can be implemented in headphones using an HRTF, and would support head tracking - all at the same time. The only drawback is that in headphones, it sounds like speakers around you. Because that's exactly what the HRTF is doing with the input signal. It's easy to see why the last option is what we've landed on. It's the most flexible for the widest number of scenarios, it's a straightforward standard, and it's not too hard to emulate using an HRTF.
- Shish2k 6y ago> encode a potentially large number of discrete channels and their positions in 3D space This does seem like a lot - but at the same time, it doesn’t seem like much compared to the advances in graphics over the past decades? I feel like if audio had kept up with video, we should have an equivalent to Physically Based Rendering / raytracing by now...
- dandare 6y agoI would like to SEE the HRTF function in action. Is there maybe a web app where one could see the HRTF function while tinkering with different sound directions?
- adzm 6y agoOf interest, Sennheiser with dearVR provides a free vst plugin for spatial audio which is really fun to play with! https://en-de.sennheiser.com/ambeo-orbit https://en-de.sennheiser.com/ambeo-orbit
- nallic 6y agoI have a 5.1 surround system (with real speakers around me) and I find the lack of surround support in games sad. How come not any game supports output to a surround system - they have their sound sources in a 3D environment and should be able to mix a sound output with arbtrary speaker setup ?
- Agentlien 6y agoWhat games have you been playing and on what platform? I remember being amazed how well surround sound worked in Left 4 Dead 2 on PC back in 2010.
- nallic 6y agoex. Fortnite don't seem to support it (but it does support some binaureal sound). When I got the system I ran through a couple of games on my steam Library to try it out and found very few supported it. Most vere based on the big engines (Unity / Unreal) and I kind of just suspected it to be a compile time swith on the devs side, but maybe im wrong - are sounds mixed in a studio and not on a "per source" kind of way ? - maybe they are not really attached to a position.
- Agentlien 6y agoIt depends on the engine and how you set it up. But the big engines all support attaching sounds to positions and mixing is done in real-time. I remember a lot of effort went into making sounds feel right in the NFS games. Including mixing engine sounds recorded from different parts of the car to match the camera's position relative to the car. We even had an article about the process of recording those sounds: http://www.speedhunters.com/2015/10/recording-the-sounds-of-need-for-speed/ http://www.speedhunters.com/2015/10/recording-the-sounds-of-... Speaking to the sound engineers was one of those wonderful glimpses into a whole other field that I love about working in games.
- Agentlien 6y agoA quick Google search gives me this: https://www.pcgamingwiki.com/wiki/List_of_games_that_support_surround_sound https://www.pcgamingwiki.com/wiki/List_of_games_that_support... I can verify that at least parts of this list is correct. I remember getting jump scares when hearing monsters behind me in Dead Space 2, F.E.A.R., and as I mentioned earlier Left 4 Dead 2. One thing I will say is that settings screens usually do a poor job at showing whether they're using surround sound. Games often just query the system for audio setup and show little more than whether you've selected headphones or speakers. edit: since I thought it strange that your experience was so different from mine and that Fortnite wouldn't support it, I googled it and found an article from 2019 about how Fortnite, originally built for 5.1 surround sinds sound, now supports 7.1. My guess is there's some configuration issue with your PC.
- jonathanstrange 6y agoYou can mix a surround effect for stereo headphones with audio plugins like DearVR Pro but I personally find all these psychoacoustic effects lacking. I wouldn't use them for music. For effects they are fine, though. Mixing with such plugins is weird because you have to run everything through them and "build" any stereo effects by hand - because sounds become so localizable that they sound like someone positioned a single speaker somewhere. Just like real surround sound, it also often sounds very unnatural and you cannot really use any other reverbs or delays for sound sculpting.
- gens 6y agoThief the dark project supports HRTF through OpenAL Soft[0]. Head related transfer function is the.. modeling of how sound waves bounce of your body (shoulders, ears, breast). And it's a part of how we determine where a sound is coming from. Other part is the timing, as in the difference of phase of sound coming in one and in the other ear. Amplitude(volume) is also a part, probably, but we are much more sensitive to difference in phase then amplitude. If you want to start researching in these things; the start is probably "impulse response" as well as.. a lot really (systems and signals is a heavy book that i should read one day). Just remember that everything is a spring. As for practical modeling in 3D games and such. The problem is almost the same as global illumination. You would need to model the whole environment and how it responds to sound (absorption, reflection, idk probably even the speed of sound in various materials to be accurate). A great youtube person has a couple videos on whitepapers about this [1-2](the 2 is more practical). Valve bought a company that played with these things, but idk if anything came out of it (iirc it is part of the steam framework now). [0]https://www.youtube.com/watch?v=VW-W3A2l5UE https://www.youtube.com/watch?v=VW-W3A2l5UE [1]https://www.youtube.com/watch?v=DzsZ2qMtEUE https://www.youtube.com/watch?v=DzsZ2qMtEUE [2]https://www.youtube.com/watch?v=Mx8viOFKiIs https://www.youtube.com/watch?v=Mx8viOFKiIs PS Headphones are better then 5.1/7.1 for surround sound, mostly because of room acoustics.
- bollu 6y agoI began to write an acerbic comment at "everything is a spring". I then thought about it, and realised you're so right. Linear algebra is crazy. Thank you for the insight. (It struck me that all of quantum mechanics I've ever studied in university was about learning to solve more sophisticated harmonic osciollators.)
- saturdaysaint 6y agoNow that tactical shooters have gone from a hardcore gamer niche to arguably the primary way many teenagers hang out with peers, good spatial sound is a huge opportunity. If someone could make $200 headphones where you could easily perceive if someone was above you or below you in Fortnite or Warzone, you would have a billion dollar company. As it is, most of us need visual indicators to tell where a nearby gunshot on the same level as us came from.
- Cthulhu_ 6y agoErr. There are plenty of surround sound headphones in the <$200 range, like ones from Logitech, and they are a billion dollar company.
- gruez 6y agoI think he's talking about the "virtual" surround that's mentioned in the article, rather than the "true" surround that's in most consumer headphones these days. The article mentions that the former is superior because they can simulate effects from other parts of your body (eg. chest/shoulders) and can be combined with head tracking.
- moftz 6y agoI bought a $200 wireless Turtle Beach headset for my Xbox 360 in 2010 (released in 2008) that came with Dolby Surround 7.1 and Dolby Pro Logic IIx which is meant for creating surround sound from stereo sources. It has both a stereo RCA and Toslink inputs. You're over a decade behind the times.
- tapper 6y agoThey all sound like shit. I am blind and my years keep me alive on a Daly.
- ganafagol 6y agoFor an article posted to Hacker News, this is disappointingly low on technical details. So there is some "heavy signal processing" involved. And there are a few brands that sell it. Um ok. But how do they work? How do they simulate those clues tht the ears get through physical phenomena? As-is, the article is more like a mix of product history and sales pitch than something a hacker enjoys/expects. Imagine an article about brtfs just mentioning when it started and that it procides snapshots. Yeah .. sure, but how? That's what interests a hacker.